"Alerted.org

Job Description

One of Insight Global's retail clients is searching for a Data Engineer who will support the data engineering function by assisting in the development and maintenance of robust data pipelines and collaborating with various teams. Key responsibilities include:

• Development and management of data pipelines for various data sources such as e-commerce, stores, suppliers & vendors, and internal ERP systems

• Supporting senior data engineers and data architects in building and maintaining data infrastructure and architecture and ensuring data integrity and security.

• Collaborating with cross-function teams including Data engineers, Data architects, Business Analyst, IT leaders and business users to understand data requirements

• Assisting in maintaining the code repository and assist in maintaining and promoting the pipelines through CI/CD

• Responsible for performing root cause analysis on internal and external data processing related issues

• Maintain documentation and create high level data flow and low-level data flow for the pipelines

• Following best practices in coding and maintaining data pipelines to ensure efficiency, reliability, and scalability

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

• Bachelor’s degree in computer science, Information Technology, or a related field.

• 3-5 years of hands-on experience with Data Engineering, BI, or Data Warehousing.

• Strong experience on Azure Databricks, Azure Data Factory, Azure Key Vault, ADLS

• Proficiency in Python and SQL.

• Experience with Data integration, ingestion, transformation and modelling

• Basic understanding of agile project delivery framework and DevOps processes.

• Familiarity with visualization platforms like PowerBI

• Basic knowledge of modeling techniques (star schema, OLAP) and workflow orchestration (Apache Airflow)

• Knowledge on using AI tools like Co-pilot, ChatGPT, Databricks Assistant, Github Co-pilot

• Excellent written and verbal communication skills.

• Self-starter who welcomes responsibility and is eager to learn and grow and should be able to work with the team • Basic knowledge on AI/ML concept will be plus