"Alerted.org

Job Description

We are seeking a highly skilled and motivated Senior Data Engineer with 8+ years of experience to join our team. This role will be pivotal in designing and building our domain data interface. The ideal candidate will be an individual contributor capable of leading design discussions, making informed design decisions, and collaborating with stakeholders to create canonical data models. This role offers the opportunity to play a crucial part in shaping the architecture and success of our data solutions.

Design, build, and maintain scalable data pipelines and ETL processes using Azure Data Factory, Databricks, and PySpark.

Architect and implement cloud-based data solutions on Azure, leveraging services such as Azure Synapse Analytics, Azure Data Lake Storage, and Azure SQL.

Develop and optimize complex SQL queries and stored procedures for data transformation and reporting.

Work with structured and unstructured data to create clean, reusable datasets for analytics and business intelligence.

Monitor, troubleshoot, and improve the performance and reliability of data workflows and pipelines.

Ensure data quality, governance, and security standards are consistently met.

Collaborate with data scientists and analysts to support ML and AI initiatives.

Contribute to best practices, documentation, and knowledge sharing within the data engineering team.

We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf) .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

8+ years of experience in data engineering or related fields.

o Proficiency in Python, PySpark, and SQL.

o Azure, Databricks, and Azure data factory

Strong expertise in supply chain concepts.

Experience with data modeling tools and frameworks.

Strong understanding of data engineering concepts and hands-on experience with Databricks.

Familiarity with system design concepts relevant to data architecture.

Knowledge of data governance practices, including the use of Unity Catalog. Experience developing/designing scalable microservices in Java would be a plus. null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].