-
Sr. Data Engineer
- Insight Global (Minnetonka, MN)
-
Job Description
Optum Government Solutions is looking for a Sr. Data Engineer - ETL Developer to assist the AL DSS by developing and maintaining workflows, identifying, and resolving data quality issues, and optimizing processes to improve performance. This Data Engineer will also support intrastate agencies by monitoring automated data extracts and working directly with state partners to create new extracts based on business specifications.
Day to Day/Responsibilities:
- Collaborate with ETL architect and cross-functional teams to design data transformations for end-user needs.
- Implement, design, and automate ETL flows and architecture.
- Analyze data to identify ETL pipeline issues, alert stakeholders, and recommend fixes.
- Build and maintain ETL pipelines using Azure Data Factory (ADF) and Snowflake.
- Design resilient ETL processes that allow error-free reruns of failed jobs.
- Automate data ingestion in Snowflake using Snowpipe and manage Virtual Warehouses.
- Track dimensional changes and versioning with Streams and Tasks in Snowflake.
- Develop orchestration workflows for scheduling, data quality checks, and dependency management.
- Test ETL code, perform root cause analysis, and document implementations for CI/CD.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Skills and Requirements
- 8-10+ years Snowflake
- 3-4+ years creating pipelines in ADF
- 5+ years in Data Engineering with a focus on Data Warehousing
- 5+ years developing ETL using Informatica PowerCenter, SSIS, Azure Data Factory (ADF), or similar tools
- 5+ years with Relational Databases such as Oracle, Snowflake, SQL Server, etc.
- 3+ years creating store procedures with Oracle PL/SQL, SQL Server T-SQL, or Snowflake SQL
- 2+ years with GitHub, SVN, or similar source control systems
- 2+ years processing structured and un-structured data
- 3+ years analyzing project requirements and developing detailed specifications for ETL requirements
- Experience with HL7 and FHIR standards and processing files in these formats
- Problem-solving and analytical skills to troubleshoot and optimize data pipelines
- Ability to adapt to evolving technologies and changing business requirements
- Bachelor's Degree or higher in Information Technology/Computer Science, Mathematics/Statistics, Analytics, Business or a related field
- Experience Data Engineering in Healthcare industry - Medicare/Medicaid experience HIGHLY preferred - 2+ years of batch or Powershell scripting
- 2+ years of Python scripting
- 3+ years of data modeling in a data warehouse environment
- Experience/familiarity with Informatica Intelligent Cloud Services (specifically Data Integration)
- Experience designing and building APIs in Snowflake and ADF (e.g. REST, RPC)
- Azure certifications related to data engineering or data analytics
Experience with State Medicaid/Medicare****
-