-
Technical Data Quality Engineer
- Comerica (Auburn Hills, MI)
-
Job Description
Technical Data Quality Engineer
The Technical Data Quality Engineering role will support the Data Quality lifecycle from inception to implementation through various distribution channels. This role will ensure data accuracy, consistency, and reliability by establishing data quality rules and standards, monitoring data health, and resolving issues using technical tools and analytical methods. Responsibilities include data profiling, cleansing, reporting on data quality metrics, and collaborating with data engineers, the Data Governance team, and business teams to improve data governance and data integrity across the organization. Key skills involve SQL, programming, data visualization, statistical analysis, and understanding data quality methodologies to ensure data accuracy and support informed decision-making. This role will also have significant ownership of the ultimate success of Data Quality throughout the data life cycle.
Position Responsibilities: Design and Methodology
+ Design, implement and operate medium to large-scale, high-volume, high-performance data structures for reporting, analytics, and data science.
+ Write and refine code to ensure performance and reliability of data extraction and processing.
+ Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes by leveraging big data tools.
+ Create data products for analytics and Data Scientist team members to improve their productivity.
+ Document and test moderate data systems that bring together data from disparate sources, making it available to Data Scientists, and other users using scripting and/or programming languages.
+ Design, develop and build real-time data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages etc.)
+ Leverage the understanding of software architecture and software design patterns to write scalable, maintainable, well-designed, and future-proof software.
+ Manage existing pipelines and create new pipelines from a variety of sources (relational, XML, etc.)
+ Design and build solutions to track data quality, stabilize data pipeline, etc. to ensure reliable operations.
+ Document and test data processes including performance of through data validation and verification.
Technical Consulting
+ Gather business and functional requirements and translate these requirements into robust, scalable operable solutions with a flexible and adaptable data architecture.
+ Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation.
+ Collaborate with Data Scientists to create fast and efficient algorithms that exploit our rich data sets for optimization, statistical analysis, prediction, clustering, and machine learning.
+ Coordination with other teams to design optimal patterns for data ingest and egress, as well as lead and coordinate data quality initiatives and troubleshooting.
+ Participate in sprint planning meetings as needed.
+ Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
+ Optimize support for ad-hod analysis across various data sources.
Planning - Organizing
+ Ensure best practices are followed across architecture, codebase, and configuration.
+ Continually improve ongoing reporting and analysis processes, automating or simplifying self-service modeling and production support for customers.
+ In collaboration with the Data Engineer III, contribute to the exploration and understanding of new tools and techniques for improvements to the data pipeline.
Risk Management
+ Review and are familiar with automated processes for performance and fault tolerance.
+ Review functional and technical designs to identify areas of risk and any missing requirements.
+ Design and implement security measures to protect data from unauthorized access or misuse.
+ In collaboration with the Data Engineer III, design backup and recovery procedures to ensure data integrity is maintained.
Administration/Support
+ Keeps management informed of status of on activities through accurate, timely, and appropriate reporting.
+ Contribute to Data Governance, system documentation and sharing of data asset knowledge.
+ Actively participates in committees representing the department and/or planning unit.
+ Keeps abreast of leading-edge technologies in the Data Engineering space.
Qualifications
Position Qualifications:
+ Bachelor's Degree from an accredited university or 8 years of related experience with a demonstrated ability to successfully perform the requirements of the position
+ 5 years of relevant experience in Information Technology, Information Systems or Product Management
+ 5 years of experience in technical business consulting, business analysis or product design
+ 3 years of experience in strategic development
+ This position is not eligible for sponsorship. Must have indefinite employment authorization.
Preferred Qualifications:
+ 3+ years of experience creating mappings/mapplets and data quality rules using Informatica Cloud Data Quality
+ 3+ years of experience using release management tools such as BitBucket
+ Proficiency in SQL and scripting languages (e.g., Python, JavaScript)
+ Proficiency with data visualization tools such as Power BI
+ Experience with integrating Data Quality rules and results into data catalog and lineage tools.
+ Experience working with software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes and testing
+ Experience building and managing automated workflows using programming language
+ Experience working with Product Managers to prioritize work; and Scrum Masters to create stories and complete sprint deliverables
+ AWS Certification highly desired
+ Experience in the banking and financial services fields
About Comerica
We know our employees are critical to our overall success and we are dedicated to investing in their future. One of the ways we do this is to offer a comprehensive Total Rewards package designed to recognize and reward individual performance, as well support health, well-being, development and security for our colleagues and their family. Total Rewards consists of cash compensation, development and flexible benefit programs designed to meet individual needs today and in the future. Your salary will be commensurate with your work experience and our programs are reviewed regularly to ensure each remain competitive. We are proud to offer benefits such as health and welfare programs, strong retirement benefits, and generous paid time off programs. You and your eligible family members, including domestic partners and their children, can participate in medical, dental, and vision benefits, 401(k) and pension, income protection benefits such as life insurance, AD&D, and supplemental health programs to offset unexpected health care expenses. We also have a variety of time off programs for things like vacation, sick time, disability, and parental leave. Eligibility for some programs varies based on employment status and tenure.
Upon offer, Comerica conducts a comprehensive background and fingerprint check. Your fingerprints will be used to check the criminal history records of the FBI and may be subscribed in the FBI's Record of Arrest and Prosecution Background ("RAP Back") service, which provides ongoing notification to the Company of any updates to your criminal history.
NMLS certification requirement: where applicable, a favorable background check screening, credit check, fingerprint check, and NMLS certification is required in accordance with the SAFE Act.
Comerica Incorporated (NYSE: CMA) is a financial services company headquartered in Dallas, Texas, and strategically aligned into three major business segments; the Commercial Bank, the Retail Bank, and Wealth Management. Comerica's colleagues focus on relationships, and helping people and businesses be successful. In addition to Texas, Comerica Bank locations can be found in Arizona, California, Florida and Michigan, with select businesses operating in several other states, as well as in Canada and Mexico.
Comerica is proud to be an Equal Opportunity Employer-disability/veteran
-
Recent Jobs
-
Technical Data Quality Engineer
- Comerica (Auburn Hills, MI)
-
Software Engineer - Level 3 or 4
- Northrop Grumman (Fairfax, VA)
-
Software Developer
- Three Saints Bay (Montgomery, AL)