-
Cloud Data Engineer (Azure)
- DATAMAXIS (Dearborn, MI)
-
Cloud Data Engineer will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling is a must with Python programming background. The Data Engineer will be responsible for providing design and development solutions for applications in the cloud.
Essential Job Functions:
+ Understand requirements and engage with team to design and deliver projects.
+ Design and implement data lake house projects within azure.
+ Design and develop application lifecycle utilizing Microsoft Azure technologies
+ Participate in design and planning and necessary documentation
+ Participate in Agile ceremonies including daily standups, scrum, retrospectives,demos, code reviews.
+ Hands on with Python development and Azure data pipelines
+ Engage with team to develop and deliver cross functional products
+ Postgres SQL knowledge is a plus
Minimum Qualifications and Job Requirements:
+ Bachelor's degree in CS.
+ 7 years of hands-on experience in designing and developing distributed data pipelines.
+ 5 years of hands-on experience in Azure data service technologies.
+ 5 years of hands-on experience in Python, SQL, Object oriented programming, ETL and unit testing
+ Experience with data integration with APIs, Web services, Queues
+ Experience with Azure DevOps and CI/CD as well as agile tools and processes including JIRA, confluence.
+ Working experience with writing SQL queries from scratch
Key Skills
a. Data Engineering and SQL
b. Python
c. PySpark
d. Azure Data lake and ADF
Other Responsibilities:
+ Document and maintain project artifacts.
+ Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
+ Complete training as required for Privacy, Code of Conduct etc.
+ Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
+ Adhere to the company's compliance program.
+ Safeguard the company's intellectual property, information, and assets.
-
Recent Jobs
-
Cloud Data Engineer (Azure)
- DATAMAXIS (Dearborn, MI)
-
Principal Scientist, Analytical R&D
- Merck & Co. (Rahway, NJ)
-
Retail Field Merchandiser- Immediate Need
- SRS Merchandising (Friday Harbor, WA)
-
Associate Director, Business of IT Communications and Change Management Lead
- Merck & Co. (Upper Gwynedd, PA)