-
Senior Data Engineer
- Robert Half Technology (Houston, TX)
-
Description
Robert Half is seeking a highly skilled Senior Data Engineer with deep expertise in the Microsoft Azure data ecosystem and Databricks to design, build, and optimize robust, scalable data pipelines and analytics platforms. This role will play a critical part in delivering enterprise-grade data solutions that support business intelligence, advanced analytics, and data science initiatives. Apply today to learn more about this exciting opportunity!
Key Responsibilities:
+ Design and develop end-to-end data pipelines using Azure Data Factory, Azure Synapse, Azure Data Lake, and Azure SQL/SQL MI.
+ Develop and optimize big data processing workflows using Azure Databricks (PySpark/Scala).
+ Implement and maintain ETL/ELT processes for large-scale, structured and unstructured data sources.
+ Collaborate with data scientists, analysts, and stakeholders to deliver clean, reliable, and performant datasets.
+ Leverage CI/CD practices to deploy data solutions using Azure DevOps.
+ Apply data governance, security, and compliance best practices across the data lifecycle.
+ Monitor, troubleshoot, and optimize data workflows for performance and cost-efficiency.
+ Work in agile teams to continuously improve data architecture and engineering practices.
Requirements
Requirements:
+ 5+ years of experience in data engineering or software development
+ Strong expertise in Microsoft Azure data services (ADF, Databricks, Synapse, Data Lake, Azure Functions, Event Hub, etc.)
+ Proficiency with Databricks and big data frameworks (e.g., Spark, Delta Lake)
+ Experience with Python, SQL, and optionally Scala
+ Familiarity with DevOps tools (e.g., Git, Azure DevOps, Terraform) and CI/CD pipelines
+ Solid understanding of data modeling, warehousing, and performance tuning
+ Excellent problem-solving and communication skills
Preferred Qualifications:
+ Experience working in high-volume, enterprise-scale environments
+ Familiarity with streaming data solutions (Event Hubs, Kafka)
+ Prior work with MLOps pipelines or support for data science teams
+ Knowledge of Power BI or similar BI tools for data visualization
+ Experience with infrastructure-as-code and dataOps practices
+ Exposure to Azure Purview, Databricks Unity Catalog, or other data governance tools
+ Background in a regulated industry such as finance, healthcare, or insurance
+ Relevant certifications (e.g., Azure Data Engineer Associate, Databricks Certified Data Engineer)
Technology Doesn't Change the World, People Do.®
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.
All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
• 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .
-