-
Data Engineer (Airflow, PySpark, Dataricks)
- Robert Half Technology (Washington, DC)
-
Description
We are looking for a skilled Software Developer with expertise to join our team in Washington, DC. This is a long-term contract position offering the opportunity to work on innovative projects and contribute to the development of high-quality software solutions. The ideal candidate will possess strong problem-solving skills and collaborate with cross-functional teams to ensure seamless application performance and scalability.
As a Data Engineer, you will:
+ Design and optimize data ingestion and indexing pipelines
+ Work with structured and unstructured data to support real-time search capabilities
+ Develop and maintain workflows using Airflow, PySpark, and Databricks
+ Build and deploy infrastructure using Terraform
+ Index data into Elasticsearch or AWS Search with low latency
+ Troubleshoot networking and cloud infrastructure issues
+ Collaborate on potential API service development (in planning phase)
+ Contribute to infrastructure scalability (possible use of Kubernetes)
Requirements
Tech Stack
+ Languages & Tools: Python, PySpark, Pandas
+ Cloud & Infrastructure: AWS (Glue, ECS, Lambda, S3, RDS, Athena), Airflow, Databricks, Jupyter Notebooks, Terraform, Elasticsearch/AWS Search
+ Development: Microservices, API development (FastAPI, Django – nice-to-have)
+ Containerization & Orchestration: Docker, Kubernetes (optional)
Required Qualifications
+ 3–5+ years of experience in data engineering
+ Strong proficiency in:
+ AWS
+ Python
+ PySpark (basic or better)
+ Airflow
+ Terraform
+ Cloud networking troubleshooting
Preferred Skills
+ Experience with Elasticsearch or AWS Search
+ Familiarity with Kubernetes
+ Background in microservices/API development
+ Cloud database setup and optimization
Technology Doesn't Change the World, People Do.®
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.
All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
• 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .
-
Recent Searches
- Support Logistics Section Manager (United States)
- Data Engineer Aws Python (United States)
- Principal Senior Principal Field (Vermont)
- Fulfillment Associate II THD (United States)
Recent Jobs
-
Data Engineer (Airflow, PySpark, Dataricks)
- Robert Half Technology (Washington, DC)