• Databricks Specialist

    Robert Half Technology (Houston, TX)


    Description

    We are seeking an experienced Databricks Specialist to join our data and analytics team to architect, design, and optimize data solutions using the Databricks platform. The ideal candidate will have deep expertise in data engineering practices, big data tools, and cloud technologies to enable advanced analytics, machine learning, and scalable data processing. This role is perfect for someone who thrives on managing complex data applications and driving innovation within fast-paced environments.

    Key Responsibilities:

    + Databricks Platform Expertise: Design, develop, and implement data pipelines, ETL processes, and analytics workflows on Databricks, ensuring optimized performance and scalability.

    + Big Data Processing: Leverage frameworks such as Apache Spark within Databricks to efficiently process and analyze large datasets across a variety of structured, semi-structured, and unstructured formats

    + Data Engineering: Build and maintain robust data models, workflows, and engineering pipelines to ensure the seamless movement of data between systems

    + Integration & Automation: Integrate Databricks with other cloud tools and platforms, such as Azure, AWS, or Google Cloud, and automate processes using infrastructure-as-code tools like Terraform or CloudFormation.

    + Collaboration: Work closely with data scientists, business analysts, and IT teams to align data solutions with analytics and machine learning needs.

    + Data Governance: Implement and enforce data quality, security, and governance standards within Databricks projects, ensuring compliance with organizational and regulatory requirements

    + Optimization: Troubleshoot and optimize Spark queries and Databricks workflows for better performance and cost management in cloud environments.

    + Reporting and Visualization: Collaborate on building dashboards and data visualizations using connected tools like Power BI or Tableau to provide actionable insights for stakeholders.

    + Training & Best Practices: Act as the subject matter expert for Databricks, mentoring team members on best practices for the platform and staying updated on emerging trends

    Requirements

    + Bachelor’s degree in Computer Science, Data Engineering, Information Technology, or a related field.

    + Proven experience (3+ years) working with Databricks, Apache Spark, and big data processing.

    + Hands-on expertise in Python, Scala, or Java for data engineering tasks.

    + Experience with SQL for data manipulation and querying.

    + Solid understanding of cloud platforms, particularly Azure Databricks, AWS EMR, or GCP Dataproc.

    + Familiarity with Delta Lake, data lakes, and building scalable architecture for real-time and batch data processing.

    + Excellent problem-solving skills and analytical mindset.

    + Ability to communicate technical concepts to non-technical stakeholders in a clear and concise manner.

    Preferred Qualifications:

    + Certifications such as Databricks Lakehouse Fundamentals or Databricks Certified Data Engineer Associate.

    + Experience with machine learning workflows in Databricks.

    + Knowledge of DevOps practices and automation tools (e.g., Docker, Kubernetes, Jenkins).

    + Familiarity with BI tools like Power BI, Tableau, or Looker.

    + Experience with advanced analytics workflows such as forecasting, clustering, or recommendation engines.

    Key Competencies:

    + Expertise in data engineering and big data best practices

    + Proficiency with Databricks tools and features, from Delta Lake to Databricks Machine Learning.

    + Collaborative approach to problem-solving and innovation.

    + Strong focus on data-driven decision-making and scalability.

     

    Technology Doesn't Change the World, People Do.®

     

    Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

     

    Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.

     

    All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

     

    • 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .