• Databricks Architect - Remote

    Cognizant (San Francisco, CA)


    Job Title - Databricks Architect

    Job Summary

    Databricks Architect with expertise in building scalable data solutions on AWS

    + Supply Chain, Consumer Goods / Retail domain knowledge required.

    + Experience in modernizing (solutions and hands-on execution) enterprise data platforms from legacy to AWS cloud

    + Deep knowledge and experience in Data Modelling (OLAP and OLTP), Data Lake, Data Warehousing, ETL/ELT pipelines on both on-premise legacy and on AWS

    + Lead migration and modernization of legacy ETL processes from Informatica, DataStage, and SQL Server to cloud-native solutions.

    + Design and optimize data workflows for ingestion, transformation, and analytics using AWS-native services

    + Design and Build data pipelines and solutions using Databricks (PySpark and SparkSQL) on AWS

    + Experience with building Medallion architecture based data estates

    + Experience in building Databricks Delta Lake based Lakehouse using DLT, PySpark Jobs, Databricks Workflows

    + Proficient in SQL, Python, PySpark, S3, Lambda

    + Working knowledge of Git, CI/CD, VS Code

    + Proficient in AWS data ingestion stack

    + Must have knowledge and ability to scale up on Glue, Lambda, Step Functions, Spark Streaming and other services on a need basis

    + Implementation experience of several key data concepts such as CDC (Change Data Capture), Streaming and/or Batch ingestion, Pull v/s Push paradigms, Source to Target mapping, and so on

    + Collaborate with cross-functional teams to gather requirements and deliver scalable, secure, and high-performance data solutions.

    + Strong semantic layer modelling and implementation experience

    + Establish best practices for data governance, lineage, and quality across hybrid environments.

    + Provide technical leadership and mentoring to data engineers and developers.

    + Monitor and troubleshoot performance issues across Databricks and AWS services.

    + Understanding of key reporting stack such as Power BI, Tableau, Alteryx, Excel BI Add-Ins a plus

    Certifications Required

    Databricks Certified Data Engineer Associate

    **Applications will be accepted until 10/17/25**

    Salary and Other Compensation:

    The annual salary for this position is between $88,200 - $139,500 depending on experience and other qualifications of the successful candidate.

    Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

    Medical/Dental/Vision/Life Insurance

     

    Paid holidays plus Paid Time Off

     

    401(k) plan and contributions

     

    Long-term/Short-term Disability

     

    Paid Parental Leave

     

    Employee Stock Purchase Plan

     

    Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

     

    Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.