• Sr. IaC Systems/Cloud Engineer(Big Data)

    Insight Global (Glendale, CA)


    Job Description

    The Ad Infrastructure team is looking for a seasoned Software and Cloud Infrastructure Engineer to help build and scale our data processing platforms. This role is focused on enabling infrastructure and DevOps capabilities for high-scale batch and streaming workloads, including Spark and Flink on EKS. Our mission is to reduce the cognitive load on application and data teams by delivering scalable, secure, and easy-to-operate infrastructure and tools that accelerate development and delivery.

     

    What Youll Do

     

    - Design, build, and maintain infrastructure automation and tooling that enables developers to deploy and operate cloud-native applications.

     

    - Implement best practices for secure, scalable, and cost-efficient cloud operations across AWS.

     

    - Contribute to and maintain a robust library of shared Terraform modules and infrastructure-as-code standards.

     

    - Participate in root cause analyses (RCAs) and postmortems to continuously improve reliability and operational practices.

     

    - Support container orchestration and workload scaling on Kubernetes (EKS) for Spark and Flink jobs.

     

    - Collaborate with development teams to ensure seamless onboarding and operational support for infrastructure tooling and platforms.

     

    - Participate in on-call rotations and own uptime and reliability of key systems.

     

    - Drive adoption of DevOps practices, including CI/CD workflows, observability, and incident management.

     

    We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf) .

     

    To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

     

    Skills and Requirements

     

    Onsite 4 Days: San Francisco

     

    Must be willing to be included in on call rotation once per month

     

    - 7 plus years of experience in infrastructure engineering, DevOps, or cloud-native software engineering.

     

    - 4 plus years of hands-on experience with Kubernetes, preferably on Amazon EKS.

     

    - 3 plus years of experience with Python or Go for infrastructure automation.

     

    - 3 plus years working with data processing frameworks such as Apache Airflow, Spark, or Flink.

     

    - 2 plus years designing and operating Databricks environments at scale on AWS, including performance tuning and securing workloads.

     

    - Expertise in AWS services (EC2, S3, IAM, VPC, etc.), infrastructure automation, and Terraform.

     

    - Experience with container technologies (Docker) and CI/CD tools like Spinnaker.

     

    - Strong communication skills and a collaborative mindset for working across engineering teams. - AWS Certifications (e.g., Solutions Architect, DevOps Engineer).

     

    - Experience with Unix/Linux systems and shell scripting.

     

    - Familiarity with all three: Airflow, Spark, and Flink.

     

    - Experience operating service mesh technologies like Istio.

     

    - Experience running Spark or Flink workloads on Databricks. null

     

    We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].