• Big Data Engineer INTL India

    Insight Global (Phoenix, AZ)


    Job Description

    Insight Global is seeking a skilled and motivated Big Data Engineer to join our clients GenAI applications team based out of India. This role is part of a strategic initiative to migrate their data infrastructure from on-premise to Google Cloud Platform (GCP). You will work closely with a high-performing team of engineers and leaders to build scalable data solutions and support cloud-native application development.

    Key Responsibilities:

    Design, develop, and maintain scalable big data pipelines and applications.

     

    Collaborate with cross-functional teams to support the migration from on-prem to GCP.

     

    Contribute to the development of GenAI-powered applications and services.

     

    Participate in whiteboarding sessions and technical discussions to solve complex problems.

     

    Ensure high performance, reliability, and scalability of data systems.

     

    Work closely with senior engineers and leadership to align with project goals.

     

    We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf) .

     

    To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

    Skills and Requirements

    35 years of hands-on experience in Big Data engineering.

     

    Proficiency in Python (Java is a plus).

     

    Strong understanding of Google Cloud Platform (GCP) services and architecture. GCP certification is a plus.

     

    Solid problem-solving skills and a structured thought process.

     

    Experience with data migration and cloud-native development is highly desirable.

     

    Experience with building RESTful APIs

     

    Thorough understanding of JSON, and data structure fundamentals

     

    Expertise in objected oriented analysis and design across a variety of platforms

     

    Fundamental knowledge of distributed computing and Experience in Big Data Technologies like Spark, Hive, distributed computing.

     

    Experience with workflow scheduling tools. Airflow experience is desirable.

     

    Demonstrated experience in Agile development, application design, software development, and testing

     

    Hands-on expertise with application design, software development and automated testing

     

    Experience with distributed (multi-tiered) systems, algorithms, and relational databases

     

    Aptitude for learning and applying programming concepts

     

    Ability to effectively communicate with internal and external business partners Experience working in hybrid teams and agile environments.

     

    Exposure to GenAI or AI/ML-based applications.

     

    Familiarity with vendor collaboration (e.g., Infosys, IBM, CDS). null

     

    We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].