• Software Engineer III (Distributed Systems)

    Insight Global (Menlo Park, CA)


    Job Description

    Insight Global is looking for a Software Engineer to join one of the world's leading technology companies. You will be part of the Reality Labs organization which brings people around the world together through next generation Augmented, Mixed, & Virtual Reality products. We are seeking a skilled and experienced engineer to join our team as a Distributed Systems Specialist. As a generalist with expertise in distributed systems, you will play a key role in designing, developing, and optimizing our data generation pipelines for maximum efficiency. Your experience with DAGs/Graphs, large fan-out loads, and distributed workers/jobs will be instrumental in helping us scale our systems to meet the growing demands of our users.

    Responsibilities:

    Design, develop, and optimize data processing pipelines using DAGs/Graphs and distributed workers/jobs

     

    Collaborate with cross-functional teams to identify and prioritize system improvements

     

    Develop and implement solutions to handle large fan-out loads and ensure system scalability

     

    Work closely with data scientists and engineers to integrate and scale solutions

     

    Identify opportunities for optimization and implement changes to improve system performance and reduce resource utilization

     

    Pay rate: $75/hr

     

    We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

     

    Skills and Requirements

     

    5+ years of experience in software development, with a focus on distributed systems

     

    Experience with large fan-out loads and distributed workers/jobs

     

    Python (primary language)

     

    Strong problem-solving skills and ability to work independently

     

    Excellent communication and collaboration skills Rust

     

    C+Hack (PHP)

     

    Experience with cloud-based infrastructure, such as AWS or GCP