• Software Engineering Manager - Meta…

    Meta (Menlo Park, CA)


    Summary:

    Meta is seeking hands-on engineering managers to join the Meta SuperIntelligence Lab (MSL), making direct contributions to the next generation of Generative AI models. The MSL Infra Optimizations team’s mission is to enable the development and productionization of cutting-edge high-performance optimizers, kernels and numeric algorithms, providing comprehensive analyses of their effect for MSL. Join us and be a part of the team that is shaping the future of Meta SuperIntelligence Lab’s infrastructure!

    Required Skills:

    Software Engineering Manager - Meta Superintelligence Labs - Infra: Optimizations Team Responsibilities:

    1. Lead and support the team that develops various kernels including but not limited to GEMMs, Attention mechanisms etc. Also, contribute to enabling performance at scale of our inference and training of next generation GenAI (Llama) models

    2. Enable the growth of individual contributors, driving the technical roadmap along with technical leads and expand the impact of the team by growing new skill-sets and capabilities

    3. Lead a high performance team of engineers to deliver new capabilities and efficient compute systems for our fleet

    4. Technical management

    5. Experience in systems architecture, performance, workload-analysis and large scale distributed systems

    6. Work cross-functionally across hardware and software/services team to drive engineering efforts

    Minimum Qualifications:

    Minimum Qualifications:

    7. MS or BS in Computer Science or Electrical/Electronics Engineering or equivalent

    8. 3+ years of experience of directly managing or leading a team of engineers with varied skill levels

    9. Experience in leading teams working on high performance computing (HPC) and AI/ML systems, including:

    10. GPU/ASIC-based kernel development and optimization (e.g. CUDA)

    11. Distributed systems for large scale training and serving

    12. Systems Architecture + Performance

    13. Large scale distributed systems

    14. Experience running a large-scale program and dealing with ambiguity

    Preferred Qualifications:

    Preferred Qualifications:

    15. Familiarity with the latest techniques in optimizing GenAI workloads

    16. Using frameworks like PyTorch, TorchTriton to develop custom kernels

    17. Understands Kernel enablement and optimizations, including experience working on attention kernels

    18. Understanding GPU memory hierarchy and computation capabilities

    19. Understands low-level CUDA kernel optimizations for inference and training

    20. Experience with Quantization and structure sparsity for low precision training & inference

    21. Understands Optimizers such as Adam, Shampoo, Muon

    Public Compensation:

    $177,000/year to $251,000/year + bonus + equity + benefits

    **Industry:** Internet

    Equal Opportunity:

    Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

     

    Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [email protected].