"Alerted.org

Summary:

This team works at the center of some of the most exciting and innovative parts of AI. This is an opportunity to ensure Meta continues to scale and optimize next generation ML models and training clusters by working across multiple products groups, next generation model architectures, scale up AI training, and hardware accelerators (GPUs).

Required Skills:

Engineering Manager, Software Engineering, PyTorch Training Acceleration Responsibilities:

1. Develop the foundational technology to unlock new model development paradigms and bring the state of the art algorithms and infra to PyTorch.

2. Develop systems and techniques to leverage Accelerators like NVIDIA and AMD GPUs to scale and optimize AI Training

3. Explore and adapt PyTorch technologies to the right problems that Meta Product Groups are facing. Along the way, optimize, improve, and work closely with other PyTorch teams to push forward in directions that maintain PyTorch as an industry leading ML framework that users love.

4. Manage engineers and help them develop their careers, assigning them to projects tailored to their skill levels, long-term skill development, personalities, and work styles.

5. Communicate and collaborate effectively with cross-functional hardware and software engineering teams.

6. Operate strategically and tactically. Develop the vision and strategy to help set direction for the team.

7. Work closely with dedicated recruiting staff to expand the team, including sourcing candidates, interviewing candidates, participating in conferences/events, and onboarding new employees.

Minimum Qualifications:

Minimum Qualifications:

8. At least 8 years of experience in managing a software team in a fast-paced environment, including managing managers.

9. Worked on Large scale distributed training, Fully Sharded Data Parallel, Parallelism Mechanisms (Tensor Parallelism, Pipeline Parallelism, Expert parallelism)

10. Understand and analyze the interplay of hardware and software architectures on future algorithms, programming models and applications.

11. Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management.

Preferred Qualifications:

Preferred Qualifications:

12. Managed an org that has done Accelerator (GPU/ASIC) kernel development and optimization.

13. Managed org that has experience in accelerating libraries on AI hardware, similar to cuBLAS, cuDNN, CUTLASS, HIP, ROCm etc.

14. Experience working closely with hardware architectures such as Intel SIMD, GPU, RISC-V, AI Accelerators etc.

15. Knowledge of ML frameworks like PyTorch, TensorFlow, ONNX, MXNet, etc.

Public Compensation:

$213,000/year to $293,000/year + bonus + equity + benefits

**Industry:** Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [email protected].