- NVIDIA (Santa Clara, CA)
- …of the attention mechanisms. + Hands on experience with large scale training (eg, ZeRO, DDP , FSDP, TP, CP) and data processing (eg Ray, Spark). + All we do is ... in Python and we open source our product, therefore production-quality software engineering skills is highly relevant. + MS or PhD or equivalent experience in Computer Science, Machine Learning, Applied Math, Physics, or a related field. + 5+ years of relevant… more
- Amazon (Cupertino, CA)
- …in Pytorch, XLA, JAX as well as distributed training libraries like FSDP, DDP and others. Includes enabling models using MoE architectures and future newer ... architectures. Lead the way to ensure support for key ML functionality in a combined chip / software platform Ensure the right thing is being built and delivered to customers Key job responsibilities Our engineers and managers collaborate across diverse teams,… more
Recent Jobs
-
Clinical Nurse Coordinator Emergency Department
- HCA Healthcare (Independence, MO)
-
NDI Technician
- PDS Tech Commercial, Inc. (Kinston, NC)
-
Restaurant Manager
- Outback Steakhouse / Out West Restaurant Group (Santa Fe, NM)
-
Instructional Designer, Online Development
- University of Utah (Salt Lake City, UT)