- NVIDIA (Santa Clara, CA)
- …and see how you can make a lasting impact on the world. We are seeking a Principal Software Engineer to join our Software Infrastructure Team in Santa ... be a key leader in designing and developing our Inference as a Service platform, creating the systems that...What we need to see: + 15+ years of software engineering experience with deep expertise in distributed systems… more
- ManpowerGroup (Boston, MA)
- …innovation which will align successfully in the organization. **Job Title:** Principal Software Engineer - Model Inference **Location: Raleigh, NC or ... a leader in the technology sector, is seeking a Principal Software Engineer to join...Job?** + Develop and maintain a high-quality, high-performing ML inference runtime platform for multi-modal and distributed model serving.… more
- Snap Inc. (Palo Alto, CA)
- …with privacy at the forefront. We're looking for a Principal Machine Learning Engineer to join Snap's ML Inference Platform team! What you'll do: + Design, ... Snap's most strategic initiatives + Design and build a next-generation inference framework and services that can support large-scale model, high-throughput serving,… more
- Red Hat (Boston, MA)
- …closely with our product and research teams to scale SOTA deep learning products and software . As an ML Ops engineer , you will work closely with our technical ... open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings...years of experience in MLOps, DevOps, Automation and modern Software Deployment practices + Strong experience with Git, Github… more
- Red Hat (Boston, MA)
- …bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI ... optimize, and scale LLM deployments. As a GPU Kernel Engineer focused on vLLM, you will be at the...computing will directly impact the development of our cutting-edge software platform, helping to shape the future of AI… more
- Microsoft Corporation (Redmond, WA)
- …many exciting problems on the intersection of AI and Cloud. We're looking for a ** Principal Software Engineer ** **- Azure AI Inferencing** to drive the ... Microsoft Azure AI Inference platform is the next generation cloud business positioned to address the growing AI market. We are on the verge of an AI revolution and… more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Principal Deep Learning Software Engineer , LLM Performance! NVIDIA is seeking an experienced Deep Learning Engineer passionate ... set of teams involving performance modeling, performance analysis, kernel development and inference software development. What you'll be doing: + Performance… more
- Microsoft Corporation (Mountain View, CA)
- …in major Microsoft products, including Office, Windows, Bing, SQL Server, and Dynamics. As a Principal Software Engineer on the team, you will have the ... themselves on a collaborative and inclusive culture. We own inference performance of OpenAI and other state of the...remote locations considered for strong candidates. **Responsibilities** As a Principal Software Engineer on the… more
- Microsoft Corporation (Redmond, WA)
- …agents that listen, respond, and act in real-time based on audio signals. As a Principal Software Engineer you'll collaborate with Teams and Azure AI ... how AI transforms human collaboration-and we're building the future of meetings. As a Principal Software Engineer on the Intelligence Meeting Runtime team,… more
- Microsoft Corporation (Redmond, WA)
- …Our mission is to enable state-of-the-art large language model (LLM) training and inference through deep optimization across the full software and hardware ... is part of a highly specialized sub-team focused on building the end-to-end software stack for Microsoft's first-party (1P) AI accelerators. Our work is foundational… more