- NVIDIA (Santa Clara, CA)
- …efficient, resilient deployment of cutting-edge LLM workloads. We are seeking a Principal Systems Engineer to define the vision and roadmap for memory ... inference. + Architect and implement deep integrations with leading LLM serving engines (such as vLLM, SGLang,...are growing fast. If you're a creative and autonomous engineer with a genuine passion for technology, we want… more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Principal Software Engineer , TensorRT- LLM ! NVIDIA is hiring experienced principal software engineer for its TensorRT- LLM ... an "iPhone moment". Join the team building the AI serving software which is foundational to product lines within...in deep learning like LLMs + Experience working with LLM inference frameworks like vLLM, SGLang, etc. + Experience… more
- Microsoft Corporation (Redmond, WA)
- …modern web tech, serving millions of users worldwide at scale. We are seeking a ** Principal Software Engineer ** for the Teams Platform, with a focus on AI & ... LLM technologies, to design and build our next-generation programmability...support Model Context Protocol (MCP), agent-to-agent communication, and secure LLM -driven experiences-at hyperscale. You will be empowered to make… more
- Palo Alto Networks (Santa Clara, CA)
- …ensuring a formidable security posture from development through runtime. As a Senior Principal Machine Learning Engineer , you will drive research on cutting-edge ... areas, including AI-Native Security ( LLM , AI Agent, Model Supply-Chain, Runtime AI) and the...scalable, low-latency, and resilient ML inference platform capable of serving a diverse range of models for real-time security… more
- NVIDIA (Santa Clara, CA)
- …engineers enthusiastic about building the next generation of scalable AI systems. As a Principal Software Engineer on the Dynamo project, you will address some ... supporting a variety of LLM frameworks (eg, TensorRT- LLM , vLLM, SGLang). + Disaggregated Serving : Architect...are growing fast. If you're a creative and autonomous engineer with a genuine passion for technology, we want… more
- Red Hat (Boston, MA)
- …enterprises to build, optimize, and scale LLM deployments. As a Senior Principal Machine Learning Engineer focused on model optimization algorithms, you will ... You will collaborate with our technical and research teams to develop LLM training and deployment pipelines, implement model compression algorithms, and productize… more
- Microsoft Corporation (Redmond, WA)
- **Overview** Microsoft Advertising is seeking a ** Principal Software Engineer ** to join our **Ads Engineering Platform** team and advance the core capabilities ... I/O, and maximizing GPU occupancy and kernel fusion for deep learning and LLM workloads. + **Strong understanding of model- serving trade-offs** -batching vs.… more
- Microsoft Corporation (Redmond, WA)
- …AI and how our lives and society will be impacted? We are seeking an experienced ** Principal Software Engineer - AI Safety and Security** to join a high impact ... the intersection of cybersecurity and generative AI. As a Principal Software Engineer - AI Safety and...This encompasses providing infrastructure for AI safety and security; serving as a coordination point for all things AI… more
- Microsoft Corporation (Mountain View, CA)
- …major Microsoft products, including Office, Windows, Bing, SQL Server, and Dynamics. As a Principal Engineer on the team, you will have the opportunity to work ... performance of OpenAI and other state of the art LLM models and work directly with OpenAI on the...locations considered for very strong candidates. **Responsibilities** As a Principal Software Engineer on the team the… more
- JPMorgan Chase (Palo Alto, CA)
- **Job Summary:** We are seeking a highly skilled and experienced Principal AI/ML and Gen AI Engineer to join our dynamic team at CCB COSMIC (CCB Operational ... primarily focused on scaling infrastructure and platforms from a serving and fine-tuning standpoint. The candidate should also have...serving , and fine-tuning techniques. + Proven experience in LLM Ops and the productionalization of Gen AI use… more