- NVIDIA (Santa Clara, CA)
- NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and ... NVIDIA's inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions. + Work with cross-collaborative teams across frameworks, NVIDIA libraries… more
- NVIDIA (Santa Clara, CA)
- NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and ... optimize the GPU-accelerated software that powers today's most sophisticated AI applications. Our...inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions. + Work with cross-collaborative teams across frameworks,… more
- MongoDB (Palo Alto, CA)
- **About the Role** We're looking for a Senior Engineer to help build the next-generation inference platform that supports embedding models used for semantic ... Together, we're building infrastructure for real-time, low-latency, and high-scale inference - fully integrated with Atlas and designed for developer-first… more
- NVIDIA (CA)
- We are now looking for a Senior System Software Engineer to work on Dynamo & Triton Inference Server! NVIDIA is hiring software engineers for its ... What you'll be doing: In this role, you will develop open source software to serve inference of trained AI models running on GPUs. You will balance a variety… more
- NVIDIA (CA)
- …can make a lasting impact on the world. We are now looking for a Senior System Software Engineer to work on user facing tools for Dynamo Inference Server! ... NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team, and we are a remote friendly work environment. Academic and commercial… more
- NVIDIA (Santa Clara, CA)
- …and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You'll architect and implement ... high-performance inference stacks, optimize GPU kernels and compilers, drive industry...way to integrate research ideas and prototypes into NVIDIA's software products. What we need to see: + Bachelor's… more
- NVIDIA (Santa Clara, CA)
- …to work on cutting-edge AI technology? Join NVIDIA's TensorRT team as a Senior Software Engineer , and be at the forefront of technology, enabling support in ... with teams and stakeholders across the whole hardware and software stack to understand and leverage new features to...models (such as Large Language Models) & frameworks for inference . + Background with C++17. NVIDIA is widely considered… more
- Amazon (Cupertino, CA)
- …and multimodal workloads-reliably and efficiently on AWS silicon. We are seeking a Software Development Engineer to lead and architect our next-generation model ... Description AWS Neuron is the software stack powering AWS Inferentia and Trainium machine...Trainium machine learning accelerators, designed to deliver high-performance, low-cost inference at scale. The Neuron Serving team develops infrastructure… more
- Amazon (Cupertino, CA)
- …The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's ... with popular ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement and Acceleration team… more
- Amazon (Cupertino, CA)
- …The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's ... with popular ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement and Acceleration team… more