- Red Hat (Boston, MA)
- …open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings ... to GenAI deployments. As leading developers, maintainers of the vLLM project, and inventors of state-of-the-art techniques for model...LLM deployments. We are seeking an experienced ML Ops engineer to work closely with our product and research… more
- Red Hat (Boston, MA)
- …Red Hat OpenShift AI (RHOAI) team is looking for a Senior Software Engineer with Kubernetes and MLOps (Machine Learning) experience to join our rapidly ... build and impact the next generation of hybrid cloud MLOps platforms, contribute to the development of the RHOAI...the affiliated open-source communities, such as KServe, Kubeflow, and vLLM . You will work as part of an evolving… more
- Red Hat (Boston, MA)
- **Job Summary:** The Red Hat Ecosystems Engineering group is seeking a Senior Principal Software Engineer in our Boston, MA office. In this role, you will work ... + Familiarity with model parallelization, quantization, and memory optimization using vLLM , DeepSpeed, OpenVino and other inference libraries + Strong experience… more