"Alerted.org

Job Description:

Must have skills: LLM and Kubernetes

Project Tasks:

AI Operations Platform Consultant

+ Experience deploying, managing, operating, and troubleshooting containerized services at scale on Kubernetes for mission-critical applications (OpenShift).

+ Experience with deploying, configuring, and tuning LLMs using TensorRT-LLM and Triton Inference server.

+ Managing MLOps/LLMOps pipelines, using TensorRT-LLM and Triton Inference server to deploy inference services in production.

+ Setup and operation of AI inference service monitoring for performance and availability.

+ Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.

+ Operation and support of MLOps/LLMOps pipelines, using TensorRT-LLM and Triton Inference server to deploy inference services in production.

+ Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.

+ Experience with standard processes for operation of a mission critical system – incident management, change management, event management, etc.

+ Managing scalable infrastructure for deploying and managing LLMs.

+ Deploying models in production environments, including containerization, microservices, and API design.

+ Triton Inference Server, including its architecture, configuration, and deployment.

+ Model Optimization techniques using Triton with TRTLLM.

+ Model optimization techniques, including pruning, quantization, and knowledge distillation.

Position Details:

+ Pay Rate / Range:____$74.91-$84.91_____

_The above salary range represents the range expected for the position; however, final salary offers are based on a number of factors such as the position’s responsibilities; the candidate’s experience, education, and skills; location; travel required; and current market conditions._

+ Benefits (Regular, Full Time Employees):

1. Medical, Dental, and Vision offerings

2. Weekly Direct Deposit

3. Paid Holidays and Personal Time Off

4. 401(k) with match

5. Voluntary Life and AD&D, Short / Long Term Disability, plus other voluntary coverages

6. Pre-Paid Legal and Employee Assistance Programs

7. Northwest Federal Credit Union Membership

8. BB&T @ Work Program

This program requires US Citizenship or Green Card (Lawful Permanent Residents)

_ABBTECH is an EOE/Minorities/Women/Disabled Individuals/Veterans_

tag#IND1