• LLM Engineer

    Insight Global (Boston, MA)


    Job Description

    Insight Global is seeking an LLM Engineer to join our clients dynamic development team. This individual will enhance and expand a complex application, requiring strong communication skills and full-stack technical expertise. This role involves collaborating with global teams across multiple time zones (IST, UST, and other countries) and actively contributing to ongoing feature development.

    Key Responsibilities:

    -Enhance and expand a complex, dynamic application.

     

    -Collaborate with global teams across multiple time zones.

     

    -Actively contribute to ongoing feature development.

    Ideal Candidate:

    -Highly skilled Senior Python and LLM engineer.

     

    -Capable of executing both planning and hands-on technical work independently.

     

    -Effective collaborator with Product Owners and other stakeholders to solve complex problems.

     

    -Able to work cross-functionally to deliver impactful solutions.

     

    -Committed to continuously developing technical expertise and staying current with new technologies.

     

    -Passionate, intellectually curious, and driven to expand skills and knowledge.

     

    -Utilizes a data-driven approach to solve technical challenges and make informed decisions.

     

    -Applies systems-level thinking, integrating data science and engineering principles.

     

    -Takes full ownership of features and projects, delivering high-quality solutions independently.

    Compensation:

    $65/hr to $85/hr.

     

    Exact compensation may vary based on several factors, including skills, experience, and education.

     

    Employees in this role will enjoy a comprehensive benefits package starting on day one of

     

    employment, including options for medical, dental, and vision insurance. Eligibility to enroll in

     

    the 401(k) retirement plan begins after 90 days of employment. Additionally, employees in this

     

    role will have access to paid sick leave and other paid time off benefits as required under the

     

    applicable law of the worksite location.

     

    We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf) .

     

    To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

     

    Skills and Requirements

    Years of Experience:

    -2+ years of experience developing and experimenting with LLMs

     

    -8+ years of experience developing APIs with Python

    Background:

    -Extensive experience with Python, particularly in building REST APIs using frameworks like FastAPI or Flask.

     

    -Expertise in microservices architecture and deployment in containerized environments (e.g., Docker, Kubernetes).

     

    -Strong knowledge in AI, machine learning, and natural language processing.

     

    -Proficient in working with key LLM model APIs (e.g., OpenAI, Anthropic) and LLM frameworks (e.g., LangChain, LlamaIndex).

     

    -Experience with MCP (Model Context Protocol).

     

    -Understanding of multi-agent systems and their applications in complex problem-solving scenarios.

     

    -Familiarity with RAG concepts and fundamentals (vectorDBs, semantic search, etc.).

     

    -Expertise in implementing RAG systems that combine knowledge bases with generative AI models.

     

    -Skilled in prompt writing for various use cases.

     

    -Experience with deploying generative solutions to production at scale, beyond POCs.

     

    -Proficiency with server-side events, event-driven architectures, and messaging systems.

     

    -Strong problem-solving skills and experience in debugging and optimizing backend systems.

     

    -Solid understanding of security best practices for backend systems, including authentication and data protection.

     

    -Can work IST and UST hours -Experience with LLM guardrails

     

    -Experience with LLM monitoring and observability

    -Experience developing AI/ML technologies within large and business critical applications null

    We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].