"Alerted.org

Job Description

Insight Global is looking for a seasoned, techno-functional leader to drive the development and execution of large-scale LLM training programs. This role is deeply technical and customer-facing, with significant emphasis on dataset creation, annotation and workflows, and high-quality data pipelines for foundational model training. The ideal candidate combines deep technical understanding of the LLM training lifecycle, strong operational rigor, and exceptional cross-functional leadership. This candidate should also be comfortable operating with little structure, handling sensitive information responsibly, and navigating complex organizational dynamics with humility and confidence.

This role can pay between $60-$100/hour depending on years of experience and skillset.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

• 10+ years of experience building and leading large scale technical delivery teams. Proven ability to lead large cross functional teams (100+) by building strong operations

• Bachelor’s degree in Engineering, Computer Science or equivalent practical experience leading large-scale technical initiatives.

• Demonstrated experience managing large-scale dataset generation or annotation for LLMs, ideally with experience in RLHF or SFT pipelines.

• Strong understanding of quality review mechanisms including prompt win rate, agreement metrics, inter-annotator consistency, and preference modeling.

• Experience with human data generation across at least one of the modalities (Text, Image, Video, Audio)

• Technical fluency in data platforms, machine learning concepts and modern Machine Learning tooling (e.g., HuggingFace, LangChain, Weights & Biases).

• Strong communication skills with experience presenting to executive stakeholders, managing client escalations, and aligning delivery with strategic goals. • Prior experience at AI Data Platform companies

• Past experience with retrieval augmented generation (RAG), fine-tuning, and human evaluation workflows.

• Familiarity with fine-tuning LLMs, prompt engineering at scale, and instruction dataset design.

• Technical fluency in Python and cloud infrastructure

• Familiarity with bench marks (SWE Bench, MMMLU, or equivalent)