- Oracle (Sacramento, CA)
- **Job Description** The Principal Applied Scientist will play a key role in the evaluation of LLM and LMM models, with a focus on creating innovative solutions to ... a deep understanding of machine learning techniques, including foundation model evaluation , traditional NLP/CV metrics, LLMaaJ techniques, human evaluation ,… more
- General Motors (Mountain View, CA)
- **Job Description** **The Role:** As a Staff Software Engineer within the Evaluation team under the Simulation, Evaluation , and Data organization, you will shape ... the design and delivery of the evaluation strategy for GM's autonomous vehicle programs. In this...and research scientists to build reliable, reproducible, and high-signal evaluation mechanisms that accelerate model iteration and improve safety,… more
- US Tech Solutions (Mountain View, CA)
- …CA (Hybrid)** **Duration: 5 months contract** **Job Description:** + As a Human Evaluation & Content Quality Vendor Operations Manager, you will play a key role ... in scaling and optimizing our global human evaluation ecosystem - the backbone of GenAI product quality....to enhance data quality, improve rater accuracy, and streamline evaluation workflows that shape how our AI models learn… more
- General Motors (Sunnyvale, CA)
- …stack generates far more numerical data than anyone can review manually. The Evaluation Insights team builds tools that turn this data into a single, trustworthy ... range of questions about AV stack performance. **About the Organization:** The Evaluation team is dedicated to creating, maintaining, and evolving the evaluation… more
- Spectrum Comm Inc (Edwards, CA)
- …seeking highly qualified Engineers and/or Analysts to support Operational Test & Evaluation (OT&E) programs located in Edwards AFB, CA. Key Roles and ... documents and operational requirements documents (if required), Test and Evaluation Master Plans, System Threat Assessment Reports, system description information,… more
- NVIDIA (Santa Clara, CA)
- …banks, multiple-choice formats, and test suites to support both automated and human evaluation workflows. + Employ multiple VLMs in parallel to explore ensemble ... evaluation methods such as majority voting, ranking agreement, and answer consensus. + Make evaluation as automated and scalable as possible by encoding prompts… more
- Microsoft Corporation (Mountain View, CA)
- …Product Engineers with a focus on web front-end development skills to join our Evaluation tooling team. As part of our mission, you will play a critical role ... in building tools for data collection and model evaluation , contributing directly to the development of cutting-edge AI technologies that define the future. Our team… more
- Spectrum Comm Inc (Edwards, CA)
- …to be addressed during operational capability during assessments and test and evaluation . + Development of test concepts and test plans, data management and ... supporting program/technical reviews, and readiness reviews. + Development of evaluation methodologies and general analytic techniques, assess data requirements, and… more
- Humana (Sacramento, CA)
- …help us put health first** The Senior Clinical Medical/Financial Risk Evaluation Professional is responsible for supporting the development, implementation and ... risk and healthcare fraud. The Senior Clinical Medical/Financial Risk Evaluation Professional work assignments involve moderately complex to complex fraud… more
- Stanford University (Stanford, CA)
- Executive Director, Regulation, Evaluation , and Governance Lab (RegLab), Stanford Law School **School of Law, Stanford, California, United States** Administration ... Post Date Sep 08, 2025 Requisition # 107228 **Executive Director, Regulation, Evaluation , and Governance Lab (RegLab), Stanford Law School** **About Us:** Stanford… more