- Cisco (San Jose, CA)
- …Continuous Evaluation - Exposure to automated retraining, dataset versioning/curation, evaluation harnesses, and reliability monitoring for ML models in ... for intelligent code generation, contributing across model architecture, experimentation, evaluation , and integration into production systems. + Push the boundaries… more
- Humana (Sacramento, CA)
- …inverse reinforcement learning, preference learning, interpretability tools, and human-in-the-loop evaluation + Develop continuous monitoring strategies for ... architectures for Agentic AI systems, including guardrails, reward modeling, and self- monitoring capabilities + Lead and collaborate on alignment techniques such as… more
- Eliassen Group (Sacramento, CA)
- …including security categorization, control selection and implementation, security testing and evaluation , and continuous monitoring . . Develop and maintain ... comprehensive security documentation: System Security Plans (SSPs), Security Assessment Reports (SARs), and Plans of Action and Milestones (POA&Ms). . Conduct regular security scans, vulnerability assessments, and compliance testing. . Support internal and… more
- Datavant (Sacramento, CA)
- …advise on secure end-to-end AI systems, including data pipelines, model training, evaluation , deployment, runtime monitoring , and agentic workflows. + Lead ... threat modeling, architecture reviews, and risk assessments for AI-driven products, including LLMs, agent frameworks, and multi-agent systems. + Define and evolve a comprehensive AI/ML secure development lifecycle integrated into existing SDLC practices. +… more
- DoorDash (San Francisco, CA)
- …subscriber outcomes and marketplace health. + Set best practices for model training, evaluation , deployment, and monitoring This is a highly impactful IC role ... for someone who enjoys combining economic intuition, large-scale ML modeling, and system design to solve complex real-world optimization problems. We're Excited About You Because You Have + MS or Ph.D. in Computer Science, Machine Learning, Statistics, or a… more
- Stanford University (Stanford, CA)
- …studies primarily focused on surgical and ICU patients. Specific studies include evaluation of novel monitoring devices and both investigational drug and ... device studies focusing on novel treatments for acute kidney injury. The CRC2 will collect key study measures, maintaining the integrity of critical care research. The coordinator will be responsible for managing data related to study outcomes, ensuring that… more
- DoorDash (San Francisco, CA)
- …ad delivery outcomes and marketplace health. + Set best practices for model training, evaluation , deployment, and monitoring + Act as a technical thought leader ... for Ads ML - influencing roadmap, experimentation design, and overall Ads system evolution. This is a highly impactful IC role for someone who enjoys combining economic intuition, large-scale ML modeling, and system design to solve complex real-world… more
- SAP (Palo Alto, CA)
- …to all processes of the ML lifecycle: data collection, annotation, modeling, evaluation , deployment, and monitoring **What you bring:** Required: . Masters ... of science degree in Software Engineering. . Experience in designing, developing, deploying, and testing multi-tenant business applications in the cloud with a focus on backend infrastructure and AI models . Experience in developing data-driven microservices,… more
- Sumitomo Pharma (Sacramento, CA)
- …in signal detection activities including data assembly, signal validation, and signal evaluation . + Perform literature monitoring (with vendor support) and ... ensure appropriate sources are incorporated into signal detection activities. + Participate and lead aggregate safety report activities including data compilation and analysis as well as writing of assigned sections (with vendor support.) + Compile agenda,… more
- Northrop Grumman (Redondo Beach, CA)
- …the toughest challenges in space. Key responsibilities include: + **Supplier Evaluation , Approval, and Performance Monitoring :** Conduct thorough supplier ... Top Secret or SCI Clearance with Polygraph, enrolled in a continuous evaluation program. + Demonstrated familiarity with Federal Acquisition Regulation (FAR) and… more