"Alerted.org

Summary:

Meta Superintelligence Labs is seeking a Research Scientist Manager to lead a high-impact team working on the next generation of AI Assistants powered by frontier-scale foundation models. This role centers on building cutting-edge measurement and evaluation paradigms that align fast-moving model development with real end-user value. As a Research Scientist Manager, you will define the scientific strategy behind the evaluation flywheel, ensure scientific across methodologies, and partner with product, engineering, and model training teams to steer the system toward reliability and trustworthiness at scale.

Required Skills:

Research Scientist Manager, MetaAI Assistant Measurement Responsibilities:

1. Define and execute the scientific roadmap for measurement of AI Assistant with purpose, agility, and efficiency

2. Lead the development of innovative offline and online evaluation metrics, benchmarks, and data synthesis methodologies to drive model improvement and improve user experience

3. Partner closely with research, engineering, and product teams to integrate robust measurement into the model development lifecycle (the "evaluation flywheel")

4. Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects

5. Mentor and grow a team of Industry-Leading research scientists and applied scientists, fostering a of scientific rigor, impact, and success

Minimum Qualifications:

Minimum Qualifications:

6. 12+ years of, or PhD + 8 years of hands-on experience in large language model, NLP, and Transformer modeling, in the setting of both research and engineering development

7. Experience and track record of landing large research and/or product impacts in a time-sensitive environment

8. 2+ years of people-management experience leading research scientists or applied scientists

9. Proven technical vision in where the field of generative AI will go

10. Experience of and knowledge of online and offline measurement, benchmark building, and data synthesis

11. Experience with cross functional collaboration with other teams including non-engineering functions

12. Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management

Preferred Qualifications:

Preferred Qualifications:

13. PhD or equivalent research experience in fields such as machine learning, statistics, econometrics, causal inference, computer science, optimization, or related areas

14. Experience developing evaluation frameworks for LLMs, multimodal models, or interactive assistants

15. Expertise in online measurement, user-behavior modeling, A/B testing, and experiment platform design

16. Experience building large-scale datasets and ontologies used for training or evaluation

17. Background in safety, alignment, content evaluation, or human-AI interaction

18. Ability to communicate complex ideas clearly to executives, product partners, and engineering stakeholders

19. Proven ability to build high-performing teams that thrive under ambiguity and rapid iteration

20. Experience with cross functional collaboration with other teams including non-technical functions

21. Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management

Public Compensation:

$213,000/year to $293,000/year + bonus + equity + benefits

**Industry:** Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [email protected].