"Alerted.org

If you have an interest in data and are committed to developing systems that enhance informed decision-making at Microsoft, the Insights, Data Engineering & Analytics team offers a platform for professional growth.

This team plays a crucial role in directing Microsoft 365 and the Experiences + Devices group (E+D), both of which are central to the Company's mission to empower individuals and organizations to achieve more. Our objective is to foster a data-informed culture by equipping the Experiences + Devices group with actionable insights to guide their decisions. This initiative represents a significant opportunity to deliver impactful information that will improve operational efficiency, drive empowerment, and support Microsoft’s success in the evolving AI landscape.

We are looking for a seasoned **Senior Applied Scientist – AI Evaluation** who will lead evaluation of Copilot chat and other canvas AI responses and drive quality improvement across a wide variety of products like Office, Teams and Outlook.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

+ Apply state of art GenAI techniques to understand and evaluate Copilot usage and satisfaction.

+ Collaboration with Researchers, engineers, product managers to derive sophisticated metrics that will drive product quality and sentiment.

+ You will need to triangular data from various sources and help in sensemaking.

+ You will be involved in the full product building lifecycle including hypothesis development, product building and experimentation.

+ Embody our culture and values .

Qualifications

Required Qualifications:

+ Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)

+ OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)

+ OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)

+ OR equivalent experience.

+ Experience building agents and or chat based AI systems.

+ Experience working on large scale computing systems like COSMOS, Hadoop, MapReduce and/or similar systems.

+ Experience with programming skills, e.g. Java, C#.

+ Familiarity with deep learning toolkits, e.g. CNTK, TensorFlow.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

+ **Microsoft Cloud Background Check** : This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

+ Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)

+ OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)

+ OR equivalent experience.

+ 3+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers).

+ Experience presenting at conferences or other events in the outside research/industry community as an invited speaker.

+ 3+ years experience conducting research as part of a research program (in academic or industry settings).

+ 1+ year(s) experience developing and deploying live production systems, as part of a product team.

+ 1+ year(s) experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping.

+ 2+ years of experience with written and verbal communication to educate and work with cross functional teams.

+ 1+ year of experience in delivering on ambiguous projects with incomplete or imperfect data

**Applied Sciences IC4** - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until October 21, 2025.

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .