"Alerted.org

Come build the core of Microsoft Copilot for enterprise with Microsoft Turing Team, where you'll join a collaborative group of applied scientists and engineers pushing the frontier of large language models (LLMs) to improve the productivity of hundreds of millions of users around the world.

Our team is responsible for the core systems that power Microsoft 365 Copilot Chat delivering intelligence, quality, and transformative new features. We work at the intersection of research and engineering—advancing orchestrator reasoning, training next-generation models, and shipping impactful, model-driven experiences in Microsoft 365 Copilot.

Shape the way the world measures and trusts AI. In the Experimentation & Evaluation area, you’ll define what “good” means for Copilot, by working on metrics, scorecards and eval pipelines across offline, shadow, and online experiments. You’ll work at the intersection of science and engineering, gaining a front-row seat to how AI impacts millions of users and help steer one of Microsoft’s most important products forward. As a **Senior Applied Scientist** in the Experimentation & Evaluation area, you will lead the advancement of Copilot’s measurement and experimentation science. You will design and evolve evaluation frameworks across offline, shadow, and online scorecards, setting new standards for rigor, reliability, and scalability. By driving innovation in statistical analysis, machine learning, and experimentation methodology, you will generate trustworthy insights that shape product direction, influence leadership decisions, and accelerate Copilot’s impact at scale.

This position is based out of either Redmond, WA or Mountain View, CA with 3 days per week work in the office and 2 days per week work from home. Living local to the Greater Seattle Area or Bay Area is required, and relocation assistance is available.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond

Responsibilities

+ You will master one or more subareas and gain expertise in a broad area of research, including applicable research techniques. You’ll also gain deep knowledge of a service, platform, or domain, and identify product needs by sharing the latest industry trends and applied technologies.

+ You will review business requirements and incorporate research to meet business goals. You‘ll provide strategic direction for the kinds of data used to solve problems and apply deep subject matter knowledge to support business impact.

+ You will participate in onboarding of early career team members and assist in developing academics to be members of multidiscipline teams. You’ll identify new research talent to join Microsoft and collaborate with the academic community to develop the recruiting pipeline.

+ You will document work in progress and experimentation results and share findings to promote innovation. You’ll also use your deep understanding of fairness and bias to contribute to ethics and privacy policies related to research processes and data collection.

Qualifications

Required Qualifications:

+ Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)

+ OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)

+ OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)

+ OR equivalent experience.

+ 4+ years of experience building AI-powered products, large-scale data analysis, information retrieval or evaluation systems.

+ 4+ years of experience in Python, C++, C# or AML, with scientific computing libraries such as PyTorch, TensorFlow, scikit-learn, or pandas.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

+ **Microsoft Cloud Background Check:** This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

+ Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)

+ OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)

+ OR equivalent experience.

+ 3+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers).

+ Experience presenting at conferences or other events in the outside research/industry community as an invited speaker.

+ 3+ years experience conducting research as part of a research program (in academic or industry settings).

+ 1+ year(s) experience developing and deploying live production systems, as part of a product team.

+ 1+ year(s) experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping.

Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until October 28, 2025.

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .