"Alerted.org

Overview

Join us at the forefront of innovation in Microsoft Copilot Studio's COO Data Science team within the Business Industry Copilot organization, where data-driven insights and intelligent experimentation power product-led growth. As a **Senior Data Scientist** , you will own end-to-end analytics and machine learning solutions that shape how customers build, deploy, and use copilots and AI agents.

You will partner closely with product managers, engineers, and business stakeholders to design experiments, build production models, and extract actionable insights that accelerate product adoption, improve agent performance, and influence Microsoft Copilot Studio's growth strategy. This role is ideal for someone who thrives at the intersection of analytics, experimentation, and ML engineering, and enjoys turning ambiguous product questions into measurable business impact.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

+ Lead analytics insights: perform deep quantitative analysis and exploratory data work to identify trends, diagnose user behaviors, surface actionable insights, and guide product-led growth strategies.

+ Build intelligent solutions: Design, develop, and productionize ML models, AI agents, and other AI-driven heuristics (e.g. quality evaluation, forecasting, scoring) that improve product performance and influence roadmap prioritization.

+ Drive experimentation: Design, implement, and analyze A/B tests and other experimental methods to validate hypotheses and optimize Copilot Studio experiences at scale.

+ Partner for impact: Collaborate with PM, engineering, and research partners to define metrics, measure success, and drive data-informed decision making across Copilot Studio.

+ Operationalize ML: Implement evaluation pipelines, monitoring, and model performance tracking for production workloads, ensuring security, reliability, robustness, and responsible AI standards.

+ Communicate with clarity: Share insights and recommendations with senior leaders and cross-functional stakeholders to align strategy and accelerate business outcomes.

Qualifications

Required Qualifications:

+ Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)

+ OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)

+ OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)

+ OR equivalent experience.

**Other Requirements:** Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

+ **Microsoft Cloud Background Check:** This position will be required to pass the

+ Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

+ Experience driving product-led growth, optimizing user journeys, or developing insights that drive product adoption or revenue / cost outcomes.

+ Hands-on experience building or evaluating AI agents, copilots, or LLM-powered systems, including working with agent workflows, prompt engineering, tool-calling, or evaluation metrics for agent performance.

+ Experience with experimentation (A/B testing, causal inference, metric development).

+ Experience working with large-scale datasets in distributed or cloud environments (e.g. Kusto/Azure Data Explorer, Spark, Fabric, or similar).

+ Strong engineering skills: ability to build pipelines, automate analyses, and work with production data systems.

+ Knowledge of evaluation systems, including prompt/agent performance measurement, regression testing, or automated evaluation framework.

+ Experience building, deploying, or monitoring ML models in production (e.g. Azure ML, ML flow, CI/CD for ML).

+ Experience with generative AI, LLMs, prompt optimization, or agentic reasoning systems is a plus.

+ Excellent collaboration and communication skills across cross-functional partners.

+ Professional experience writing SQL or Kusto queries to analyze large-scale datasets.

+ Hands-on experience building or evaluating machine learning models using Python or R.

+ Conducted or analyzed A/B tests, controlled experiments, or other statistical experimentation methods in a previous role.

+ Worked with data in a cloud or distributed environment (e.g. Azure, AWS, Spark, or similar).

\#BICJOBS

\#MCSJobs

Data Science IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations. (https://careers.microsoft.com/v2/global/en/accessibility.html)