"Alerted.org

Do you want to shape the future of the autonomous enterprise and lead the development of intelligent, agent-first experiences that transform how businesses operate?

The **Business and Industry Solutions (BIS)** team is looking for a  **Senior Applied Scientist** to drive innovation at the intersection of AI, experimentation, and enterprise systems. In this role, you will design and evaluate autonomous agents that deliver measurable improvements in accuracy, latency, and cost-efficiency. You’ll lead rapid experimentation cycles, develop robust evaluation frameworks, and apply advanced techniques like reinforcement learning to enable multi-step reasoning and decision-making. You’ll collaborate across engineering, product, and partner teams to ensure agents are performant, secure, reliable, and extensible—empowering customers and partners to build on our platform. This is your opportunity to influence the next generation of AI-native business applications and deliver real-world impact at scale.

The ideal candidate has prior expertise in natural language processing (NLP), with a foundation in large language model (LLM) development, evaluation, and fine-tuning. They should have hands-on experience in applying advanced fine-tuning techniques—including instruction tuning, reinforcement learning from human feedback (RLHF), and tool-augmented generation—to build agents capable of multi-step reasoning and decision-making. Familiarity with prompt/context engineering, context-aware orchestration, and integrating LLMs with external tools and APIs is essential.

The candidate should be comfortable working in an experimentation-driven environment, leveraging both offline and online evaluation methods to iterate rapidly and optimize agent behavior. A deep understanding of the challenges and opportunities in building AI-native enterprise applications will be key to success in this role.

This role requires you to be onsite 3 days a week in Microsoft's offices in Redmond, WA.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

+ **Deliver impactful solutions**  by executing highleverage data science and analytics initiatives within a product area or feature team, ensuring measurable improvements to user and business outcomes.

+ **Lead the design and implementation**  of advanced model finetuning pipelines, including Reinforcement Learning from Human Feedback (RLHF), to align AI system behavior with user intent and improve performance in realworld scenarios.

+ **Own complex,** **end** **to** **end** **projects**  that combine technical depth with crossfunctional collaboration, influencing feature direction and prioritization rather than broad organizational investment decisions.

+ **Foster alignment and trust**  across partner teams through clear, actionable communication and collaborative problemsolving.

+ **Develop and** **maintain** ** ** robust measurement systems, experimentation frameworks, and causal inference methodologies tailored to dynamic AI systems and enterprisescale environments.

+ **Mentor and support**  peers by sharing best practices, reviewing designs, and contributing to a collaborative, highperformance team culture.

+ **Leverage AI to**  streamline workflows and enhance team productivity through intelligent automation and innovation.

Qualifications

Required** **Qualifications

+ Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)

+ OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)

+ OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)

+ OR equivalent experience.

+ 1+ year(s) experience developing and deploying live production systems, as part of a product team.

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:

+ This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

+ 3+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers).

+ Experience presenting at conferences or other events in the outside research/industry community as an invited speaker.

+ 3+ years experience conducting research as part of a research program (in academic or industry settings).

+ 1+ year(s) experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping.

Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until October 19 2025.

\#BICJobs

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .