"Alerted.org

•​The MSAI Search Relevance team is at the forefront of delivering world-class search quality across Microsoft’s ecosystem. We are the driving force behind the relevance of results in Copilot Search experiences and serve as the core retrieval layer in the RAG architecture powering Bizchat. Our impact also extends to maintaining high search quality across traditional endpoints like Outlook, Teams, and SharePoint Search. Our team thrives at the intersection of innovation and applied machine learning.

We are looking for a **Principal Applied Scientist** to help us deliver breakthrough applied machine learning and information retrieval solutions at enterprise scale. This role is a unique opportunity to apply state-of-the-art techniques—including dense retrieval, hybrid search, multilingual large language models (LLMs), RAG (Retrieval-Augmented Generation), and transformer-based re-ranking models and agentic search—to solve complex challenges in Copilot-driven enterprise search.

As a Principal Applied Scientist, you’ll be responsible for delivering mission-critical innovations that directly improve Copilot experiences such as:

+ Agentic Search in modern orchestrator architectures

+ Adapting advanced vector search algorithms (e.g., FAISS, ANN, ScaNN) for enterprise-scale semantic retrieval

+ Improving classic and neural keyword search quality through deep language understanding

+ Designing and training relevance models, including LLM fine-tuning and learning-to-rank (LTR) approaches

+ Building robust evaluation pipelines using offline metrics and online A/B experimentation

+ Driving cross-org collaboration with platform partners, other applied science teams, and product teams across time zones

This role requires a mix of technical depth, strategic execution, and people management to shape the next generation of AI-powered search experiences.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

+ Drive end-to-end applied science projects: From ideation and design to implementation, experimentation, and shipping, you will lead high-impact projects that directly improve Copilot Chat, Copilot Search, and BizChat experiences. This includes identifying search and relevance gaps, formulating innovative hypotheses, and delivering scalable solutions.

+ Inspire help to grow a high-performing applied science team: mentor, and empower a team of applied scientists—owning their technical direction, project execution, and career development. You will guide day-to-day work, ensure scientific and engineering rigor, and be accountable for the team’s output and impact.

+ Innovate with scientific rigor: Invent and apply cutting-edge techniques in machine learning, natural language processing, and information retrieval to address real-world challenges at enterprise scale. You will design novel approaches for improving retrieval, ranking, query understanding, and semantic search in Copilot systems.

+ Document, share, and amplify learnings: Promote a culture of transparency and innovation by capturing experimental results, documenting methodology, and publishing internal learnings. You’ll drive knowledge sharing that enables broader impact across the organization.

+ Translate business goals into scientific strategy: Partner closely with product and business stakeholders to align team efforts with high-priority objectives. You will translate ambiguous product requirements into clear, data-driven, and technically feasible directions.

+ Collaborate across organizations and time zones: Work cross-functionally with platform engineering teams, peer science orgs, and product managers to ensure alignment, resolve dependencies, and unblock progress. You’ll be a key bridge between applied science innovation and product delivery.

+ Embody our Culture and Values

Qualifications

Required Qualifications:

+ Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)

+ OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research)

+ OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)

+ OR equivalent experience.

+ 4+ years experience in applied science projects from ideation to production—in high-scale environments such as search, recommendation, or conversational AI.

+ 4+ years experience in data analysis at scale, including working with logs, telemetry, and large datasets to uncover behavioral patterns, build evaluation datasets, and derive insights.

Preferred Qualifications:

+ Experience in search and ranking systems, semantic retrieval, and information retrieval at scale.

+ Applied experience with state-of-the-art retrieval and ranking techniques, including:

+ Experience with Dense retrieval models (e.g., DPR, ANCE, ColBERT)

+ Experience with Vector search systems (e.g., FAISS, ScaNN, Milvus, Pinecone)

+ Experience with RAG (Retrieval-Augmented Generation) architectures using LLMs such as OpenAI GPT, T5, or Llama.

+ Experience with Fine-tuning or prompt engineering of large-scale language models for query rewriting, summarization, and document reranking

+ Familiarity with hybrid search strategies, learning-to-rank (LTR) frameworks, and evaluation methodologies for IR systems (offline metrics, A/B testing, relevance judgments).

Applied Sciences IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until October 21, 2025.

\#M365Core

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .