"Alerted.org

Description

DESCRIPTION

AGI Data Services is seeking a seasoned Product Manager - Technical (PMT) to lead our Quality Assessment initiatives. This role will be instrumental in owning and evolving the Quality Assessment Portal (QAP), improving batch-level analytics for workflows, and establishing defined standards for quality strategies and options.

The QAP is a critical tool for evaluating the quality of human-in-the-loop data generated across all channels. It enables AGI-DS to perform Level 1 (L1) quality checks within a two-business day SLA, significantly accelerating feedback cycles with data providers and ensuring scientists have timely access to high-quality data for model training.

Key Responsibilities:

Own and drive the evolution of the Quality Assessment Portal (QAP)

Lead the strategic vision and roadmap for QAP

Collaborate with engineering teams to implement new features and improvements

Ensure the tool meets the evolving needs of scientists and quality assessment teams

Improve batch-level analytics of workflows

Develop and implement strategies to enhance data analysis at the batch level

Work with data scientists and engineers to create more robust and insightful analytics

Drive the integration of advanced analytics into the quality assessment process

Set defined standards for quality strategies and options

Establish comprehensive quality assessment frameworks

Develop and maintain quality metrics and benchmarks

Collaborate with cross-functional teams to ensure alignment on quality standards

Lead cross-functional development teams

Guide teams from design through delivery of quality assessment tools and processes

Influence engineering decisions to build optimal solutions

Ensure scalability and reusability of developed capabilities

Stakeholder management and communication

Regularly communicate with senior management on status, risks, and change control

Collaborate with product management, program management, and partner teams

Present to executive leadership on quality assessment strategies and outcomes

QUALIFICATIONS

Basic Qualifications:

Bachelor's degree in Computer Science, Engineering, or related technical field

7+ years of technical product management experience

5+ years of experience working directly with software engineering teams

Strong understanding of machine learning and data quality concepts

Proven track record of delivering complex technical products

Preferred Qualifications:

Master's degree in Computer Science, Engineering, or related technical field

Experience with quality assessment tools and methodologies in AI/ML contexts

Strong analytical and problem-solving skills, with the ability to translate data insights into actionable strategies

Excellent communication and presentation skills, with the ability to influence senior leadership

Experience in agile development methodologies

Familiarity with data privacy and security best practices

Key job responsibilities

The Sr. Technical Program Manager will interact with product management, program management, cross partner teams, multiple stakeholders and leadership to deliver complex projects and programs. The person will anticipate bottlenecks, provide escalation management, make trade-off decisions, and balance business needs versus technical constraints.

The person should have technical skills to provide solutions, design, build, and deliver it. Successful candidates will have a strong technical background, be detail driven and have excellent problem solving abilities. You will have a deep understanding of product design and implementation details and will successfully represent the technical team to senior leadership and customers. Your technical expertise and operational excellence will influence the team’s decisions and drive secure and robust solutions, which have great customer experience. They are responsible for bridging scientists, technology, process and operations for to achieve the right results. This position defines standards and measurements, identifies the inputs that drive the quality of Ground Truth, and drives initiatives across a variety of teams to achieve these results.

A day in the life

- Collaborate with internal partners to understand their business priorities, communicate outcomes and define roadmaps.

- Define metrics and performance indicators and establish mechanisms to drive them.

- Dive deep into anecdotes and data to find patterns and root causes of problems.

- Dive deep into science, technology and process to identify problems and create solutions. Tirelessly advocate for improvements to systems and processes that will benefit our product teams / stakeholders and business partners.

- Engage with ML Data operations teams to root cause issues, and design solutions.

Basic Qualifications

- Bachelor's degree

- Experience owning/driving roadmap strategy and definition

- Experience with feature delivery and tradeoffs of a product

- Experience contributing to engineering discussions around technology decisions and strategy related to a product

- Experience managing technical products or online services

- Experience in representing and advocating for a variety of critical customers and stakeholders during executive-level prioritization and planning

Preferred Qualifications

- Experience in using analytical tools, such as Tableau, Qlikview, QuickSight

- Experience in building and driving adoption of new tools

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.