Senior Manager, Quality Operations, AGI Data Services – Data Quality

Job title:

Senior Manager, Quality Operations, AGI Data Services – Data Quality

Company

Amazon

Job description

DESCRIPTIONAmazon’s AGI Data Services organization is hiring a Senior Manager of Quality Operations for its Data Quality business unit. The purpose of the role is to manage our worldwide network of Quality Auditors and Quality Specialists and oversee the human verification of the data that the organization creates and annotates. Come be part of an initiative that is critical to building and improving the just-launched Amazon Nova foundational models!Today, AGI Data Services produces tens of millions of units of human-created data that is used to train and fine-tune large language models. These data must be evaluated based on whether they were generated following the conventions defined by the workflow, on dimensions such as complexity, correctness, helpfulness and harmfulness. Filtering out high quality data from low quality is of paramount importance, as it maximizes our chances of improving performance of the model under test.To achieve this objective, the Data Quality organization is responsible for auditing individual units of data, as well as building an automated system using a large language model to predict and filter high quality units of data from low. The Senior Manager of Quality Operations will manage our network of Quality Auditors and Quality Specialists in eight countries that sit with the experts who create this data, reviewing their work to find defects, suggesting process improvements that lead to generating higher quality data while balancing the need to generate the data quickly and cost-competitively. Our quality assessments must be highly accurate in order to avoid sending poor quality data to our customers, necessitating constant measurement and improvement of the accuracy of our quality assessments. This role partners with the entire AGI Data Services network to advocate for changes to the overall operations processes that improve quality; and with the rest of the Data Quality organization to provide requirements and ground truth for the improvement of our automated quality checks.BASIC QUALIFICATIONS

• Bachelor’s Degree from an accredited university or equivalent qualification.
• 5+ years of previous supervisory experience in a production, distribution or manufacturing environment.
• 5+ years of previous people management experience, as well as proven ability to drive employee engagement and development plans.
• Background in Quality Assurance Management with the proven ability to show improvement in a continually developing environment.
• Experience in fast-paced environments, driving process improvement across different teams, while motivating others to meet challenges.
• Relevant experience working with high-level stakeholders in a complex, ambiguous environment.
• Proficient verbal and written communications skills both in English.

PREFERRED QUALIFICATIONS

• Degree in a science or logistics-based discipline, with a strong bias towards analytics and data.
• Experience in Machine Learning Data operations disciplines, including data creation, collection and annotation.
• Experience in remote team management and team development.
• Experience with Lean and Six Sigma methodologies and techniques.

Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( ) to know more about how we collect, use and transfer the personal data of our candidates.Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Expected salary

Location

Cambridge

Job date

Sun, 12 Jan 2025 02:05:01 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (hiring-jobs.com) you saw this job posting.