Program Manager, Data Quality
- Investigate annotation faults by querying databases directly to identify root causes, moving beyond reliance on ticket queues for initial troubleshooting.
- Sitting with Autonomy Engineering leadership, translating a model accuracy regression into a specific labeling workflow problem and walking in with the fix already scoped.
- Auditing a live pipeline, spotting a systematic edge-case misclassification that has been silently propagating, and building the evidence-based case to restructure how that object type gets labeled.
- Manage the processes for quality management/processes for the offshore annotation team
- Being the bridge: the person ML Operations leans on for quality diagnostics, and the person Engineering trusts to understand how a labeling decision upstream shapes what the model learns downstream.
- Define what 'good' looks like for each data type across active labeling pipelines and instrument pipelines to measure against it continuously, not just at delivery milestones.
- Build inter-annotator agreement frameworks, taxonomy governance, and sampling methodologies that hold up at offshore production scale.
- Design scalable processes to reduce systematic errors and support evolving ML training requirements.
- Audit live workflows, query production databases, and trace accuracy failures to their structural root cause then return with an evidence-based plan that fixes the mechanism, not just the symptom.
- Apply statistical process control thinking to distinguish a labeling error from a labeling system error, and drive the changes that address it.
- Connect ML labeling quality metrics directly to model performance and safety outcomes in close partnership with Autonomy Engineering leadership.
- Build executive-ready reporting that frames quality gaps as safety and business signals — not operational updates.
- Drive alignment across engineering, product, and global ops with clear analysis and well-reasoned recommendations.
- 5+ years embedded with ML, data operations, or software engineering teams close to the work, not managing from a distance.
- SQL fluency: you can investigate a labeling anomaly yourself, form a hypothesis, and test it without waiting on a data engineer.
- Deep experience with ML data pipelines and labeling ecosystems annotation workflows, quality sampling, taxonomy design, and inter-annotator agreement.
- A systems-level mindset: you identify where quality breaks down structurally and design the mechanism that fixes it, not just the process that patches it.
- Clear, confident communication: you can translate a nuanced data quality finding into a precise safety or business risk that senior leadership can act on.
- Experience managing large-scale offshore or globally distributed annotation teams.
- Background in autonomous vehicles, robotics, computer vision, or ML model training.
- Prior experience in ML engineering, data engineering, or technical consulting.
- A demonstrated track record of improving training data quality at scale, with metrics to show for it.
- Bachelor's degree in a technical or business discipline, or equivalent practical experience.
Recommended Jobs
Real Estate Dispositions Agent
About Us: Kingdom Homes is a multiple seven-figure nationwide real estate wholesaling & flipping business operating in 15+ markets across the U.S . We specialize in sourcing off-market discounte…
Commercial Director
This is a fantastic opportunity to join Luminance, the pioneer of Legal-Grade™ AI for enterprise. Backed by internationally renowned VCs and named in both the Forbes AI 50 list of ‘Most Promising Pri…
HVAC Project Manager
HVAC Project Manager position in Mountain View, CA We are a large, growing mechanical contractor currently hiring a Senior Project Manager in our Bay Area office. Responsibilities for HVAC Proj…
X-Ray Machine Inspector
Job Description and Duties The incumbent works under supervision of the Senior Health Physicist. (Sr. HP) of the Inspection, Compliance, and Enforcement Section, Radiation Machines, X-Ray Machine …
Part Time Receptionist
Responsibilities: Ensure all phone calls are directed in a timely and professional manner. Always provide excellent customer service over the phone and in person. Greet and guide customers to a…
California Field Sales Manager - Public Sector
Public Sector Field Sales Manager, California Location: Remote position in the West region, ideally out of California or Arizona. Salary: There is a base plus commissions component tied t…
Pacific Basin Research Center Post-Doctoral Fellowship (2026-2027 Academic Year)
Date Posted: 2/27/2026 The Pacific Basin Research Center (PBRC) at Soka University of America (SUA), a premier liberal arts university in Orange County, California, is pleased to announce a call for …
Experienced HVAC/Refrigeration Technician
Cold War Refrigeration is an equal opportunities employer operating in the construction, refrigeration, and HVAC industries. Cold War Refrigeration is looking to fill a full time HVAC/R technician po…