Senior Technical Program Manager Data Labeling, Data and Machine Learning

Remote, USA Full-time
About the position As a Senior Technical Program Manager: Data Labeling at Material Security, you'll be part of a team of experienced, world-class engineers, working to protect our users and their privacy (e.g., inboxes from breaches, targeted phishing, fraud, and lateral account takeover). Your mission is to develop high quality data sets that will be used to create ML/AI models that detect security relevant data and behavior (phishing emails, sensitive data in email and drive). Responsibilities You will lead cross-functional initiatives to build, scale, and optimize data annotation programs critical to AI model performance. You'll own program delivery across internal teams, vendor partners, and ML stakeholders to ensure high-quality labeled datasets are delivered on time and at scale. This role is both strategic and execution-driven: you'll define roadmaps, manage SLAs, create scalable processes, and resolve bottlenecks to ensure the labeling engine is efficient, quality-controlled, and model-aligned. Responsibilities • Define and drive end-to-end execution of large-scale annotation programs across multiple data types. • Collaborate with ML, product, and data operations teams to scope and prioritize labeling needs. • Own vendor engagement: onboarding, SLA management, training, and quality reviews. • Build feedback loops between annotators and model performance to inform labeling strategies. • Create dashboards and reporting mechanisms to track labeling velocity, quality, and cost. • Lead initiatives to improve labeling efficiency through tooling enhancements and process automation. • Be the voice of labeling in cross-functional forums-translating model needs into operational plans. • Manage and mentor a team of trained threat analysts who conduct our labeling. • Conduct analysis of the quality of the labeling and for insights into how our detections can be improved. • Hire and train new or replacement threat analysts Requirements • 5+ years of program management experience, ideally in ML ops, data labeling, or AI infrastructure. • Proven track record building and managing remote labeling teams. • Strong understanding of ML lifecycle stages and the importance of annotated data quality. • Experience defining SOPs, audit mechanisms, and workflows for scalable data labeling. • Proficient in project management tools such as Jira, Asana, or Linear for program tracking • A deep understanding on ML Operations labelling tools and experience building or maintaining an annotation tool. • Strong analytical and communication skills; ability to synthesise feedback from ML, ops, and product stakeholders and also analyzed data to spot trends in our labeling or detection quality. • Understanding of data privacy and security standards and how they can be followed in a labeling program. Nice-to-haves • Exposure to LLMs, foundation models, or active learning-based data curation. • Familiarity with annotation for multimodal inputs (e.g., Image, Text, Documents, OCR based forms etc) • Knowledge of quality scoring frameworks, inter-annotator agreement (IAA), or QA loop design. • The ability to develop and maintain labeling quality metrics and analytic insights and report on those to senior management • Technical background (e.g., in ML, data science, or engineering) is a plus. Apply tot his job
Apply Now

Similar Jobs

Director / Sr Program Manager, AI Accelerator

Remote, USA Full-time

Computer Vision/Deep Learning Scientist fully remote

Remote, USA Full-time

Malware Analyst San Antonio, TX

Remote, USA Full-time

Senior Analyst, Mandiant Threat Intelligence Services

Remote, USA Full-time

Workforce Management Analyst

Remote, USA Full-time

Senior Workforce Management Analyst

Remote, USA Full-time

Content Management Analyst - Medical Education and Practice

Remote, USA Full-time

Case Management Analyst

Remote, USA Full-time

Remote Management Consultant; Port St. Lucie

Remote, USA Full-time

[Remote] Managing Consultant - Oracle Cloud Payroll (Remote)

Remote, USA Full-time

Senior Associate Content Partnerships job at Walt Disney Company in Santa Monica, CA

Remote, USA Full-time

**Experienced Commercial Customer Success Manager – Driving Customer Adoption and Retention at blithequark**

Remote, USA Full-time

**Experienced Part-Time Remote Data Entry Specialist – Flexible Work Arrangements at blithequark**

Remote, USA Full-time

[Remote] Fast Track Mortgage Loan Officer

Remote, USA Full-time

Lead Production Operations Manager, Games

Remote, USA Full-time

Remote Licensed Therapist- PsyD/ LCPC/ LCSW/ LMFT/LPC/LSW

Remote, USA Full-time

**Experienced Customer Service Associate - Remote Customer Support Specialist**

Remote, USA Full-time

Associate Project and Program Manager job at Wolters Kluwer in Coppell, TX, Kennesaw, GA

Remote, USA Full-time

Technical Sales Representative; Remote - Reside in Southern Region

Remote, USA Full-time

Experienced Customer Service Representative – Remote Health Insurance Specialist for arenaflex

Remote, USA Full-time
Back to Home