Overview
In this role you will drive content quality for TikTok Live by combining human labeling with AI/ML methods, including LLMs. You will train and refine models, analyze moderation data for actionable insights, and coordinate with cross-functional teams to resolve issues. You’ll oversee BPO onboarding, calibration, and quality benchmarks, ensuring scalable, high-quality moderation. This is a hands-on position that impacts ecosystem health and content standards at scale, using data-driven methods to improve decision-making and processes.
Responsibilities
- Ensure high-quality content benchmarking across BPO teams and support onboarding/training of new BPOs
- Manage policy clarifications, calibrations, and arbitration processes while analyzing team performance to identify gaps
- Handle content labeling for defined queues, analyze trends, and deliver actionable insights to project teams
- Train models on large labeled datasets, iteratively improve accuracy, and assist in data preparation and structuring for training
- Draft, revise, and quality-check content to optimize human input and LLM alignment in training
- Analyze moderation and labeling data across queues to identify trends and support impact analysis
- Custodian of quality artifacts for content moderation, proposing tech-enabled improvements to outputs
- Provide creative solutions to enhance content quality and team outputs
Key requirements
- Bachelor
- 3+ years of experience in AI data operation, AI/ML-enabled content quality management, product operations, or related analytics
- Proficiency in data analysis and visualization tools such as Excel, Tableau, Power BI, or similar
- Basic understanding of machine learning concepts and Large Language Models (LLMs)
- Strong ability to analyze complex datasets, identify patterns, and generate actionable insights
- Fluency in written and spoken English; proficiency in French is necessary for monitoring French markets
- Strong analytical thinking
- High ownership and accountability
- Cross-functional collaboration
- Excel
- Tableau
- Power BI
…
