AI Quality Assurance Program Manager

Overview

In this role you drive the end-to-end QA for AI systems at Tripadvisor, ensuring reliability and alignment with business goals. You will design AI quality frameworks, audit outputs, and translate QA findings into actionable guidance for cross-functional teams. You’ll track performance, report to executives, and help shape the roadmaps for AI deployment at scale. This is a hands-on leadership position at the intersection of AI, product, and traveler experience.

Pay / Benefits

• remote-friendly
• flexible schedule
• health benefits
• donation matching
• tuition assistance
• travel perks

Responsibilities

• Define the AI-Era quality strategy spanning human and AI agents and shift QA to continuous, AI-enabled management
• Design and maintain AI evaluation benchmarks, testing protocols, and HITL workflows for AI agents, support bots, and recommendation engines
• Audit AI outputs and traveler interactions for intent fulfillment, safety, tone, and hallucination prevention
• Deliver executive-ready insights on QA metrics, model accuracy, and error trends to guide business decisions
• Collaborate with Data Science, AI Engineering, Product, and CX teams to translate QA findings into refinements and knowledge-base updates
• Track timelines for AI deployments, manage QA regression testing, and ensure quality before traveler rollout

Key requirements

• 4–6 years in technical program management, QA management, or AI/ML product operations focused on reliability and evaluation
• Strong operational knowledge of AI/LLM testing methodologies, prompt evaluation, intent recognition accuracy, and AI safety guardrails
• Proven ability to analyze AI logs, use analytics tools, and present findings in executive-ready formats

• Cross-functional collaboration
• Domain empathy
• Communication with executives
• AI/LLM evaluation
• Prompt evaluation
• HITL workflows

…