Sr. Engineer – Testing & Quality Assurance P
Ready to turn bold ideas into real-world impact?At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it. Genpact’s AI Gigafactory, our industry-first accelerator, exemplifies how we scale advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. Whether tackling complex challenges through large-scale models or agentic AI, our breakthrough solutions tackle companies’ most complex challenges.If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting‑edge AI solutions, and want to push the boundaries of what’s possible, this is your moment.Genpact (NYSE: G) is an agentic and advanced technology solutions company. We leverage process intelligence and artificial intelligence to deliver measurable outcomes.
Job Description
Responsibilities
- Execute annotation, evaluation, and validation activities for AI-powered solutions using established guidelines and quality standards.
- Validate AI-generated outputs against a predefined set of golden questions and expected results.
- Create, maintain, and review annotations to support AI model evaluation and continuous improvement.
- Test and evaluate Databricks Genie responses for accuracy, completeness, relevance, and consistency.
- Write and execute SQL queries against underlying data sources to validate answers generated from golden questions and Databricks Genie outputs.
- Investigate discrepancies between expected results, source data, and AI-generated responses, and document findings.
- Lead the design, optimization, and standardization of annotation processes and prompts across multiple AI use cases.
- Collaborate with AI teams to define and govern annotation schemas, taxonomies, evaluation frameworks, and quality standards.
- Review complex or high-risk AI outputs and provide expert quality assessments and recommendations.
- Ensure consistency, accuracy, traceability, and auditability of
#J-18808-Ljbffr…