Consultant/Senior Consultant, AI Quality Assurance, Quality Engineering, Technology & Transformation, Solutions

Overview

In this AI QA role, you will help embed quality assurance practices into AI solutions across traditional and generative AI systems. You’ll partner with data scientists, engineers, and stakeholders to evaluate models, ensure data quality, and identify risks like bias and drift. You will design test scenarios, validate pipelines, and promote responsible AI practices. This position sits within Deloitte’s Technology & Transformation practice and offers a hybrid, client-facing environment where your impact shapes reliable AI outcomes.

Pay / Benefits

• hybrid working policy
• base location in Belfast or Manchester
• opportunity to work on client sites and remotely
• wellbeing and supportive culture
• world-class development and learning opportunities
• cross-functional collaboration

Responsibilities

• Support design and implementation of AI QA approaches across Traditional AI and Generative AI systems
• Analyze model behavior and performance using suitable evaluation techniques and metrics
• Develop and execute structured test scenarios to assess performance, robustness and risk (edge cases/adversarial inputs)
• Validate input/output data across AI pipelines for completeness, consistency, and relevance
• Collaborate with teams to prepare, validate and enhance datasets for model evaluation
• Apply tools for model observability, monitoring and performance tracking
• Identify Responsible AI risks including bias, fairness and explainability concerns
• Contribute to knowledge sharing and accelerators within the AI QA and QE community

Key requirements

• Understanding of Traditional AI and Generative AI concepts and terminology
• Experience in data analysis, profiling, feature exploration and data validation
• Awareness of AI risks such as bias, hallucination and drift
• Experience analyzing model outputs and relating to AI-specific quality metrics (relevance, coherence, accuracy, precision, recall, F1)
• Working knowledge of Python (or similar) for data validation and model evaluation
• Client-facing experience
• Proven technical ability combined with strong business acumen
• Acute attention to detail
• Comfort in fast-paced client environments
• Strong academic record

• curious
• collaborative
• hands-on
• Python
• data validation
• AI quality metrics (relevance, coherence, accuracy, precision, recall, F1)

…