Principal AI Quality Engineer

Overview

In this role you will define and drive Fourth’s AI-driven QA strategy at a global scale, aligning with product and technology roadmaps. You will set standards, frameworks, and governance to embed quality, reliability, and trust in AI-enabled delivery. As the senior quality voice, you shape testing across AI-assisted and agentic development, partnering with engineering and product leadership to elevate quality at scale.

Pay / Benefits

• 25 basic holidays with option to grow to 30
• Flexible working and hybrid environment
• Wellness activities and gym discounts
• Laptop and equipment provided
• On-demand pay tools for salary access
• Pension and life insurance options

Responsibilities

• Define and evolve the AI-driven global QA strategy and roadmap aligned with product/tech roadmaps
• Establish QA tools, frameworks, standards, and ways of working across the global engineering organization
• Unify and improve testing processes across delivery teams in partnership with Engineering Managers and Product Managers
• Serve as the escalation point for complex testing/quality challenges across global teams
• Champion modern testing technologies and responsible AI adoption
• Define and own quality KPIs and quality gates for product quality and AI delivery
• Own the engineering defect management process and organization-wide defect prevention
• Lead QA approach for AI development end-to-end (AI-assisted and agentic)
• Establish quality, evaluation, and governance for non-deterministic/AI-driven systems (LLM-based/agentic)
• Set enterprise standards for validating AI-generated code for quality, security, maintainability
• Partner with Engineering, Product, and Service Delivery leadership to embed AI fluency and modern QA practice across the organization

Key requirements

• Strong understanding of QA for non-deterministic, ML/LLM-based, and agentic systems
• Experience defining and implementing QA strategy at enterprise scale
• Experience establishing test automation best practices across multiple teams
• Proven ability to shape or lead QA for AI-enabled development
• Track record defining/analyzing quality KPIs and gates
• Ability to influence and mentor senior engineering/product stakeholders
• Experience creating and owning technical strategy and process documentation
• Strong Agile software delivery experience at scale
• Excellent communication and stakeholder-management with fluent English

• Leadership and mentoring
• Excellent communication and stakeholder management
• Collaborative and strategic mindset
• MLOps/LLMOps familiarity
• Prompt design and evaluation techniques for AI-enabled features
• Strong programming in C# or Java

…