AI Testing & Automation Engineer (Python/LLM Evaluation)

Company: Reply
Apply for the AI Testing & Automation Engineer (Python/LLM Evaluation)
Location: London
Job Description:

Reply is seeking a mid/senior-level AI Testing & Engineering Specialist with strong Python expertise to build a next-generation testing framework for generative AI agents, including evaluation pipelines, synthetic data, observability, and quality metrics for LLM-based systems.

You will collaborate across AI engineering, data pipelines, and QA to design scalable testing infrastructure and contribute to standards for production AI validation.

#J-18808-Ljbffr…

Posted: October 17th, 2026