Data Engineering Lead

Overview

In this role you will lead the design and delivery of an enterprise, AI-ready data platform on Azure, enabling advanced analytics, reporting and data-powered products. You’ll work with Data Architecture, Analytics and business teams to build robust pipelines, ensure trusted data, and support a data-driven, AI-enabled organization. You’ll combine hands-on delivery with leadership, setting engineering best practices and driving continuous improvement. This is a pivotal, strategically important role with impact on governance, security and cross-functional data initiatives.

Pay / Benefits

• flexible work life balance
• private medical insurance
• income protection insurance
• discounted gym membership
• professional funding for growth
• in-person and remote social events

Responsibilities

• Design, develop and maintain enterprise ETL/ELT pipelines from case management, finance, CRM and third-party systems into a central data platform
• Lead the cloud data platform development on Azure, ensuring scalability, reliability and cost-effectiveness
• Build and maintain datasets to support reporting, analytics, dashboards and data-enabled products
• Establish and promote engineering best practices, including CI/CD, automated testing, monitoring and alerting for pipelines
• Collaborate with Data Architects on target-state data models and modern data engineering principles
• Partner with data scientists and analysts to operationalize advanced analytics and predictive models
• Manage integrations with insurer portals and external data providers ensuring timely, secure data flows
• Support the organisation’s shift towards a data-driven and AI-enabled culture

Key requirements

• Senior Data Engineering or Lead Data Engineer experience
• Strong hands-on experience with Azure data technologies (Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, Azure Data Lake)
• Advanced SQL development skills
• Proficiency in Python and data pipeline orchestration tools with monitoring/automation
• Proven track record of production-grade, monitored data pipelines
• Experience integrating data from multiple business-critical applications and legacy systems
• Good understanding of data security, protection and access control in cloud platforms
• Comfort in regulated environments with sensitive data
• Excellent stakeholder management and communication skills

• stakeholder management
• communication
• collaboration
• Azure Data Factory
• Azure Synapse Analytics
• Microsoft Fabric

…