Data Engineering Lead

Overview

In this role you will lead the design and delivery of a scalable, secure, AI-ready enterprise data platform. You will collaborate with Data Architecture, Analytics and business teams to build robust data pipelines and trusted data sources for analytics, dashboards and AI-enabled processes. You’ll drive modern data engineering practices in a cloud-first environment and mentor teams while shaping data-driven and AI-enabled capabilities. The position offers impact across claims management and related domains with cutting-edge Azure technologies.

Pay / Benefits

• private medical insurance
• income protection insurance
• discounted gym membership
• professional funding
• remote social events
• ESG involvement

Responsibilities

• Design, develop and maintain enterprise ETL/ELT pipelines integrating data from case management, financial, CRM and third-party systems into a central data platform
• Lead the development and continuous improvement of the cloud-based data platform within Azure
• Ensure pipelines are scalable, reliable, cost-effective and resilient
• Build and maintain datasets supporting reporting, analytics, dashboards and data-enabled products
• Establish engineering best practices including CI/CD, automated testing, version control, and monitoring/alerting
• Collaborate with Data Architects to implement target-state data models and modern data engineering principles
• Partner with data scientists and analysts to operationalise advanced analytics and predictive models
• Manage integrations with insurer portals and external data providers ensuring high-quality, timely, secure data flows
• Support the organisation’s shift to being data-driven and AI-enabled

Key requirements

• Senior Data Engineering or Lead Data Engineer experience
• Hands-on experience with Microsoft Azure data technologies (Azure Data Factory, Synapse Analytics, Microsoft Fabric, Azure Data Lake)
• Advanced SQL development
• Python and modern data pipeline orchestration tools with monitoring/automation
• Proven track record of production-grade data pipelines
• Experience integrating data from multiple business-critical applications and legacy systems
• Understanding of data security, protection and access control in cloud platforms
• Comfort working in regulated data environments with sensitive personal and litigation data
• Excellent stakeholder management and communication skills

• stakeholder management
• communication
• leadership
• Azure Data Factory
• Azure Synapse Analytics
• Microsoft Fabric

…