Lead Data Engineer

Overview

In this Lead Data Engineer role, you will steer the design and delivery of modern cloud-based data platforms and automated pipelines to enable insight and decision-making across West Yorkshire’s NHS system. You’ll work with senior leaders and clinicians to translate requirements into scalable data solutions, uphold governance and security, and drive continuous improvement. You’ll lead a team to build a modern intelligence platform that supports better health outcomes and reduced inequalities. This role combines technical leadership with strategic collaboration in a mission-driven health system.

Pay / Benefits

• flexible working
• permanent contract
• Band 8a salary
• opportunity to shape regional health data platforms
• collaboration with cross-functional teams
• professional development support

Responsibilities

• Provide senior technical leadership for data engineering across the ICB
• Steer adoption and continuous improvement of enterprise data platforms and services
• Deliver cloud-based data solutions and automated pipelines
• Develop data models and integration services while ensuring quality, security, governance, and performance
• Translate business requirements from senior stakeholders into robust technical solutions
• Advise on architecture, standards, emerging technologies (including AI)
• Lead and develop a team of data engineers on complex projects
• Manage competing priorities and support innovative data management and automation
• Collaborate with NHS organisations, local authorities and partners to build a modern intelligence platform

Key requirements

• Experience creating data models and schemas
• Experience with industry standard integration/API tools
• Extensive experience building data ingestion pipelines, automation, and modern data platforms
• Data integration via APIs, ETL/ELT, Batch, FAAS
• Architectural design for quality control, security, and information governance
• Understanding of Data Sharing Agreements and Population Health Management
• Experience in line management and project management
• Experience engaging with senior clinical staff and working in IT industry
• Ability to plan operational and strategic delivery to align with organisational objectives
• Strong negotiating skills and ability to build consensus in challenging environments
• Masters degree or equivalent senior-level experience; postgraduate project management qualification

• High emotional intelligence
• Team player with collaborative mindset
• Integrity and trustworthiness
• Data modeling and schema design
• API and integration tools
• Data ingestion pipelines and automation

…