Data Engineer (G7)
Company: Government Recruitment ServiceSalary: £57,946 to £75,664 a yearHours: Full-timeLocation: CV1 2WTJob type: PermanentPosting date: 16 Oct 2026Closing date: 1 Nov 2026
Summary
Please notethis role requires you to passSecurity Checkclearance. For further information, please see ‘Selection process details’.
You must have resided continuously in the UK for at least 3 of the last 5 years, 2 of which must have been the immediately preceding years from the point of applying for this job.
Are you a Senior Data Engineer with expert-level experience in Azure data engineering, ETL/ELT pipeline design and technical team leadership?
Join DWP as part of our Data Engineering community, where you will lead the design and delivery of secure, scalable data solutions that power services used by millions of people across the UK. This role plays a key part in ensuring our data estate is reliable, well-governed and continuously improving, enabling analysts, data scientists and operational teams to access trusted data at scale.
Roles and Responsibilities:
- Lead the team in designing, developing andmaintainingscalable ETL/ELT pipelinesusingastrong knowledge of PySpark and Python to ensure best practice and standards are met in optimizing,validatingand standardising all team data workflows as well as batch processes.
- Lead collection of complex data requirements from a wide range of stakeholders, interpret the data and shape data sets to for Data Analysts to fulfil requirements in their creation of analysis and insight dashboards.
- Lead the build and management as well as the supply of data to multiple systems and applications including database management. This to secure data availability and the construction of efficient scripts to extract data for cross business usage.
- Leading immediate team though large-scale data and platform transformation and/or migration programmes, ensuring bestpracticeand building capability within the team as the transformation occurs. Set direction of change and proactivelyidentifykey issues.
- Apply a deep understanding and experience of cloud data engineering toolsets in developing complex pipelines, lead development of products and automation processes. Lead development of logging,monitoringand assuring tool performance information.
- Oversee, support and manage team in developing and using a range of operational tracking and cataloguing tools to track data and metadata through its journey such as: Google Cloud DataCatalog, AWS Glue DataCatalog, Azure DataCatalog, Informatica Enterprise DataCatalog, Alation, Apache Atlas etc. Ensuring compliance with business standards.
- Lead the use of Agile practices in the team toleveragedata engineering tools like version control, automation, monitoring to streamline data pipelines, automate testing, deployment and track changes.
Skills England is an executive agency of the Department for Work and Pensions (DWP), working with employers, training providers, local partners and government to create better skills for better jobs. We play a leading role in identifying current and future skills needs across the economy, helping to ensure that people can access high-quality education, training and employment opportunities while supporting businesses to develop the skilled workforce they need. As part of the Digital and Data Services team you will play a key role in ensuring Skills England creates, maintains and uses data efficiently and effectively to drive decisions and produce high quality technical education products and labour market insights.
Locations for this team are: London, Coventry, Darlington, Sheffield, Leeds. Roles within other teams will be based in the locations advertised above. This can be discussed further, should you be successful.
Proud member of the Disability Confident employer scheme
About Disability Confident Disability Confident is a government scheme. It encourages employers to recruit and retain disabled people and those with long term health conditions.
#J-18808-Ljbffr…