Lead Data Engineer

Overview

In this Lead Data Engineer role in London, you design and implement data foundations and end-to-end solutions to maximize data value. You will champion data-driven thinking across IT and business, shaping how decisions are made. You mentor junior engineers and translate data strategy into IT solutions, delivering foundational initiatives for key programs. You drive efficiency across pilots and projects, coordinating change and incident management in a hybrid team. This role offers impact in an energy-sector trading context with modern cloud data platforms.

Responsibilities

• Design and build data foundations and end-to-end data solutions to maximize value
• Foster a data-driven mindset across IT and business stakeholders
• Act as SME and mentor for junior engineers
• Translate vision and data strategy into implementable IT solutions
• Lead Data Foundation initiatives to support key business programs
• Coordinate change, incident, and problem management processes
• Present insights to stakeholders as a data analysis and design SME
• Improve efficiency of pilots and future projects to reduce cost and increase value

Key requirements

• 8+ years of data engineering experience
• Cloud expertise in AWS or Azure
• Strong ELT proficiency
• Strong data modeling proficiency
• Data integration and ingestion skills
• Data manipulation and processing skills
• Experience with GitHub Actions and Azure DevOps
• Experience with data platforms/tools: Azure Data Factory, Databricks, SQL Database, Synapse Analytics, Stream Analytics, AWS Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest
• Trading and energy sector experience (commodity trading and supply operations)
• Strong communication for technical and business audiences; ability to work in hybrid teams
• Project management or Scrum team leadership experience
• Experience with MKDocs documentation
• Experience with external technical ecosystems

• strong communication
• mentoring and coaching
• stakeholder collaboration
• AWS or Azure cloud platforms
• ELT processes
• data modeling

…