Lead Data Platform Engineer

Overview

As Lead Data Platform Engineer you will guide an Agile data platform team to deliver secure, scalable data pipelines and a data lake on AWS. You’ll collaborate with risk, security and compliance to meet GDPR/PCI DSS and industry standards, while shaping technology roadmaps and ensuring high-quality software. This role blends hands-on engineering with team leadership to drive innovation within Experian’s Ascend Cloud Foundation Platform. You’ll work closely with cross-functional partners to enable data-driven decisions at scale.

Pay / Benefits

• great compensation package
• discretionary bonus plan
• pension
• bupa healthcare
• sharesave scheme
• 25 days annual leave plus 8 bank holidays and 3 volunteering days

Responsibilities

• Lead an Agile technical team
• Build data pipelines and a data lake
• Deliver quality software
• Collaborate with risk, security and compliance to meet regulatory requirements
• Identify overlapping requirements across teams and help build technology roadmaps
• Codebase ownership
• Technical application ownership

Key requirements

• DevOps & IaC tooling experience (Terraform, CI/CD pipelines, Git, Jenkins, Harness)
• Experience with Apache Spark/Hadoop
• Experience with AWS services (Glue, S3, Step)
• Experience building data pipelines and data lake
• Familiarity with Bitbucket & Jira lifecycle tools
• Programming in Scala or Python
• Configuration as code principles and API integration
• Experience with automated testing methodologies
• Ability to analyze and compare large data sets
• Experience with Lambdas, EventBridge, SQS, Lake Formation

• leadership and team coaching
• collaboration across risk, security and compliance
• strong communication
• Terraform
• CI/CD pipelines
• Git

…