Senior Data Engineer

Overview

In this role, you will own the design and delivery of scalable data pipelines and products to create a single source of truth for the business. You’ll work closely with cross-functional teams to turn data challenges into technical solutions, while embedding data quality, governance, and access controls. You will shape the data architecture and platform strategy, with opportunities to mentor others and influence a growing data function. This is a hands-on, high-impact position within a fast-growing software business with a strong data agenda.

Pay / Benefits

• health insurance
• income protection
• life assurance
• subsidised gym membership
• 25 days’ holiday
• birthday off

Responsibilities

• Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake
• Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems
• Shape enterprise data architecture balancing scalability, performance, security and maintainability
• Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to translate business problems into technical solutions
• Embed data quality, governance and access controls throughout the data lifecycle
• Mentor a junior engineer and help mature the data function

Key requirements

• Senior level data engineering experience
• Strong Databricks skills (PySpark, Spark SQL, Delta Lake)
• Advanced SQL and Python coding skills
• Experience building and optimising enterprise-scale data pipelines and ETL/ELT solutions
• Solid grounding in data architecture, modelling and modern data platform design
• Cloud experience (AWS preferred; Azure acceptable) and familiarity with CI/CD and source control

• Cross-functional collaboration
• Mentorship and coaching
• Communication with stakeholders
• Databricks
• PySpark
• Spark SQL

…