Databricks Data Engineer – London (Hybrid) – Up to £80,000
Databricks – Azure – PySpark – Unity Catalog – AI & Machine Learning – Consulting
Are you looking to join a growing Data & AI team delivering some of the UK’s most ambitious transformation programmes.
Due to continued growth, we’re hiring multiple Databricks Data Engineers to join a rapidly expanding Data & AI practice. Whether you’re currently working within a consultancy or delivering Databricks solutions in industry, we’d love to hear from engineers passionate about modern data platforms, AI and cloud technologies.
Our client is building one of the UK’s leading Databricks practices and is investing heavily in Data & AI. You’ll work on Databricks-led transformation programmes, helping enterprise organisations design and build modern Lakehouse platforms that support advanced analytics, machine learning and AI initiatives.
You’ll join a high-performing team of architects, engineers and AI specialists, solving complex technical challenges for large-scale clients. This is an opportunity to work with cutting-edge Databricks technologies, gain exposure to major Data & AI programmes and accelerate your career within a collaborative and highly respected consulting environment.
If you enjoy combining hands-on engineering with stakeholder engagement and solving real-world business challenges through data, this is a fantastic opportunity to make an impact.
You Will Work With
- Designing and building enterprise-scale Databricks Lakehouse solutions
- Developing high-performance batch and streaming data pipelines using PySpark and Spark SQL
- Building AI-ready data products and trusted data foundations
- Implementing Delta Lake, Unity Catalog, Databricks SQL and modern governance frameworks
- Working directly with clients to gather requirements and define solution architectures
- Delivering end-to-end data engineering projects from design through to production deployment
- Optimising data platforms for performance, scalability, reliability and cost efficiency
- Supporting advanced analytics, machine learning and emerging Generative AI initiatives
- Applying modern engineering practices including CI/CD, automated testing and Infrastructure as Code
- Collaborating with architects, data scientists and cloud specialists across complex transformation programmes
- Contributing to technical leadership, best practices and mentoring less experienced consultants
- Annual performance bonus
- Access to market-leading Data, AI and Cloud projects
- Clear and structured career progression framework
- Industry-recognised training and certifications
- Exposure to enterprise-scale Databricks and AI implementations
- Flexible benefits package
- Inclusive and collaborative culture focused on professional development
Key Experience
To be successful in this role, you’ll likely have experience with:
- Commercial experience in Data Engineering within cloud environments
- Strong hands-on Databricks expertise
- Deep understanding of Lakehouse architecture, Delta Lake and Medallion design patterns
- Advanced SQL skills and strong development experience with Python and/or Scala
- Experience building and supporting production-grade data pipelines
- Experience delivering Databricks solutions within a production environment.
- Strong stakeholder engagement and client-facing communication skills
- Knowledge of modern data engineering best practices including CI/CD and automated testing
- Azure Data Factory, Airflow or Databricks Workflows
- MLflow, Feature Engineering, Vector Search and modern AI enablement technologies
- Terraform, Docker and Kubernetes
- Databricks certifications
- Experience supporting Machine Learning, GenAI or Agentic AI solutions
- Background working within a consultancy or client-facing environment
- Whether you’re currently working within a consultancy or delivering Databricks solutions in industry, we’d love to hear from engineers passionate about modern data platforms, AI and cloud technologies.
#J-18808-Ljbffr…