Senior Manager, Databricks Architect & Delivery Lead, Engineering, AI & Data, Technology & Transformation

Overview

As a Databricks Architect & Delivery Lead, you define the technical vision for enterprise Data & AI transformations and guide secure, scalable architectures. You will work with a cross-functional team of data, cloud and AI specialists to modernise data estates and accelerate AI adoption. The role emphasizes delivery leadership, governance, and collaboration with executive stakeholders to realise measurable business value. This is a chance to shape large-scale platforms and influence clients’ data-driven capabilities in a leading professional services firm.

Pay / Benefits

• hybrid working in London
• world-class development and learning opportunities
• focus on wellbeing
• flexible collaboration with client sites and remote
• career growth and leadership development

Responsibilities

• Lead architecture and technical strategy for large-scale Databricks Data & AI transformation programmes
• Oversee end-to-end delivery including mobilisation, planning, resourcing, financial oversight, risk management and stakeholder reporting
• Define end-to-end solution architectures spanning data engineering, analytics, ML and Generative AI workloads
• Establish enterprise data architectures, governance frameworks and semantic layers using Unity Catalog, lineage, access controls and metadata management
• Design ML, MLOps and LLMOps architectures with feature engineering, model lifecycle management and cost-aware scaling
• Lead client discovery engagements and architecture workshops to understand objectives and opportunities
• Provide architecture governance and design authority aligned with security and engineering best practices
• Coordinate multi-disciplinary teams across architecture, data engineering, analytics and AI
• Translate architecture into delivery with backlog shaping, design assurance, performance optimization and cost management
• Define reusable patterns, reference architectures and accelerators across the Databricks ecosystem
• Advise on technology strategy, cloud adoption, and operating models; support business development and sales activities

Key requirements

• Proven experience leading enterprise architecture for large-scale Data & AI transformation programmes
• Hands-on design of production-grade Databricks solutions including governance, security, orchestration and cost optimisation
• Strong experience defining enterprise solution, data and ML architectures
• Experience designing Generative & Agentic AI architectures including LLMOps and RAG
• Delivery leadership across multiple programmes with governance and senior stakeholder reporting
• Architecture Lead or Design Authority across concurrent programmes
• Strong governance, security and cloud architecture principles understanding
• Excellent stakeholder engagement and executive communication skills
• Industry experience in Financial Services or regulated environments (preferred)

• Excellent communication and consulting skills
• Stakeholder management and influencing at executive level
• Collaborative, multi-disciplinary leadership
• Databricks Data Intelligence Platform
• Delta Lake, Unity Catalog, Spark
• Databricks SQL, Workflows, Delta Live Tables

…