Databricks Data Engineer

Overview

As a Databricks Data Engineer in NTT DATA’s Data & AI practice, you will build scalable data pipelines and optimize Lakehouse architectures to enable advanced analytics and AI use cases for clients. You’ll design robust ETL/ELT workflows, integrate real-time and batch data sources, and ensure governed data products. You’ll work in a collaborative, client-facing environment, driving data solutions from conception to delivery. This role offers the chance to shape modern data ecosystems at scale and contribute to innovative client outcomes.

Responsibilities

• Client engagement & delivery
• Data pipeline development (batch and streaming)
• Databricks & Lakehouse architectures
• Data modelling & optimisation (Delta Lake, Medallion architecture)
• Collaboration & best practices
• Quality, governance & security

Key requirements

• Proven data engineering and pipeline development on Databricks and cloud-native platforms
• Strong consulting values with client-facing collaboration
• Hands-on experience across ingestion, transformation, modelling, governance, and consumption
• Strong problem-solving, analytical, and communication skills
• Experience leading or mentoring teams of engineers to deliver scalable data solutions
• Deep expertise with Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow)
• Proficiency in ETL/ELT tools such as DBT, Matillion, Talend
• Strong SQL and Python skills
• Experience with cloud platforms (AWS, Azure, GCP)
• Familiarity with Databricks Workflows and orchestration tools
• Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon)
• Familiarity with medallion architectures, data lakehouse concepts and distributed processing
• Experience with GitHub, Bitbucket and CI/CD pipelines
• Understanding of data governance, security, and compliance frameworks
• Exposure to AI/ML workloads desirable

• Consulting mindset and client-facing collaboration
• Strong problem-solving and analytical abilities
• Excellent communication skills
• Databricks platform (Spark/PySpark/Scala)
• Delta Lake
• Unity Catalog

…