Databricks Data Engineer

Overview

In this role you will design and maintain data ingestion pipelines in a modern Azure/Databricks environment. You will connect to multiple sources, build robust pipelines, and ensure scalable, reliable data flows for the organization. You’ll implement ingestion strategies, develop ETL/ELT processes, and apply transformation modeling to enable data-driven decisions. This contract role focuses on practical data ingestion and engineering, collaborating with cross-functional teams to support analytics and data platforms. The opportunity offers hands-on work with Databricks, Azure services, and contemporary data architectures to shape data pipelines at scale.

Responsibilities

• Build and maintain data ingestion pipelines using Databricks
• Connect to multiple data sources including SQL databases, APIs and Azure services
• Develop pipelines using Azure Data Factory and Databricks Lakeflow
• Implement ingestion strategies including incremental and batch loads
• Develop ETL/ELT processes using Databricks Medallion Architecture
• Write and maintain Python data engineering code
• Use dbt for data transformation and modelling
• Ensure pipelines are scalable, reliable and maintainable

Key requirements

• Strong commercial Databricks experience
• Proven data ingestion experience
• Azure Data Factory
• Databricks Lakeflow
• SQL and API integration
• Medallion Architecture
• Strong Python
• dbt
• Experience with incremental/batch data ingestion

• Databricks
• Azure Data Factory
• Databricks Lakeflow
• SQL
• APIs
• Medallion Architecture

…