Senior Technical Lead

Overview

In this strategic data engineering role, you will lead the migration of the client’s ETL estate from Matillion to AWS Glue, shaping target-state architecture across compute, data, and orchestration layers. You’ll collaborate with engineering teams to reverse-engineer the current landscape, define reusable migration patterns, and deliver a blueprint that enables a large-scale data platform transition. The work is highly collaborative, combining governance, PoC testing, and architectural decisions to drive a safe, scalable transformation. You’ll play a pivotal role in aligning technical design with business goals and architectural governance.

Responsibilities

• Define and own the target AWS architecture for compute, data, and orchestration layers
• Own HLD/LLD documentation for migration workloads
• Prepare and present architecture proposals to the Architecture Review Board
• Make and document key technical decisions across the migration program
• Define reusable architecture and migration patterns for reuse
• Design the Agentic AI migration framework architecture and its integration with the broader landscape

Key requirements

• 5+ years experience
• Hands-on experience with AWS Migration
• AWS Glue, Step Functions, Lambda, EventBridge — hands-on design experience
• IaC (Terraform) — strong experience
• Data platform architecture — scaleable data lakes, warehouses, pipelines
• PySpark — hands-on large-scale data processing
• CI/CD — pipelines for infra and data workflows
• AI/ML frameworks — knowledge of adoption within architecture design
• GitHub Copilot — practical experience in development/architecture workflows

• collaborative mindset
• strong communication and stakeholder alignment
• ability to balance cost, performance, and scale
• AWS Glue
• Step Functions
• Lambda

…