Overview
In this role you build and optimize scalable data pipelines to support client data delivery, collaborating with stakeholders to translate requirements into technical solutions. You will work within a cross-functional team to design and maintain Snowflake-based data warehousing and automate workflows with Airflow and Azure Data Factory. You’ ll contribute to performance and cost efficiency while advancing CI/CD and governance practices. This position offers the chance to impact client analytics through robust, scalable data infrastructure.
Responsibilities
- Design, build, and optimize data pipelines using Azure Data Factory and Apache Airflow
- Ingest, transform, and move data into Snowflake Data Warehouse
- Create and maintain Snowflake objects (tables, views, procedures, stages, file formats)
- Write complex SQL for data processing, validation, and reporting
- Develop reusable components and templates to speed delivery
- Collaborate with client stakeholders and participate in stand-ups and planning sessions
- Use GitLab for source control and support CI/CD pipelines
- Support automated testing, deployment, and monitoring of data workflows
Key requirements
- SEI processes, tools, and compliance standards experience
- Experience building and maintaining data pipelines and workflows
- Strong knowledge of Azure Data Factory for data movement and transformation
- Proficiency with Apache Airflow (orchestration, scheduling, DAGs, error handling)
- 5+ years of data engineering experience with Azure Data Factory, Snowflake, and Airflow
- Bachelor in Computer Science or equivalent experience
- collaboration
- communication
- cross-functional teamwork
- Azure Data Factory
- Apache Airflow
- Snowflake
…
