Senior Data Engineer

Overview

You join Kargo to advance scalable data infrastructure and privacy-conscious targeting at a global scale. In this role you will implement and optimize data pipelines, collaborate with tech leads, and drive robust data processes that power high-impact targeting systems. You’ll help shape data architecture, improve reliability, and explore new approaches to onboarding and analytics. This is an opportunity to work across a modern stack in a collaborative, growth-focused environment with a strong emphasis on privacy and performance.

Responsibilities

• Design, implement, and optimize ETL/ELT pipelines using Python, Airflow, Spark, Iceberg, Snowflake, Aerospike, Docker, Kubernetes (EKS), AWS, and real-time streaming (Kafka, Flink).
• Contribute to collaborative design sessions and propose technical solutions for complex data engineering challenges.
• Define and implement testing strategies and promote CI/CD practices with ArgoCD for reliable deployments.
• Monitor, tune, and optimize data systems for reliability, performance, and cost-efficiency.
• Onboard new datasets and enhance targeting capabilities while exploring privacy-compliant methodologies.
• Document technical implementations, procedures, and best practices to support knowledge sharing.

Key requirements

• Extensive experience building and maintaining large-scale data systems with minimal supervision.
• Strong skills in Python, Spark, and Iceberg; ability to optimize data structures for performance.
• Preference for experience with Airflow for data workflows.
• DevOps proficiency in AWS (including EKS), Docker, Kubernetes, and CI/CD automation with ArgoCD; monitoring with Prometheus.
• Experience with analytical warehousing (Snowflake or Clickhouse) and SQL performance/cost awareness.
• Agile experience with Jira and Confluence for task management and documentation.
• Proven ability to drive implementation independently and turn ambiguity into executable actions.
• Excellent communication with technical teams and stakeholders; familiarity with identity, privacy, and targeting methodologies in AdTech.

• strong communication
• collaboration
• problem-solving
• Python
• Spark
• Iceberg

…