Senior Data Engineer – Python

Overview

In this role you will design and maintain scalable data pipelines for Bloomberg’s Climate Data Utility, enabling open, public-good data access via websites and APIs. You will translate diverse source data into structured forms, enforce data quality, and collaborate with data scientists to drive data-driven decisions. You’ll document lineage and architectures, participate in CI/CD deployments to the cloud, and mentor junior engineers. This is a hands-on position at the intersection of data engineering and climate data delivery, offering impactful, mission-driven work.

Responsibilities

• Design and develop scalable data pipelines in Python reading from APIs and structured files (Excel, Parquet)
• Translate domain and source-specific business logic into efficient code for usable downstream data
• Implement data transformations using Pandas and Pydantic to ensure data quality and adherence to business logic
• Collaborate with data scientists and analysts to support data-driven decision-making
• Document data engineering processes including data lineage, data dictionaries, and system architectures
• Maintain best practices via code reviews, version control, and industry standards
• Deploy production-quality code through CI/CD pipelines into the cloud
• Provide mentorship to junior teammates in data engineering practices

Key requirements

• 7+ years of experience in data engineering or equivalent
• Proficiency in Python programming
• Experience building and managing data pipelines
• Knowledge of data warehousing and ETL processes
• Excellent problem-solving and communication skills

• communication
• mentorship
• collaboration
• Python
• data pipelines
• Pandas

…