Senior Databricks / Snowflake Data Architect – BestX

Overview

In this role, you will design and implement high‑performance multi‑asset analytics platforms using kdb+ to support BestX’s data-driven trading analytics. You will work closely with quants and engineers to deliver scalable, low-latency solutions and to optimize tick systems and data pipelines. You will champion modern development practices, including TDD and CI/CD, and drive architectural decisions that balance performance and maintainability. This is an opportunity to shape the BestX TCA platform within State Street’s global markets ecosystem, contributing to regulatory readiness and execution analytics at scale.

Pay / Benefits

• flexible work‑life support
• paid volunteer days
• inclusive environment
• robust employee networks

Responsibilities

• Design and develop components of the multi‑asset analytics platform
• Architect and maintain kdb+ tick systems with efficient data models and schemas
• Process large-scale, high‑frequency datasets ensuring low latency and high throughput
• Analyse and optimise q queries, data models, and ingestion pipelines for real-time and historical workloads
• Apply Agile practices across cloud-based, server-side, and database-driven systems
• Develop understanding of Transaction Cost Analysis (TCA) and MiFID/MiFIR benchmarks
• Own deliverables from design to production and promote best practices
• Champion Test‑Driven Development and shift‑left CI/CD practices

Key requirements

• 5+ years hands‑on kdb+ development experience
• Strong expertise in kdb+/q and Python
• Experience with data science toolchains (Jupyter, pandas, NumPy, scikit‑learn) and applied ML
• Knowledge of parallel computing frameworks (e.g., Slurm)
• Background in quantitative analysis (math modelling, statistics, regression, probability)
• Bachelor’s or Master’s in CS, Mathematics, Statistics, or related STEM from a top‑ranked university
• Hands‑on experience with AWS and/or other modern cloud infrastructure

• strong collaboration with cross‑functional teams
• ability to drive change and improve engineering practices
• problem‑solving mindset with focus on performance
• kdb+/q
• Python
• AWS

…