Senior Software Engineer – AI Infrastructure

Company: Kraken
Apply for the Senior Software Engineer – AI Infrastructure
Location:
Job Description:

Overview

In this role you design and build the production infrastructure that powers AI agent systems at scale. You’ll develop high-performance Rust services and architect systems capable of supporting millions of users with low latency. You collaborate across infrastructure teams to deliver reliable ML infrastructure, MLOps patterns, and robust guardrails for agent-driven workflows. This position blends systems engineering with ML operations in a high-stakes, production environment, offering a chance to impact crypto technologies at scale.

Responsibilities

  • Design and build the infrastructure layer powering AI agent systems in production
  • Develop high-performance Rust services for model inference, orchestration, and execution
  • Architect scalable systems supporting millions of users and high throughput
  • Build reliable ML infrastructure and MLOps patterns for deployment, evaluation, and monitoring
  • Define guardrails, observability, and failure handling for agent workflows
  • Optimize latency, throughput, and cost across inference and orchestration
  • Collaborate with the Agent Systems team to turn prototypes into production systems
  • Contribute to foundational infrastructure decisions in a high-scale, high-impact environment

Key requirements

  • 5+ years of experience building and operating high-scale production systems
  • Strong proficiency in Rust and systems-level programming
  • Deep understanding of distributed systems, reliability engineering, and performance optimization
  • Experience operating services serving millions of users or high-throughput workloads
  • Familiarity with ML infrastructure, model serving, or MLOps in production environments
  • Experience designing observability, monitoring, and failure recovery systems
  • Strong collaboration skills across infrastructure and applied engineering teams
  • High ownership mindset in high-stakes production environment
  • collaboration
  • ownership
  • cross-functional communication
  • Rust
  • distributed systems
  • reliability engineering

…

Posted: October 17th, 2026