Senior Software Engineer – AI Infrastructure

Building the Future of Crypto Our Krakenites are a world-class team with crypto conviction, united by our desire to discover and unlock the potential of crypto and blockchain technology.What makes us different? Kraken is a mission-focused company rooted in crypto values. As a Krakenite, you’ll join us on our mission to accelerate the global adoption of crypto, so that everyone can achieve financial freedom and inclusion. For over a decade, Kraken’s focus on our mission and crypto ethos has attracted many of the most talented crypto experts in the world.Before you apply, please read the Kraken Culture page to learn more about our internal culture, values, and mission. We also expect candidates to familiarize themselves with the Kraken app. Learn how to create a Kraken account here.As a fully remote company, we have Krakenites in 70+ countries who speak over 50 languages. Krakenites are industry pioneers who develop premium crypto products for experienced traders, institutions, and newcomers to the space. Kraken is committed to industry-leading security, crypto education, and world-class client support through our products like Kraken Pro, Desktop, Wallet, and Kraken Futures.Become a Krakenite and build the future of crypto!Proof of workThe teamThe AI Infrastructure team builds and operates the production systems that power intelligent agents at scale. This team sits at the foundation of the agent platform, ensuring that model inference, orchestration, and execution layers are reliable, observable, and performant under real-world load.Working closely with the Agent Systems team and broader infrastructure partners, this group owns the core primitives that enable agents to safely operate across internal systems. The environment is high-scale and high-stakes — systems serve millions of users and must meet strict reliability, latency, and correctness standards.This is a deeply production-oriented team. Engineers here combine strong systems thinking with applied ML infrastructure experience, building in Rust and operating services where performance and failure modes matter.The opportunityDesign and build the infrastructure layer powering AI agent systems in productionDevelop high-performance Rust services that handle model inference, orchestration, and executionArchitect scalable systems capable of supporting millions of users and high request throughputBuild reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoringDefine guardrails, observability, and failure handling for agent-driven workflowsOptimize latency, throughput, and cost across inference and orchestration layersPartner closely with the Agent Systems team to translate experimental prototypes into hardened production systemsContribute to foundational infrastructure decisions in a high-scale, high-impact environmentSkills you should HODL5+ years of experience building and operating high-scale production systemsStrong proficiency in Rust and systems-level programmingDeep understanding of distributed systems, reliability engineering, and performance optimizationExperience operating services serving millions of users or high-throughput workloadsFamiliarity with ML infrastructure, model serving, or MLOps in production environmentsExperience designing observability, monitoring, and failure recovery systemsStrong collaboration skills working across infrastructure and applied engineering teamsHigh ownership mindset in high-stakes production environmentNice to havesExperience building infrastructure for agent-based or LLM-powered systemsBackground in high-performance networking, async systems, or low-latency architecturesExperience with container orchestration and cloud-native infrastructureFamiliarity with evaluation frameworks and model performance monitoring at scaleExperience working in fast-moving 0→1 or platform-building teamsUnless a specific application deadline is stated in the job posting, applications are accepted on an ongoing basis.P ... (truncated, view full listing at source)