Software Engineer, Machine Learning Infrastructure

<div class="content-intro"><p><img style="display: none; max-width: 100%;" src="https://click.appcast.io/greenhouse-te8/a31.png?ent=34e=22630t=1701374353806" width="1px"> <img style="display: none; max-width: 100%;" src="https://track.jobadx.com/v1/i.gif?utm_pixel=224e990b-8ff4-4287-8d5d-2ff09647f181utm_ptz=ESTutm_rqt=track" alt="" width="1"></p></div><h2><strong>About the Team</strong></h2> <p>The GenAI Platform team builds the centralized AI infrastructure that powers every Generative AI use case at DoorDash — Search, Recommendations, Fraud, Chatbots, Merchant tools, and more. We are part of the Machine Learning Platform (MLP) org, which powers critical real-time decision-making for millions of orders each day.</p> <p>Our team owns:</p> <ul> <li><strong>LLM Gateway</strong> — unified access to OpenAI, Anthropic, Google, and open-weights models with cost attribution, guardrails, and multi-region deployment across DoorDash, Wolt, Deliveroo, and SevenRooms</li> <li><strong>MCP Gateway</strong> — authentication, tool registry, and rate limiting for MCP servers across the company</li> <li><strong>Agent Gateway</strong> — infrastructure for building and deploying AI agents with tool access, streaming, and observability</li> <li><strong>Evals Platform</strong> — evals with human annotation, LLM-as-a-judge, auto-calibration, and custom use-case-specific UIs for human annotation and debugging</li> <li><strong>Project Slingshot (Open-Weights Models)</strong> — fine-tuning, online inference, and batch inference for open-weights LLMs</li> </ul> <p>We are a team of 6 engineers in a high-growth phase — every AI product team at DoorDash is building with GenAI and we need to scale our infrastructure to match.</p> <h2><strong>About the Role</strong></h2> <p>You will join the GenAI Platform team to build the foundational infrastructure layer that every AI product team at DoorDash depends on. You'll rotate across areas — agents, evals, open-weights models, and gateways — gaining broad exposure to the GenAI stack while going deep on the problems that matter most.</p> <h2><strong>You're excited about this opportunity because you will…</strong></h2> <ul> <li>Use your backend, data, and ML infrastructure expertise to help build a high-quality GenAI platform</li> <li>Build and improve the reliability, scalability, and monitoring of our GenAI infrastructure, including the LLM Gateway, MCP Gateway, fine-tuning systems, and model serving</li> <li>Build scalable, high-performance ML pipelines — from retrieval (e.g., RAG) to batch inference — that adapt quickly to new technologies</li> <li>Develop an easy-to-use platform that supports fast iteration and deployment of products powered by Generative AI, including AI agents and evals</li> <li>Collaborate with ML Engineers and Product Engineers across DoorDash, Wolt, Deliveroo, and SevenRooms to evolve the platform for their use cases</li> <li>Shape the direction of DoorDash's centralized GenAI platform that supports all business functions</li> </ul> <h2><strong>We're excited about you because…</strong></h2> <ul> <li>B.S., M.S., or Ph.D. in Computer Science or equivalent</li> <li>Strong backend engineering skills — you can design APIs, build reliable services, and reason about distributed systems</li> <li>Strong fundamentals in computer science and Python</li> <li>2+ years of industry experience in software engineering</li> <li>Experience building and deploying machine learning systems in production</li> <li>Experience building infrastructure in cloud environments (AWS or GCP) — especially backend services at scale</li> <li>Comfortable using AI coding tools to move fast, while applying strong engineering judgment</li> <li>Problem solver who thrives on 0→1 initiatives and can navigate across multiple interconnected systems</li> </ul> <p><br><br></p> <p style="font-weight: 500;">Notice to Applicants for Jobs Located in NYC or Remote Jobs Associated With Office in NYC Only</p> <p>We use Covey as part of our hi ... (truncated, view full listing at source)