Senior Infrastructure Software Engineer, Enterprise AI
ScaleNew York, NY; San Francisco, CAPosted 21 August 2025
Tech Stack
Job Description
<div class="p-rich_text_section" style="text-align: left;">Scale GP is building the next generation of enterprise-grade Generative AI products. Our platform provides APIs for knowledge retrieval, inference, and evaluation, enabling customers to build and deploy powerful&nbsp;<strong data-stringify-type="bold">Agentic workflows</strong>&nbsp;for Enterprise use cases. We're looking for a&nbsp;<strong data-stringify-type="bold">Senior Infrastructure Software Engineer</strong>&nbsp;to build and scale our core infrastructure in a fast-paced environment. This team is key to our mission, directly enabling the deployment of these agentic flows for our customers.This is a unique opportunity for an infrastructure leader who is passionate about defining the future of AI deployments. You will be at the forefront of the industry, solving complex, bleeding-edge problems in scalability, security, and developer efficiency. You will architect and implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.</div>
<div class="p-rich_text_section">&nbsp;</div>
<div class="p-rich_text_section"><strong data-stringify-type="bold">What You'll Do:</strong></div>
<ul class="p-rich_text_list p-rich_text_list__bullet p-rich_text_list--nested" data-stringify-type="unordered-list" data-list-tree="true" data-indent="0" data-border="0">
<li data-stringify-indent="0" data-stringify-border="0"><strong data-stringify-type="bold">Define the architectural patterns</strong>&nbsp;for our multi-cloud infrastructure to support secure, reliable, and scalable Agentic workflows for enterprise customers.</li>
<li data-stringify-indent="0" data-stringify-border="0"><strong data-stringify-type="bold">Lead the infrastructure roadmap</strong>&nbsp;with a strong focus on compliance, privacy, and security standards, including designing change management and data isolation strategies.</li>
<li data-stringify-indent="0" data-stringify-border="0"><strong data-stringify-type="bold">Own the development and maintenance</strong>&nbsp;of our best-in-class Agentic observability platform (logging, metrics, tracing, and analytics) to proactively ensure system health and enable rapid incident response.</li>
<li data-stringify-indent="0" data-stringify-border="0"><strong data-stringify-type="bold">Drive developer efficiency</strong>&nbsp;by building automated tooling and championing Infrastructure-as-Code (IaC) paradigms throughout the engineering organization.</li>
<li data-stringify-indent="0" data-stringify-border="0"><strong data-stringify-type="bold">Solve the toughest engineering problems</strong>&nbsp;related to multi-tenancy, data isolation, and high-performance inference at a massive scale, taking end-to-end ownership across the full product lifecycle.</li>
</ul>
<div class="p-rich_text_section"><strong data-stringify-type="bold">What We're Looking For:</strong></div>
<ul class="p-rich_text_list p-rich_text_list__bullet p-rich_text_list--nested" data-stringify-type="unordered-list" data-list-tree="true" data-indent="0" data-border="0">
<li data-stringify-indent="0" data-stringify-border="0"><strong data-stringify-type="bold">Proven experience</strong>&nbsp;in a senior role, with&nbsp;<strong data-stri ... (truncated, view full listing at source)
Apply Now
Direct link to company career page
More jobs at Scale
See all →More JavaScript jobs
See all →Solutions Architect
Fastly · Billings, MT; Boise, ID; Cheyenne, WY; Denver, CO; Los Angeles, CA; Portland, OR; Sacramento, CA; Salt Lake City, UT; San Diego, CA; San Francisco, CA; San Jose, CA; Seattle, WA
Software Engineer (c)
Dropbox · US: SF, California
Senior Automation Engineering Manager
Toast · Bengaluru , Karnataka, India
Software Engineer, Frontend (Hybrid)
Homebase · Toronto