Senior Software Engineer, AI/MLOps
GalileoHybrid (Burlingame, California, US)Posted 24 March 2026
Tech Stack
Job Description
This is an hybrid role based in Burlingame, CA with the team working together in person 2 days per week .
About Galileo
Galileo is the leading platform for Gen AI evaluation and observability, with a mission to democratize building safe, reliable and robust applications in the new era of AI powered software development. Our foundation is built on pioneering the early technology behind the world's most ubiquitous AI applications including Apple's Siri and Google Speech. We firmly believe that AI developers require meticulously crafted, research-driven tools to create trustworthy and high-quality generative AI applications that will revolutionize our work and lifestyle.
Galileo addresses the complexities inherent in implementing, evaluating, and monitoring GenAI applications, optimizing the development process for both individual developers and teams by offering a comprehensive platform that spans the full AI development lifecycle. Galileo bridges critical gaps, significantly enhancing developers' ability to refine and deploy reliable and precise GenAI applications.
Since its inception, Galileo has rapidly gained traction, serving Fortune 100 banks, Fortune 50 telecom companies, as well as AI teams at prominent organizations such as Reddit and Headspace Health, among dozens of others.
Galileo has AI research at its core, with the founders coming from Google and Uber where they solved challenging AI/ML problems in the Speech, Evaluation and ML Infra domains. It is now a Series B business backed by tier 1 investors including Battery Ventures, Scale Venture Partners, and Databricks Ventures, with $68M in total funding. We are headquartered in San Francisco with locations such as New York and Bangalore, India forming our areas of future growth.
About the role
As an early engineer at Galileo, you will play a foundational role in designing, building, and scaling our products and team. We’re looking for an exceptional Senior Software Engineer, interested in solving complex problems at the intersection of Data and ML and passionate about the opportunities in Observability and Reliability for GenAI.
What you'll be doing
Technical Design and Architecture - you will champion for the right scalable, reliable architecture and obtain buy-in from all the stakeholders
Planning and Execution - you will work with your team to help plan the roadmap and execute it
PR and Design Reviews - you will uphold the engineering excellence/quality bar by reviewing your peer’s PRs
Collaboration - you will collaborate closely with Product Managers, designers and other TLs to ensure we are building the right strategy and leveraging each other’s work.
Advance Engineering - you will participate in design reviews, on-call and support, participate in and present during Tech Talks and learning sessions & help interview other engineering candidates
What we're looking for
5+ years of experience building Data or AI/ML products
Experience building APIs in Python (FastAPI preferred)
Experience building large scale distributed systems and familiarity with
Messaging and Pub-Sub systems such as RabbitMQ/Kafka
Storage/database systems similar to Postgres, MongoDB, Cassandra, S3
OLAP systems such as ClickHouse, Pinot
Orchestration systems such as Celery
Experience building test suites using frameworks such as PyTest/PyUnit
Experience working effectively during the product development process, working cross-functionally with a product manager, designer, user researcher, and data scientist
Excellent communication skills for collaborating with cross-functional partners
High productivity and care to help teams collaborate more effectively and efficiently
A startup mindset, biasing towards thoughtful action with minimal direction.
Bonus Points
Experience working with Docker and Kubernetes.
Experience building applications on at least one of AWS, Google Cloud, or Microsoft Azure.
Experience building customer facing products with ML frameworks (like PyT ... (truncated, view full listing at source)
Apply Now
Direct link to company career page
AI Resume Fit Check
See exactly which skills you match and which are missing before you apply. Free, instant, no spam.
Check my resume fitFree · No credit card