Staff Engineer - Agentic Platform

We, at ThoughtSpot, are looking for a Staff Engineer for the Agentic Platform team within Spotter. What is Spotter? ThoughtSpot was started with the mission of making the world more fact-driven by empowering any business professional to ask ad-hoc questions of their data without any technical skill. This mission has been realized by building foundational systems and expertise in NLP, distributed systems, analytical databases, relevance models, personalization, and more recently Generative AI, over a decade. Spotter is the AI analyst that hundreds of Fortune 500 businesses depend on. AI is the new BI and the Spotter Engineering team is at the forefront. This team has created the Data Analytics product most differentiated on AI and Natural Language. Our AI infrastructure includes distributed tries, graphs, indexes, data models, logs, and events deployed across more than fifty microservices built to scale for billions of data points. About The Role: A Staff Engineer in the Agentic Platform team, responsible for building the foundational infrastructure that powers our next-generation AI agents. You will have the opportunity to architect platforms that orchestrate complex workflows, enabling millions of business people to make smarter decisions through advanced AI reasoning and automation. What You'll Do: Build and Manage AI Platform: Architect and implement a robust AI platform, including LLM gateways and infrastructure for AI agents capable of orchestrating complex workflows and conversational interfaces. Model Orchestration: Develop capabilities to dynamically configure and switch between specialized models optimized for different tasks such as reasoning, thinking, and coding to ensure optimal performance and cost-efficiency. Advanced Observability: Design and build comprehensive observability solutions using the latest frameworks (such as Langfuse) to provide deep visibility into agent performance, traces, and interactions. Benchmarking & Evaluation: Build rigorous benchmarking frameworks for AI applications to systematically evaluate model performance, latency, and quality across various use cases. Accuracy & Drift Monitoring: Design and implement data pipelines to collect production data and assess drifts in the accuracy of AI applications, ensuring high reliability and trust in our AI agents. System Scale & Reliability: Design, develop, test, maintain, monitor, and improve distributed systems and platform infrastructure to enable high-velocity iteration. Technical Leadership: Bring technical thought leadership to advance ThoughtSpot’s differentiation and market leadership in democratizing data analytics for business users. What You Bring: Education: Master's/PhD degree in Computer Science, Machine Learning, Data Science, or a related field. Experience: Have 10+ years of experience designing and implementing consumer-grade AI applications or distributed platforms. You understand what it takes to write software that is used by millions of people. AI Platforms & Agents: Proven track record of building AI platforms, specifically LLM gateways, and experience with agentic architectures (e.g., LangChain, AutoGPT concepts, or custom orchestrators). Observability: Hands-on experience with modern AI observability stacks (e.g., Langfuse, Arize, or custom solutions) for monitoring LLM behavior in production. Evaluation Frameworks: Experience building and maintaining benchmarking frameworks to evaluate the quality and performance of Generative AI applications. Data Engineering: Ability to build data pipelines for logging, evaluation datasets, and drift detection. Coding Proficiency: Strong coding skills in one of the modern languages such as C++, Go, Java, or Python. System Design: Experience with complex, high-volume distributed systems and an understanding of how to scale AI/ML infrastructure. About ThoughtSpot With ThoughtSpot’s next-generation Search & AI-driven analytics platform, business people can type a simple Google-like search ... (truncated, view full listing at source)