Data Scientist - LLM

Data Scientist - LLM We believe conversations will become the #1 way to shop. At Gorgias, we’re building the platform that makes this real: a unified AI agent that sells, supports, and re-engages customers across the entire journey. Conversational Commerce is the future of ecommerce, and we’re leading that shift. Our mission is to turn every interaction between a brand and its customers into a relationship: personal, seamless, and intelligent. By combining deep product expertise with the latest in AI, we’re making shopping feel more natural, human, and connected than ever before. To win, we focus relentlessly on: - Quality: conversations that feel authentic and on-brand. - Experience: effortless shopping from chat to checkout. - Re-engagement: personal, 1-1 dialogue instead of noisy marketing. The opportunity is massive. As AI reshapes how people buy, Gorgias is building the foundation for the next decade of ecommerce, where every brand has its own intelligent agent and every customer feels understood. Join us to make Conversational Commerce real. ABOUT THE TEAM You’ll join the Conversational AI team at Gorgias, focused on building AI Agents that automate customer support for e-commerce merchants at scale. Today, our AI handles over 1.5M automated interactions per month, and growing fast. The team is cross-functional, bringing together Software Engineers, AI Engineers, Product Managers, and Designers to build reliable, production-grade AI systems. We are evolving from a hands-on, iteration-heavy team into a platform-oriented team. Over the next 6–12 months, our goal is to build internal tooling that enables other Gorgias teams to develop and deploy AI agents independently. WHAT YOU WILL DO Role Overview: As a Data Scientist focused on LLM at Gorgias, you will play a crucial role in developing, refining, and enabling our AI Agent, designed to automatically address and resolve shopper requests for our merchant clients. Beyond prompt engineering, you'll be instrumental in scaling the AI Agent's capabilities by developing the right LLM strategies to enable our services. You will work closely with our ML Engineers, Product Managers, and Software Engineers to create, optimize, and implement solutions that enhance the efficiency, accuracy, and functionality of our AI-driven customer support solutions. WHAT YOU’LL DO - Design and iterate on LLM-based workflows, including prompting, chaining, and tool usage, to improve the performance of AI agents in production - Build and improve systems that reliably handle real customer support interactions at scale - Review large volumes of customer conversations to identify failure modes and areas for improvement - Develop and maintain evaluation frameworks, including offline testing and online A/B experiments - Define and track metrics to measure AI agent performance and guide iteration - Create and maintain datasets for continuous improvement and non-regression - Collaborate with Product Managers and Engineers to prioritize improvements and ship high-impact features - Contribute to the design of internal tools and abstractions that enable scalable AI agent development across teams - Integrate AI agents with internal systems and external e-commerce platforms - Document methodologies, best practices, and learnings to support team scalability and knowledge sharing WHO YOU ARE - 2–5 years of experience in software engineering, applied AI, or a similar role - Strong programming skills in Python or TypeScript - Experience building LLM-powered applications or AI agents in production environments - Comfortable working with real-world data, including reviewing large volumes of conversations to identify issues and improvement opportunities - Experience designing and iterating on prompts, including techniques such as chaining, few-shot prompting, or tool usage - Familiarity with evaluating LLM performance through structured methods, such as offline evaluation and A/B testin ... (truncated, view full listing at source)