AI Operations Specialist

AI Operations Specialist ABOUT BRETTON AI Bretton AI is the leading AI agent platform for financial services. Companies like Robinhood, Mercury and Gusto trust us to automate mission critical work, starting with anti-money laundering and counter-terrorism investigations. We’ve raised over $95M from Greylock, Y Combinator, Thomson Reuters Ventures and other top tier investors. We’re based in downtown San Francisco and our team comes from world-class organizations like SpaceX, Google, Netflix, Stripe, Plaid and more. THE ROLE We're looking for a detail-oriented, analytically-minded person to join our AI Operations team. You'll be on the front lines of ensuring our AI agents are performant for banks and fintechs fighting financial crime at scale — monitoring quality, testing new features, and working directly with engineering and customers to keep our platform running at its best. This is a rare opportunity to learn how cutting-edge AI systems work in production while making a real impact on global financial security. WHAT YOU'LL DO - Conduct quality reviews of AI agents to ensure they meet the highest standards for compliance teams at banks and fintechs - Test new features and custom logic before they go live for customers - Analyze case data to identify patterns, issues, and opportunities for improvement - Work directly with engineering to understand and measure the impact of system changes - Learn state-of-the-art AI monitoring techniques including performance drift detection, human scoring pipelines, and dataset preparation - Support our largest customers by providing operational insights and recommendations - Partner with product and engineering to translate operational findings into platform improvements WHAT SUCCESS LOOKS LIKE - Month 1: Master our AI platform and learn complex compliance workflows. Shadow experienced team members and begin conducting your first case reviews. - Month 2: Take ownership of operational support for major customer deployments. Conduct detailed quality assessments and partner with engineering to improve system performance. - Ongoing: Become the go-to expert for AI operations, conducting critical reviews that directly shape product development and customer success. WHAT WE'RE LOOKING FOR - 1–3 years of professional experience or equivalent internship experience - Strong analytical and critical thinking skills with exceptional attention to detail - Ability to review complex information and identify patterns or issues - Comfortable learning new technical systems independently - Strong written and verbal communication skills - Excited to work in a fast-paced startup environment BONUS POINTS - Exposure to financial services, fintech, or regulated industries - Experience at a fast-paced startup - Familiarity with coding/scripting — SQL, dashboards, quick scripts - Customer-facing experience in any capacity - Genuine interest in AI/ML systems and how they're deployed in the real world COMPENSATION & BENEFITS - $90k – $105k base salary + equity - Comprehensive healthcare, 401k matching, commuter benefits - 15 days PTO + holidays, unlimited sick days - Flexible leave options - Working late? We’ve got you covered with DoorDash and an Uber home