Quality Operations Lead

The future of AI — whether in training or evaluation, classical ML or agentic workflows — starts with high-quality data. At HumanSignal, we’re building the platform that powers the creation, curation, and evaluation of that data. From fine-tuning foundation models to validating agent behaviors in production, our tools are used by leading AI teams to ensure models are grounded in real-world signal, not noise. Our open-source product, Label Studio , has become the de facto standard for labeling and evaluating data across modalities — from text and images to time series and agents-in-environments. With over 250,000 users and hundreds of millions of labeled samples, it’s the most widely adopted OSS solution for teams working on building AI systems. Label Studio Enterprise builds on that traction with the security, collaboration, and scalability features needed to support mission-critical AI pipelines — powering everything from model training datasets to eval test sets to continuous feedback loops.We started before foundation models were mainstream, and we’re doubling down now that AI is eating the world. If you're excited to help leading AI teams build smarter, more accurate systems — we’d love to talk. HumanSignal is seeking a Quality Control Lead to ensure world-class data quality across our Label Studio platform and Data Creation Laboratory operations. In this role, you will be the ultimate authority on the integrity and usefulness of the data we manufacture and deliver to customers. You will drive accountability across our highest-impact projects—tackling complex quality challenges head-on while leading strategic initiatives that enable reliable, scalable delivery as we grow. Our Data Creation Laboratories don't just label existing data—we manufacture purpose-built datasets from scratch in controlled environments. This means quality control takes on new dimensions: you're not just checking annotations, you're ensuring that the human-generated data we create meets the exacting standards required by frontier AI labs and enterprises pushing the boundaries of what's possible. You Will: Build and lead a high-performing team of quality control specialists who set the standard for data excellence Collaborate with delivery teams and laboratory operations to interpret, refine, and exceed customer requirements Manage day-to-day operations including workload planning, resource allocation, and performance reporting Design and implement scalable quality frameworks and best practices that grow with the organization Champion initiatives that drive improvements in quality, operational efficiency, and customer satisfaction Serve as the ultimate standard-bearer for data quality, ensuring HumanSignal is recognized as the most trusted source of training data in AI Ideally You'd Have: Bachelor's degree in Computer Science, Engineering, Operations, or a related discipline 4+ years of experience leading teams or scaling complex operational or technical processes Strong analytical capabilities and problem-solving skills, with proficiency in SQL and meticulous attention to detail Demonstrated experience building systems, processes, and teams across diverse customer segments or product offerings Hands-on background in operations management, product management, or management consulting at a top-tier firm Track record of taking initiative and driving results in cross-functional technical environments Nice to Haves: Master's degree in Computer Science, Engineering, Operations, or a related field Experience in AI/ML data operations or services Background working in high-growth, dynamic startup environments Experience building and scaling teams from the ground up About HumanSignal At HumanSignal, we're building the infrastructure for the next generation of AI. Our Label Studio platform powers data operations for leading organizations worldwide, while our Data Creation Laboratories manufacture the purpose-built datasets that bre ... (truncated, view full listing at source)