Principal Software Engineer, Experimentation

<div class="content-intro"><p><span style="font-weight: 400;">Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. </span></p> <p><span style="font-weight: 400;">At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device.</span><strong> </strong><span style="font-weight: 400;">We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. </span></p> <p><span style="font-weight: 400;">A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.</span></p></div><p><strong>About the role:</strong></p> <p>On the experimentation platform team, we are building an industry-leading platform and tools that allow other teams and our developers to run and automatically analyze experiments at scale. As the Principal Engineer on the team, you will lead the evolution and scaling of the experimentation platform. With over ~98 million daily users (and growing!) and hundreds of experiments every day, the platform already serves millions in QPS.</p> <p>We are looking for an experienced engineer that's passionate about designing and building scalable systems for both online serving and offline analysis which empower our creators and users alike with the benefits of experimentation. Our team's product will act as the interface between those defining experiments, calculating and tracking metrics, and finally, visualizing the results of experiments to ship a successful variant to our creators and users alike. Scale and ease-of-use is of the utmost importance as Roblox continues its development of our world class experimentation data platform.</p> <h3><strong>You Will:</strong></h3> <ul> <li>Help scale our online experiment serving flow to scale 10x.</li> <li>Design and simplify the experiment creation and analysis flows for the next generation of internal and external customers leveraging AI when necessary.</li> <li>Design a scalable serving model to support novel experimentation strategies (like crossovers, multi-armed bandits) and support our Data Science partners.</li> <li>Partner with our Data Engineering and Data Platform teams to build our experimentation data processing workflows.</li> <li>Partner with our customers all across Roblox and enable targeting experiments to audiences beyond our users - e.g. creators.</li> <li>Help build a reliable serving flow and a scalable data to support experimental analysis, gradual feature rollouts and human-centric reporting.</li> <li>Report into the Foundation AI Organization.</li> </ul> <h3><strong>You Have:</strong></h3> <ul> <li>Backend engineering experience with 10+ years of work experience.</li> <li>Solid programming skills in compiled languages such as C#, Go, C++, or others and knowledge of SQL.</li> <li>Designed and built backend platform systems that can handle over 1M QPS.</li> <li>Experience with big-data processing technologies such as Spark, Apache Druid, Flink etc. and exhibit a data-driven focus for quality metrics and monitoring.</li> <li>Knowledge with REST, API design patterns, and scalable containerized systems and micro-services.</li> <li>B.Sc. equivalent in CS or sufficient experience.</li> <li>Experience in building experimentation platforms serving millions of users in preferably multi-sided marketplaces (Bonus)</li> <li>Experience building and tuning Spark workflows at TB+ scale (Bonus)</li> <li>Experience leveraging AI tooling to build simplified, human-centric experiences for internal customers (Bonus)</li> </ul><div class="content-pay-transparen ... (truncated, view full listing at source)