Senior Manager Experimentation, Testing, & Learning

<p>The Senior Manager, Experimentation, Testing, &amp; Learning owns the quarterly experimentation roadmap and learning agenda that drives measurable improvements in buying group progression. This role runs end-to-end test governance across buying group experience, ensuring tests are designed well, implemented correctly, measured cleanly, and translated into clear scale or stop decisions.&#xa0;</p><p><strong>What you will own&#xa0;</strong></p><ul><li><p>Quarterly experimentation roadmap, learning agenda, and test portfolio aligned to brand, events, and integrated program goals with emphasis on buying group progression.&#xa0;</p></li></ul><ul><li><p>Test intake, prioritization, design standards, and readout templates used across teams.&#xa0;</p></li></ul><ul><li><p>Scaling criteria and playbooks for rolling out tests that show measurable lift.&#xa0;</p></li></ul><ul><li><p>Governance for experimentation processes, including decision rules and documentation standards.&#xa0;</p></li></ul><p><strong>Responsibilities&#xa0;</strong></p><ul><li><p>Own and evolve the quarterly experimentation roadmap and learning agenda, aligned to brand, events, and integrated program goals with emphasis on buying group progression.&#xa0;</p></li></ul><ul><li><p>Manage test intake and prioritization using clear criteria,&#xa0;expected impact, feasibility, time-to-learn, and cross-channel applicability,&#xa0;maintaining&#xa0;balanced coverage across paid, owned, site, and creative.&#xa0;</p></li></ul><ul><li><p>Define and&#xa0;maintain&#xa0;test design standards: hypotheses, primary and secondary KPIs, success thresholds, guardrails, and decision rules.&#xa0;</p></li></ul><ul><li><p>Partner with Measurement to define&#xa0;incrementality&#xa0;approaches,&#xa0;holdouts, lift studies, geo tests, platform experiments&#xa0;and&#xa0;standardize efficiency metrics.&#xa0;</p></li></ul><ul><li><p>Partner with agency and platform teams to ensure clean implementation, consistent exposure rules, and strong QA across channels.&#xa0;</p></li></ul><ul><li><p>Coordinate with DX on site and landing page tests, including experimentation tooling, tagging, data layer dependencies, and conversion-path measurement.&#xa0;</p></li></ul><ul><li><p>Partner with creative and agency teams to structure creative tests (message, offer, asset variants) with clear learning&#xa0;objectives&#xa0;and measurement plans.&#xa0;</p></li></ul><ul><li><p>Standardize how results are reported — readout templates that clearly summarize lift, confidence, segment impacts, tradeoffs, and recommended decisions.&#xa0;</p></li></ul><ul><li><p>Lead quarterly readouts that drive decisions to scale, stop, iterate, or retest, with documented rationale.&#xa0;</p></li></ul><ul><li><p>Maintain scaling criteria and update global playbooks when tests show measurable lift and repeatability.&#xa0;</p></li></ul><p>&#xa0;</p> <ul><li>7+ years in growth marketing, performance marketing, experimentation, analytics, or marketing operations with ownership of cross-channel testing programs and&#xa0;a track record&#xa0;of turning test results into strategic decisions.&#xa0;</li></ul><p><strong>Hard Skills&#xa0;</strong></p><ul><li><p>Experimentation Design: A/B, multivariate, holdouts, lift studies, geo&#xa0;experiments&#xa0;and&#xa0;common design pitfalls to avoid&#xa0;</p></li></ul><ul><li><p>Cross-Channel Testing: paid media (programmatic, search, social), owned channels, site experience, and creative&#xa0;</p></li></ul><ul><li><p>Measurement Partnership: incrementality design, impact evaluation, and efficiency metric standardization&#xa0;</p></li></ul><ul><li><p>Agency &amp; Platform Execution: clean test setup, QA, trafficking, and consistent measurement across partners&#xa0;</p></li></ul><ul><li><p>Reporting &amp; Decision Frameworks: standardized readouts that drive repeatable scaling decisions&#xa0;</p></li></ul><p><strong>Soft Skills (Leadership Competencies)&#xa0;</strong></p><ul><li><p>Strategic Vision: abl ... (truncated, view full listing at source)