测试与验证负责人
Testing & Validation Lead
Blend 是一家领先的 AI 服务提供商,致力于通过数据科学、AI、技术和人才的力量,与客户共同创造有意义的影响。公司使命是激发大胆的愿景,通过无缝结合人类专业知识与人工智能,解决重大挑战。公司通过世界级的人才和数据驱动的战略,为客户解锁价值并推动创新。我们相信,人类与 AI 的力量可以对你的世界产生深远影响,为我们的员工和客户创造更有意义的工作和项目。更多信息,请访问 www.blend360.com。
Blend360 正在寻找一位高级经理,负责智能测量与验证,以管理展示大规模数据货币化项目价值和效果的端到端测试计划。该职位位于营销测量、数据科学和数据工程的交汇点,将复杂的测试和分析转化为清晰、可辩护的证据,帮助我们的合作伙伴理解该项目的影响。
你将负责整个测试生命周期——从定义方法论和设计测试,到执行、分析、文档编写,最终将结果转化为适合合作伙伴的洞察。你将领导针对历史活动数据的回测,匹配率和受众覆盖率测试,以及定制分析,用于评估提升效果、相关性、校准和其他智能质量指标。这是一个需要在深入分析细节的同时,也能退后一步把握大局、理解结果真正含义,并向技术及业务受众清晰传达发现成果的角色。
你将与我们的数据科学和数据工程团队密切合作,将测试设计转化为严谨的分析,并确保底层数据和方法经得起审查。同样重要的是,你将负责将这些分析转化为一个有说服力、可辩护的故事——能够与合作伙伴分享,并在内部用于展示项目的实际价值。
你将负责
· 负责端到端的测试和验证生命周期,包括方法论、测试设计、文档编写、执行、分析和汇报。
- 开发并维护回测、匹配率和受众覆盖率测试、提升/对照组测试以及其他验证方法的测试方法论。
- 领导测试设计的实施,确保测试方案符合高标准的分析要求。
查看英文原文
Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com.
Blend360 is looking for a Senior Manager, Intelligence Measurement & Validation to own the end-to-end testing program that demonstrates the value and effectiveness of a large-scale data monetization program. This role sits at the intersection of marketing measurement, data science, and data engineering, turning complex testing and analysis into clear, defensible evidence that helps our partners understand the impact of the program.
You’ll own the full testing lifecycle—from defining the methodology and designing the test, through execution, analysis, documentation, and ultimately translating the results into partner-ready insights. You’ll lead backtests against historical campaign data, match-rate and audience coverage testing, and custom analyses designed to evaluate lift, correlation, calibration, and other measures of intelligence quality. This is a role for someone who is comfortable getting into the details of the analysis while also stepping back to understand the bigger picture, identify what the results actually mean, and communicate those findings clearly to both technical and business audiences.
You’ll work closely with our Data Science and Data Engineering teams to translate test designs into rigorous analyses and ensure the underlying data and methodology stand up to scrutiny. Just as importantly, you’ll be responsible for turning those analyses into a compelling, defensible story—one that can be shared with partners and used internally to demonstrate the value of the program.
What You’ll Do
· Own the end-to-end testing and validation lifecycle, including methodology, test design, documentation, execution, analysis, and readouts.
- Develop and maintain testing methodologies for backtesting, match-rate and audience coverage testing, lift/holdout testing, and other validation approaches.
- Lead the development of automation for testing methodologies in order to scale frequency of testing and improved consistency
- Run tests and ad-hoc analyses within clean rooms, but owned and operated clean room and partner clean rooms
- Run backtests that validate program intelligence against partners’ historical campaign and audience data.
- Design and execute match tests to measure household match rates, audience coverage, and data quality.
- Develop custom partner analyses, including correlation, lift, calibration, and other measurement approaches based on specific business questions.
- Partner closely with Data Science and Data Engineering to translate test designs into executable analyses and ensure results are methodologically sound.
- Analyze results and determine what the data can—and cannot—support, developing defensible conclusions and clear recommendations for next steps.
- Translate complex analytical findings into concise, compelling partner-facing presentations and internal executive readouts.
- Build and maintain clear documentation of testing methodologies, assumptions, processes, and results.
- Identify opportunities to improve the testing framework, increase repeatability, and strengthen the evidence supporting the program's intelligence value proposition.
- Serve as a subject-matter expert and thought partner across Marketing Measurement, Data Science, and Data Engineering.
- 5–7+ years of relevant experience in marketing measurement, media analytics, campaign measurement, attribution, data science, or a related analytical discipline.
- Strong experience designing and executing testing and measurement methodologies, particularly backtesting, match-rate/audience coverage analysis, lift, and holdout testing.
- Experience working within clean rooms for marketing analysis, measurement, and modeling activities
- A solid understanding of marketing and media measurement and how campaign and audience data can be used to validate intelligence and demonstrate value.
- Hands-on experience working with data and executing analyses—not simply defining requirements or reviewing someone else’s work.
- Strong analytical judgment and the ability to distinguish between what the data demonstrates and what it does not.
- Experience working cross-functionally with Data Science and Data Engineering teams.
- The ability to take an ambiguous business question, create structure around it, determine the right testing approach, and drive it through to an answer.
- Strong communication skills, with the ability to turn complex analytical results into clear, partner-ready stories.
- Excellent documentation and project management skills, with a high degree of ownership and attention to detail.
- A get-it-done mentality and the ability to manage multiple analyses and partner requests while maintaining rigor and quality.
- The Blend360 Difference
- At Blend360, we bring together data, AI, technology, and marketing to solve meaningful business problems for some of the world’s leading organizations. You’ll have the opportunity to work alongside talented data scientists, engineers, marketers, and strategists while helping prove the value of an intelligence platform at the heart of how our partners make decisions.
- If you’re someone who loves figuring out “How do we prove this?”, can bring rigor to the methodology without losing sight of the business question, and knows how to turn data into a story people can act on, we’d love to meet you.
The starting pay range for this role is $140,000 - $240,000. Actual compensation within the range will be dependent on several factors including but not limited to relevant experience, skills, certifications, training, and location. It is not typical for an individual to be hired at or near the top of the range and determining factors for compensation are considered for each individual circumstance. BLEND360 also offers a competitive benefits program to meet the health and financial well-being of our team and their families. You can look forward to a range of benefits including medical, dental, vision, 401K, PTO, paid holidays, commuter benefits, spending accounts, life insurance, disability coverage, and EAPs.