Understands what we need to learn. Can effectively run a beta and gather learnings. Shares learnings with immediate team. Needs support to define actions emerging from learnings.

Defines what we need to learn and the best way to learn that. Consistently runs efficient and effective betas. Gets teams to quickly adapt to results, both quant and qual. Consistently creates close-out reports, shares them with the team, and makes decisions based on them.

Creative at figuring out quicker ways to learn faster. Particularly strong at exposing hidden assumptions and product risks. Uses hypotheses to focus a team on what and how to run a beta (or equivalent). Actively shares relevant learnings across teams and with product leadership.

Applies this skill to most ambiguous and complex problem areas. Able to think coherently across multiple teams work to define what we need to learn and how best to learn it.