Riskiest Assumption

A riskiest assumption is a belief whose uncertainty and consequences make it a priority to test before committing more resources. A team compares important assumptions rather than expecting one belief to be both the most damaging if false and the least certain. Dependencies, test cost, and the value of learning affect the order. The UK Service Manual recommends identifying and testing risky assumptions during alpha with prototypes sufficient for learning; they need not be production-quality implementations.

The manual’s illustration is a voter-registration service whose team realized it would need an interface to the systems of more than four hundred local councils; if that had not been possible the service would not have worked, so that is what the alpha tested. The assumption was not whether a registration form could be built. It was whether the thing the form depended on could exist.

Choose the uncertainty the next decision depends on

In data and AI work, uncertainty may concern model performance, harmful errors, lawful access, repeatable delivery, user adoption, or downstream integration. Existing labels and a production interface are not prerequisites for every experiment: a lawful snapshot can support an offline test, and label acquisition or integration can be the experiment itself. A fictional bank learns that excellent classification accuracy on a manually extracted sample does not establish repeatable mail delivery. It tests that dependency alongside error costs before limited operation. Compare the consequences of being wrong, the evidence already available, and what each affordable test could change. Reorder the work when new evidence appears. A failed implementation assumption may rule out that design without invalidating the whole value hypothesis. Use pilot exit criteria to define the next decision, including when further learning is worth its cost. Fourteen Pilots and Nothing in Production places these choices within a data and AI strategy.

References:

• GOV.UK Service Manual, How the alpha phase works