Primary Metric and Guardrail Metric

A primary metric expresses the improvement a decision is chiefly trying to achieve. Guardrail metrics track outcomes that must remain acceptable while pursuing it. These roles are chosen for a particular decision; a metric can be primary in one project and a guardrail in another.

For an invoice assistant, the primary metric could be mean clerk handling minutes per eligible completed case. Packet errors, unauthorized disclosures, and receiving-team work are separate guardrails. A fast response does not compensate for exposing another branch’s records.

Define each metric’s population, calculation, observation window, limit, and consequence before examining trial results. Missing quality records should not be treated as no errors. An observed guardrail breach may require stopping the trial, revising the proposal, or withholding a success decision, depending on the agreed rule.

Passing measured guardrails in a small sample is not proof of zero production risk. Keep uncertainty visible and assess the primary outcome and guardrails together instead of hiding a failed condition inside an average score.

Related reference: GOV.UK service measurement guidance. Examples and calculations here are illustrative.