Latency Budget
Step percentiles do not add to an end-to-end percentile. A useful budget reserves fallback time and tests the complete request path under load.
-
-
Response Latency
Measure response latency with a clear boundary and distinguish it from model time, throughput, and data freshness.