Load Shedding
Load shedding rejects some requests cheaply so the rest can succeed — because serving 70 percent well beats failing slowly at all of it.
Load shedding rejects some requests cheaply so the rest can succeed — because serving 70 percent well beats failing slowly at all of it.
Exponential backoff increases the wait between retries so a struggling service is not hit harder as it fails — but alone it leaves clients in lockstep.
A cascading failure spreads because each response to overload adds load elsewhere — which is why the system can stay down after the trigger is removed.