Partial Failure, Timeouts, and Retries
A timeout says the caller stopped waiting, not what the remote work did. See how partial failure, retry storms, and duplicates arise, and which defenses help.
A timeout says the caller stopped waiting, not what the remote work did. See how partial failure, retry storms, and duplicates arise, and which defenses help.
Some parts fail while others keep working, and a caller often cannot tell a lost request from a lost reply. That ambiguity is what makes it hard.
A model API call can fail in transport, be rejected, return unusable text, or return valid JSON that is wrong. Define what each outcome does to your application.
Deadline propagation gives downstream calls the time remaining from the original request budget, replacing unrelated per-layer timeouts.
Trace network and storage delays, handle uncertain writes safely, and verify a download before making it visible.
Diagnose a timeout by its step: DNS answers and caching, certificate verification, routing, load balancing, retry amplification, deadlines and packet-level evidence.