We use analytics cookies.We use cookies to analyze site traffic and improve your experience.
Loading...
System Design Masterclass · Observability Monitoring
Free preview: the first 2 parts of this 9-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
System Design Masterclass
Unlock this lesson and the 751 other paid lessons
$25 once, by PayPal
See the System Design courseread the rest of this lesson in
System Design Masterclass
Unlock this lesson and the 751 other paid lessons
$25 once, by PayPal
See the System Design coursein Observability Monitoring
This lesson is part of the full System Design Masterclass. Unlock it along with 769 other lessons for a one-time payment.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime Access18 Foundation lessons are free, no payment needed. Try them now
It is easy and good
“It is really nice and good Please join the course”
An engineering team was in constant conflict. Product managers pushed for faster feature development. SRE engineers pushed for more stability work. Every sprint planning devolved into an argument about priorities. Both sides had valid points. Neither had data.
Then they adopted error budgets. The SLO was 99.9%, giving them 43.8 minutes of allowed downtime per month. In January, they used 10 minutes. Error budget healthy. Product wins, ship features aggressively. In February, a bad deployment burned 35 minutes by day 12. Error budget nearly exhausted. SRE wins, freeze deployments, focus on stability.
The arguments stopped. Not because people changed their minds, but because the decision was no longer subjective. The error budget provided an objective, data-driven framework for balancing speed and reliability. When the budget is healthy, move fast. When it's depleted, slow down. No opinions needed.
The error budget is the inverse of your SLO, the amount of unreliability you've agreed to tolerate.
Calculation:
Error budget consumption happens through:
Tracking error budget over time:
| Day | Incidents | Budget Used | Budget Remaining |
|---|---|---|---|
| 1-5 | None | 0 min | 43.2 min (100%) |
| 6 | Deploy failure, 8 min outage | 8 min | 35.2 min (81%) |
| 7-15 | None | 0 min | 35.2 min (81%) |
| 16 | DB connection issue, 12 min | 12 min | 23.2 min (54%) |
| 17-30 | None | 0 min | 23.2 min (54%) |
This team ended the month at 54% remaining, comfortable, but the two incidents used almost half the budget. If another incident of similar size had occurred, they'd have been close to breaching the SLO.