Throttling
Slowing down the rate of processing requests instead of rejecting them outright. The gentler cousin of rate limiting.
What is Throttling?
Slowing down the rate of processing requests instead of rejecting them outright. The gentler cousin of rate limiting.
Throttling is a intermediate-level concept that sits in the Security Architecture area of system design. Engineers reach for it whenever they need to reason about real-world trade-offs in that space — not just for textbook correctness, but because real production systems at companies like Netflix, Amazon, and Google make these decisions every day.
If you want to go deeper than this definition — with diagrams, code, and a quiz to lock it in — work through the "Throttling" lesson linked below. It walks through the why, the mechanism, the trade-offs, and how the giants actually use it in production.
Learn Throttling in depth
Full interactive lesson with diagrams, code examples, real-world references, and a quiz.
Open the Throttling lessonRelated lessons
Lessons that touch on Throttling as part of a larger topic.
Throttling
Slow down instead of shut down, degrade gracefully when your system is under pressure
intermediate · api design protocols
Rate Limiting
Protect your API from abuse and overload by controlling how many requests each consumer can make
intermediate · api design protocols
Token Bucket Algorithm
A bucket of tokens that refills at a steady rate, the most popular rate limiting algorithm in production
intermediate · api design protocols
See also
Related glossary terms you might want to look up next.
Rate Limiting
Controlling how many requests a client can make in a given time window. Protects your API from abuse and ensures fair usage.
API Gateway
A single entry point for all client requests that routes them to the appropriate microservice. Handles auth, rate limiting, and request transformation.
Bulkhead
A pattern that isolates different parts of a system so a failure in one part doesn't sink the whole ship. Named after the compartments in a ship's hull.