We use analytics cookies.We use cookies to analyze site traffic and improve your experience.
Loading...
System Design Masterclass · Cloud Infrastructure
Free preview: the first 2 parts of this 7-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
System Design Masterclass
Unlock this lesson and the 751 other paid lessons
$25 once, by PayPal
See the System Design courseread the rest of this lesson in
System Design Masterclass
Unlock this lesson and the 751 other paid lessons
$25 once, by PayPal
See the System Design coursein Cloud Infrastructure
This lesson is part of the full System Design Masterclass. Unlock it along with 769 other lessons for a one-time payment.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime Access18 Foundation lessons are free, no payment needed. Try them now
A self-driving car processes 1 TB of sensor data per hour. It needs to make collision-avoidance decisions in under 10 milliseconds. Sending that data to a cloud data center 500 miles away, processing it, and sending the response back takes 50-100ms at minimum, just from the speed of light in fiber. By then, the car has traveled 3 feet at highway speed. That is too slow. People die.
An AR headset renders overlay graphics that must align perfectly with the physical world. Any perceivable , even 20ms, causes motion sickness. Apple's Vision Pro processes most spatial tracking locally on the M2 chip for exactly this reason. The cloud is 30-100ms away. The human brain notices mismatches above 7ms for visual-vestibular sync.
A factory robotic arm inspects parts at 60 frames per second on a production line. Each frame needs quality-control analysis and a pass/fail decision within 16ms (the time between frames). A round trip to the cloud takes longer than the gap between frames. By the time you get one answer, you have missed three parts.
Edge computing moves computation out of centralized data centers and closer to where data is generated. The destination varies: regional points of presence, 5G cell towers, on-premises servers, or the devices themselves. The goal is latency below what physics allows with centralized cloud, and local processing when to the cloud is too expensive or too scarce.
"Edge" is not a single location. It is a spectrum of how close to the user computation happens:
| Location | Processing Power | Examples | |
|---|---|---|---|
| On-device | <1ms | Limited (mobile GPU, NPU) | Smartphone ML inference, browser WASM, Vision Pro spatial tracking |
| On-premises | 1-5ms | Moderate (server-grade) | Factory floor servers, retail store gateways, hospital PACS |
| Cell tower / 5G MEC | 5-10ms | Moderate | AWS Wavelength, Azure Edge Zones, Verizon MEC |
| Regional PoP | 10-30ms | Limited (JS/WASM runtime) | CloudFront Functions, Cloudflare Workers, Vercel Edge Functions |
| Cloud region | 30-100ms+ | Unlimited | EC2, Lambda, Cloud Run, GKE |
Each step down the spectrum trades processing power for lower latency. The trick is putting the right computation at the right layer.
Cloud edge services you can use today:
| Service | Provider | Runtime | Cold Start | Edge Locations |
|---|---|---|---|---|
| CloudFront Functions | AWS | JavaScript (limited) | <1ms | 400+ CloudFront PoPs |
| Lambda@Edge | AWS | Node.js, Python | 5-50ms | 200+ CloudFront PoPs |
| Cloudflare Workers | Cloudflare | V8 isolates (JS/WASM) | <1ms | 300+ cities |
| Vercel Edge Functions | Vercel | Web API runtime | <5ms | 30+ Vercel PoPs |
| Fastly Compute | Fastly | WASM | <1ms | 90+ PoPs |
| Deno Deploy |
Cloudflare Workers handles over 10 million requests per second across their network. Vercel runs Next.js middleware at the edge for every request to sites like Notion, Loom, and Washington Post.
It is easy and good
“It is really nice and good Please join the course”
| Deno |
| V8 isolates |
| <5ms |
| 35+ regions |