How systems scale, from one server to many
How Systems Are Built
π»CLIENT
ClientβοΈLBnew
Load BalancerβοΈAPI
API ServerβοΈAPInew
API Server 2β‘CACHE
CacheποΈDB
Databaseπ¬QUEUE
Message QueueStep 2 of 4
Step 2: Adding a Load Balancer
Why
A single API Server becomes a bottleneck as traffic grows. When it goes down, the entire system goes down. You need redundancy and distribution.
What it does
The Load Balancer receives all incoming traffic and distributes it across multiple API Servers. It detects unhealthy servers and stops sending them traffic.
Impact
Traffic capacity scales linearly β add a server, add capacity. No single point of failure. You can deploy updates server-by-server without downtime.
Try it in Library β
Load Balancer
