πŸ’¬
βœ‰οΈ
πŸ“Έ
▢️

Loading…

How systems scale, from one server to many

How Systems Are Built
requestrouteroutequeryquery
πŸ’»CLIENT
Client
βš–οΈLBnew
Load Balancer
βš™οΈAPI
API Server
βš™οΈAPInew
API Server 2
⚑CACHE
Cache
πŸ—„οΈDB
Database
πŸ“¬QUEUE
Message Queue

Step 2 of 4

Step 2: Adding a Load Balancer

Why

A single API Server becomes a bottleneck as traffic grows. When it goes down, the entire system goes down. You need redundancy and distribution.

What it does

The Load Balancer receives all incoming traffic and distributes it across multiple API Servers. It detects unhealthy servers and stops sending them traffic.

Impact

Traffic capacity scales linearly β€” add a server, add capacity. No single point of failure. You can deploy updates server-by-server without downtime.

Try it in Library β†’

Load Balancer

β†—