Basic Framework
Breakdownsystem-designresearch-cardSystem Design

System Design Card 396 — Load Balancing / Breakdown

Load Balancing — BASIC step map

Concern

Load balancing keeps request distribution, horizontal scaling, and failure handling tractable. Ingress traffic to stateless API nodes usually scales better when the node pool can be expanded behind a balancer.

The interviewer can't score what they can't see.

What Breakdown means for this concern

In BASIC, the Breakdown step is where you clarify the product goal, workload shape, and non-functional requirement that will dominate the design. For Load Balancing, that means the candidate should make this concern visible at the right moment instead of bolting it on at the end.

Design move

A good move is to split the problem before trying to solve it. Tie the concern back to the user flow, the workload, and the dominant trade-off. That keeps the design grounded and makes it easier for the interviewer to follow why a cache, queue, replica, partition, or rate limiter is actually necessary.

Common miss

The miss is assuming horizontal scale without explaining how work is actually distributed. BASIC helps because the staged flow keeps this concern proportional to the prompt and connected to the rest of the architecture.

BASIC prompt

“When I reach the Breakdown stage, how does Load Balancing change the architecture, the trade-offs, or the review checklist?”

Experienced take
Engineers who do well in interviews spend more time here than you'd expect. The instinct to start solving immediately is strong, but the candidates who get offers consistently resist it. They name the problem shape, identify the tricky constraint, and only then pick a direction. It feels slow in the moment. It's not.

References

S9 S14 S15

Related in System Design

January 16, 2023

BASIC for system design interviews: the most reliable sequence for thinking at architecture scale

System design interviews are not just “bigger coding interviews.”

April 10, 2025

System Design Card 356 — Requirements Clarification / Breakdown

Every design starts with defining what must be true for the system to be considered successful. A notification system for security alerts is a different system from a marketing…

April 12, 2025

System Design Card 357 — Requirements Clarification / Assess

Every design starts with defining what must be true for the system to be considered successful. A notification system for security alerts is a different system from a marketing…