Basic Framework
Structuresystem-designresearch-cardSystem Design

System Design Card 393 — Caching / Structure

Caching — BASIC step map

Concern

Caching can remove load from the hot path, but only if keys, invalidation, and staleness are acceptable. Caching short-link lookups or popular feed fragments can change capacity needs dramatically.

The interviewer can't score what they can't see.

What Structure means for this concern

In BASIC, the Structure step is where you turn the chosen trade-offs into a clear high-level architecture and request flow. For Caching, that means the candidate should make this concern visible at the right moment instead of bolting it on at the end.

Design move

A good move is to make the plan visible before full execution. Tie the concern back to the user flow, the workload, and the dominant trade-off. That keeps the design grounded and makes it easier for the interviewer to follow why a cache, queue, replica, partition, or rate limiter is actually necessary.

Common miss

The miss is adding a cache as decoration without clarifying what is cached and how it expires. BASIC helps because the staged flow keeps this concern proportional to the prompt and connected to the rest of the architecture.

BASIC prompt

“When I reach the Structure stage, how does Caching change the architecture, the trade-offs, or the review checklist?”

Engineering insight
Structure is where you convert thinking into a plan someone else could follow. In coding interviews, that means the algorithm's skeleton — the invariant, the loop structure, the recursive contract. In system design, it's the component diagram with clear data flow. The test: could a teammate build from your description alone?

References

S9 S14 S15

Related in System Design

January 16, 2023

BASIC for system design interviews: the most reliable sequence for thinking at architecture scale

System design interviews are not just “bigger coding interviews.”

April 10, 2025

System Design Card 356 — Requirements Clarification / Breakdown

Every design starts with defining what must be true for the system to be considered successful. A notification system for security alerts is a different system from a marketing…

April 12, 2025

System Design Card 357 — Requirements Clarification / Assess

Every design starts with defining what must be true for the system to be considered successful. A notification system for security alerts is a different system from a marketing…