Systems & Backend

Sharding

Splitting data across many machines so no single node holds — or bottlenecks on — all of it.

Sharding partitions a dataset by a shard key across nodes so reads and writes spread out and capacity scales horizontally. The hard parts are choosing a key that avoids hotspots and rebalancing as the cluster changes — where consistent hashing helps.