Finished this one? 0 / 12 Labs done
Explore the topic
See this alongside everything else on the same subject — handbooks, system designs, challenges and tools, in one place.
More Labs
- Gradient Descent: The DescentDon't read about gradient descent — play it. Roll a ball into the valley of a loss landscape by hand and waste steps, then let the algorithm read the slope and step downhill on its own. Crank the learning rate until it overshoots and explodes, dial it down until it crawls, then switch on momentum to escape a local minimum. Four acts — descend it, follow the gradient, tune the learning rate, escape the trap.Read →
- The TokenizerA language model can't read words — it reads tokens. Watch your text shatter into sub-word chunks, race character vs word vs sub-word tokenizers head-to-head, then build Byte-Pair Encoding by hand: merge the most frequent pair over and over to grow a vocabulary and shrink the sequence. Five acts — shatter it, race three tokenizers, build BPE, tune the vocab size, and feel why 'strawberry' trips up an LLM.Read →
- The Dice Loader: SamplingDon't read about temperature, top-k, and top-p — drive them. A language model turns logits into a probability over the next token, then rolls; three dials load those dice. Slide temperature to sharpen or flatten the odds, clamp the tail with top-k or top-p, and watch the bar chart renormalize live — then hit Sample and roll. See exactly why an LLM sounds robotic at low temperature and unhinged at high.Read →
- The Gravity Wells: K-MeansDon't read about k-means — watch the clusters form. Drop three centroids into a cloud of thirty unlabeled points, then run two moves on repeat: assign every point to its nearest centroid, then slide each centroid to the mean of its crowd. Watch the mess snap into clean groups and the inertia drop each round. Unsupervised clustering, made playable, with theory, a runnable challenge and a quiz.Read →
- The Sliding Stencil: ConvolutionDon't read about convolution — slide the stencil yourself. A 3×3 kernel glides over an image and, at each spot, multiplies the pixels underneath by its weights and sums them into one output pixel. Swap kernels — identity, edge-detect, blur, sharpen, emboss, Sobel — and watch the same image become edges, or blur, or sharpened. The single operation inside every CNN, made playable, with theory, a runnable challenge and a quiz.Read →
- The Spotlight: AttentionDon't read about attention — shine the spotlight yourself. In a Transformer, every word looks at every other word and weights how much to listen to each. Click a word to see where its attention goes — the verb leaning on its subject, the determiner pointing at its noun — as glowing links and a heatmap whose weights sum to one. Self-attention (the softmax(QKᵀ) heart of every LLM), made playable, with theory and a quiz.Read →