Concepts course · AI engineering

Become an AI engineer.

Not a prompt wizard — an engineer. This course builds the mental models the job actually runs on: how memory and context really work, how embeddings power search, how tools turn a model into an agent, why it hallucinates and how to ground it, why the glue around the model is the product, and how to evaluate, deploy, monitor and secure the whole thing. Nine short episodes, each embedded here with a hands-on companion and the deeper reference.

9 episodes ~2 hours Concepts / mental models Free · no sign-up
Your progress0 / 9 complete

What you'll understand

By the end you'll carry the working mental models a shipping AI engineer relies on: why an AI "forgets," what an embedding really is, when an agent beats a single call, why grounding is non-negotiable, why most of the work is the glue and not the model, how to turn "it feels better" into a measured score, how to run and watch a model in production, and how a stranger's text can hijack your bot. Every episode points to a lab or tool so you can go from watching to doing.

Context windowsMemoryEmbeddingsVector searchTools / agentsGroundingPipelinesEvalsDeploy + monitoringPrompt-injection defense
The curriculum

Nine episodes, in order

01
Episode 1 · Context & Memory

How ChatGPT "Remembers" You (It Doesn't)

An AI has zero memory between calls. The context window is a fixed desk that gets re-fed on every single request — so "remembering" is really re-sending. Once you see the desk, you understand why apps forget, why long chats get expensive, and why things get lost in the middle.

What you'll learn
  • Why the model is stateless between calls
  • The context window as a re-fed desk
  • Overflow, cost, and "lost in the middle"
02
Episode 2 · Embeddings & Vector Search

Why AI Turns Every Word Into an Arrow

Embeddings turn text into arrows whose direction is meaning, so search stops being about matching words and becomes finding the nearest arrows by angle. This is the retrieval engine under RAG and every "search by meaning" feature you've used.

What you'll learn
  • Meaning as a direction in vector space
  • Cosine similarity / nearest neighbors
  • Why keyword search quietly misses
03
Episode 3 · Tools & Agents

How AI Agents Actually Get Things Done

The model can only talk; tools give it hands. Function calling is the handshake — the model asks, your code acts, the result comes back. Wrap that in a think-act-observe loop and a chatbot becomes an agent that can look things up, call APIs, and chain steps.

What you'll learn
  • Function calling as a handshake
  • The think → act → observe loop
  • When an agent beats a single call
04
Episode 4 · Hallucination & Grounding

Why AI Confidently Makes Things Up

The model predicts plausible words, not true ones, so it will invent a confident, well-formatted fiction. Grounding it in a real retrieved source turns guessing into quoting — and groundedness evals are how you keep it honest at scale.

What you'll learn
  • Why fluency isn't truth
  • Grounding answers in retrieved context
  • Measuring faithfulness
05
Episode 5 · The Glue

Your First LLM App Isn't the Model

The model is one box in a pipeline. The glue around it — prompt templates, retries, validation, caching, streaming, logging, evals — is the actual product, and it's where most of the engineering effort lives. Master the glue and you can ship on any model.

What you'll learn
  • The model as one component
  • Templates, retries, validation, caching
  • Why the glue is the differentiator
06
Episode 6 · Evals

Stop Shipping LLM Apps on Vibes

"It feels better" isn't a release criterion. Turn quality into a score: a golden test set, exact and rule-based graders for structured output, and LLM-as-a-judge for open-ended answers — calibrate the judge, then track the trend so a regression can't sneak past you.

What you'll learn
  • Building a golden set
  • Rule graders vs LLM-as-judge
  • Calibrating and tracking the score
07
Episode 7 · Deploy & Monitor

Shipping Is the Start, Not the Finish

Run production off a live dashboard: version your prompts, canary a change with one-click rollback, log and trace every call, and plan for drift — because the model can update underneath you and quietly change your outputs with zero code changes.

What you'll learn
  • Prompt versioning + canary + rollback
  • Tracing and observability for LLM apps
  • Catching silent model drift
08
Episode 8 · Security

How a Stranger Can Hijack Your AI Bot

The model sees your rules, the user message, and any fetched data as one undifferentiated stream — so it can't tell your instructions from an attacker's note buried in a web page. The defense isn't a smarter prompt; it's least-privilege tools and a small blast radius.

What you'll learn
  • Why injection works (one stream, no trust)
  • The lethal-trifecta risk
  • Least-privilege tools + blast-radius control
09
Episode 9 · Finale

What Actually Makes Someone an AI Engineer

Step back and see the whole craft at once. It was never prompt-wizardry — it's assembling context, retrieval, tools, grounding, evals, deployment and security into a system that holds up. Here's where the role sits, and where to go next.

What you'll learn
  • The full craft, end to end
  • What separates a demo from a product
  • Your next steps as an AI engineer

Got the mental models? Build with them.

You've got the concepts an AI engineer runs on. The natural next step is a hands-on build that puts them together — and the roadmap that frames the whole path.