Handbooks  /  AI-Assisted Interviews
Handbook~13 min readCareerworked math + runnable code
Handbook

AI-assisted
interviews.

For a decade the technical interview banned the very tool you'd use every day on the job. That's ending. In the 2026 loop, an AI assistant is allowed in the room — which quietly changes the whole exam. When the model can write the algorithm, the interview stops asking "can you produce this?" and starts asking "can you work with AI to ship something correct?" The skill under the microscope moves from writing code to reviewing it — and that's a different muscle.

01

The format flip: from banning AI to expecting it

The old contract was simple and increasingly fake: sit in a room, no tools, reproduce an algorithm from memory. Then the job changed — engineers now spend the day directing AI — and the interview lagged behind, testing a skill (from-scratch recall) that the job no longer prizes. The correction is the AI-assisted interview: bring the assistant, use it openly, and be judged on how well you do so.

This isn't a small tweak; it's a change of subject. A candidate who memorized a hundred LeetCode patterns and one who can steer and audit a model are now being measured on different axes. The rest of this handbook is what those axes are, and the one bit of math that explains why they matter.

02

What it now measures

Three capabilities the old format couldn't isolate:

SkillThe round that tests it
Code comprehensionDropped into an unfamiliar codebase, find and fix a bug — reading beats writing.
AI fluencyPrompt, steer, and critically review the model's output rather than accept it.
JudgmentDecide what to build and how to verify it — including eval-design rounds at frontier labs.

Notice the through-line: every one is about working with code you didn't write from scratch — the AI's code, a stranger's codebase, an output you have to trust or reject. The interview has become a test of judgment under assistance, not production under constraint. And the load-bearing skill in all three is the ability to catch what's wrong.

03

The math: why review, not generation, is scored

Here's the one model that explains the shift. Suppose the AI produces a correct solution with probability p. A human reviewing on top contributes two things: they catch some of the AI's errors (fixing wrong answers), and they occasionally break a correct answer by "fixing" what was already right. Final correctness is:

final = p·(1 − pfalsepos)  +  (1 − p)·pcatch

AI right and not broken by the human, plus AI wrong but caught and fixed. The human's whole value lives in pcatch and pfalsepos — pure review skill.

And the punchline the interview is built around: a skilled reviewer lifts final correctness above the AI's alone, while a poor one — who breaks correct code and catches little — drags it below what the AI would have produced untouched. An unskilled AI user is net-negative. That's exactly what an AI-fluency rubric is trying to detect, and the runnable model below makes it vivid.

skilled reviewer: catches AI errors, rarely breaks good code → final > raw AI
unskilled reviewer: misses errors, "fixes" correct code → final < raw AI (worse than not touching it)
04

The new rounds you'll see

The format is still settling, but a recognizable set of rounds has emerged:

  • AI-pairing round. Solve a real task with the assistant on. Assessed on how you prompt, when you push back, and whether you verify — not just whether it compiles.
  • Code-comprehension round. Navigate a multi-function codebase you've never seen and locate the bug. Direct prep for real work; see the sibling code-comprehension challenges.
  • Eval-design round. Frontier labs increasingly ask: design a test that would catch a subtle failure. Because verifying AI output is now the job, they interview for it.
  • Review round. Given AI-generated code with planted defects, find them. This is the review-skill math above, run as an exercise.

Every one rewards the same core: read fast, reason about correctness, and don't trust output you haven't verified. The tools change; the judgment is the point.

05

How to prepare

Prepare differently than for a classic algorithms loop. The interview-prep and system-design handbooks still teach the content you need to reason about — that hasn't gone away. This format tests how well you apply it alongside a model, so add three practices the old grind skipped:

  1. Practice reading, not just writing. Pull unfamiliar repos and race to find the bug. Comprehension speed is now a scored skill.
  2. Practice directing and auditing AI. Give precise prompts, then review the output like an adversary — the habit of agentic coding done well.
  3. Practice writing tests that catch subtle failures. Eval design is a differentiator; a good verifier is worth more than a fast solution.
The bottom line

The interview finally matches the job. Your edge isn't recalling an algorithm the model already knows — it's being the reviewer who reliably catches what the model gets wrong. Train the catch rate; that's the number being scored.

RUN IT YOURSELF

When does a reviewer add value — and when do they subtract it?

The AI-fluency rubric is really one equation. The AI is correct with probability p; a human reviewing on top catches a fraction of its errors (p_catch) but sometimes breaks a correct answer (p_falsepos). Watch a skilled reviewer push final correctness above the AI's own, a null reviewer leave it unchanged, and a harmful reviewer drag it below — the exact signal an interviewer is looking for. Change the AI's baseline and the reviewer's skill.

CPython · WebAssembly
Frequently asked

Quick answers

What is an AI-assisted interview?

A technical interview where using an AI assistant is allowed, even expected. Since the AI can write the code, the exam shifts from writing algorithms from memory to working with AI well — comprehension, direction, and review.

What does it measure?

Code comprehension (find a bug in unfamiliar code), AI fluency (prompt, steer, critically review output), and judgment (what to build, how to verify) — plus eval-design rounds at some frontier labs.

Why is review the scored skill?

When the AI drafts the code, your contribution is catching its errors without breaking what it got right. final = p·(1−p_falsepos) + (1−p)·p_catch — a skilled reviewer beats raw AI, a careless one does worse.

How do I prepare?

Practice reading code and finding bugs fast, directing and auditing AI output, and writing tests that catch subtle failures. Content handbooks still teach the substance; this format tests how you apply it with a model.

Finished this one? 0 / 169 Handbooks done

Explore the topic

See this alongside everything else on the same subject — handbooks, system designs, challenges and tools, in one place.