Paper Breakdowns  /  ReAct
Paper 06~7 min readICLR 2023
Paper Breakdown

ReAct,
explained.

A model that only reasons is a brilliant thinker locked in a windowless room — it can deduce beautifully but can't check a single fact against the world. This 2022 paper cut a door into that room: let the model think, step outside to look something up, come back with what it found, and think again. That simple loop is the blueprint for every AI agent.

Video breakdown
The animated walkthrough is in production.
Read the full breakdown below in the meantime ↓
01

Two ways to fail

By 2022 there were two ways to get more out of a language model, and each broke in its own way. Reasoning-only (chain-of-thought) let the model think in steps — but with no access to the outside world, it would reason its way to a confident, wrong answer, hallucinating facts it had no way to check.

Acting-only approaches let the model call tools — search, APIs — but with no reasoning between calls, it flailed: it couldn't plan a sequence of lookups, recover from a dead end, or decide what to do with what it found.

02

The big idea: do both, in turns

ReAct — short for Reasoning + Acting — simply interleaves them. The model is prompted to alternate between thinking about what to do and doing it, feeding each result back into the next thought. Reasoning decides the next action; the action's result grounds the next round of reasoning.

It's how a person actually researches something: think about what you need, look it up, read what you found, adjust your plan, look up the next thing. Not pure thought, not blind clicking — a conversation between the two.

03

The Thought–Action–Observation loop

Concretely, the model cycles through three moves until it can answer:

One iteration of the ReAct loop
ThoughtReason about what to do next.
ActionCall a tool — search[…], lookup[…], calculate[…].
ObservationThe environment returns a result. Read it, loop back to Thought.

The observation isn't the model's guess — it's a real result from a real tool. That's the whole point: each loop injects a fact from outside the model's memory.

04

A real trace

"Besides the Apple Remote, what device can control the program it was designed for?"
ThoughtI need to find what program the Apple Remote controls, then what else controls it.
Actionsearch["Apple Remote"]
Observation…designed to control the Front Row media program…
ThoughtNow find other devices that control Front Row.
Actionsearch["Front Row control devices"]
Observation…controlled by the Apple Remote or the keyboard function keys…
AnswerThe keyboard function keys.

No single fact was memorized. The model reasoned about what to fetch, fetched it, and let each observation steer the next step to the answer.

05

Why the two help each other

The magic is the synergy. Reasoning makes acting smarter — the model plans which tool to call and why, and recovers when a search comes back empty. Acting makes reasoning honest — every observation is a fact from the world, so the chain of thought can't quietly drift into fiction.

Worth knowing

ReAct is essentially chain-of-thought that can reach out and check its work. That's why it hallucinates far less than reasoning alone: the loop keeps dragging the model back to reality.

06

The real results

On knowledge-heavy question answering (HotpotQA) and fact verification (FEVER), ReAct beat acting-only agents and hallucinated less than reasoning-only chain-of-thought. On interactive decision-making benchmarks — ALFWorld and WebShop, where an agent must navigate an environment toward a goal — it outperformed imitation- and reinforcement-learning methods by large margins with just a couple of prompt examples.

ApproachReasons?Acts / uses tools?Weakness
Chain-of-ThoughtYesNoHallucinates — can't check facts
Act-onlyNoYesNo planning — flails
ReActYesYesGrounded, plans, recovers

A bonus the authors highlight: the interleaved trace is human-readable, so you can see why the agent did what it did — and even correct it mid-run.

07

Why it still matters

ReAct is the conceptual backbone of the entire agent era. Function calling, web-browsing assistants, coding agents, research agents — nearly all of them run some version of the Thought–Action–Observation loop this paper named. Frameworks like LangChain and the tool-calling APIs of every major model provider are, at heart, machinery for running ReAct loops.

It gave the field its simplest, most general recipe for turning a next-token predictor into something that can pursue a goal: let it think, let it act, and let what it observes shape what it thinks next.

Worth knowing

When you design an agent, most of the hard engineering — tool schemas, observation formatting, loop termination, error recovery — is about running this loop reliably at scale. Understanding ReAct is understanding the shape of every agent you'll build.

Frequently asked

Quick answers

What is ReAct?

A method that interleaves reasoning steps with actions: the model thinks, takes a tool action, reads the observation, and reasons again — the core loop behind tool-using AI agents.

How does it reduce hallucination?

It lets the model act — look things up — and feed real observations back into its reasoning, grounding each step in external evidence instead of memory.

What is the Thought-Action-Observation loop?

ReAct's repeating cycle: reason about the next move, issue a tool call, read the returned result, and loop until ready to answer.

How is it different from chain-of-thought?

Chain-of-thought reasons internally with no world access; ReAct adds actions so the model can fetch external facts mid-reasoning. ReAct is chain-of-thought that can also check things.

Why does it matter for agents?

Almost every tool-using agent — function calling, browsing, coding — runs a version of the ReAct loop. It's the general recipe for goal-directed, multi-step model behavior.

ReAct: Synergizing Reasoning and Acting in Language Models · Yao, Zhao, Yu, Du, Shafran, Narasimhan, Cao · ICLR 2023 · read the original paper on arXiv → · Vibe Engines · 2026
Finished this one? 0 / 30 Paper Breakdowns done

Explore the topic

See this alongside everything else on the same subject — handbooks, system designs, challenges and tools, in one place.

More Paper Breakdowns