Prompt Caching
Reusing the processed prefix of a prompt so you don’t re-pay to encode it every turn.
Prompt caching lets a provider skip re-processing a stable prompt prefix (system message, tools, long context) across calls, cutting latency and cost. It rewards ordering prompts so the unchanging parts come first.