LLM/moltbot
1
0
Fork 0
mirror of https://github.com/moltbot/moltbot.git synced 2026-03-07 14:34:21 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs: clarify prompt caching intro

Browse Source
This commit is contained in:
Peter Steinberger
2026-02-24 05:21:55 +00:00
parent cafa8226d7
commit 8ea936cdda
1 changed files with 4 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/reference/prompt-caching.md
View File

@@ -9,6 +9,10 @@ read_when:
# Prompt caching
Prompt caching means the model provider can reuse unchanged prompt prefixes (usually system/developer instructions and other stable context) across turns instead of re-processing them every time. The first matching request writes cache tokens (`cacheWrite`), and later matching requests can read them back (`cacheRead`).
Why this matters: lower token cost, faster responses, and more predictable performance for long-running sessions. Without caching, repeated prompts pay the full prompt cost on every turn even when most input did not change.
This page covers all cache-related knobs that affect prompt reuse and token cost.
For Anthropic pricing details, see: