Lesson 7 of 14 · Settings · 2 minutes
Context window: how much your baker can keep in mind
An oven doesn't remember your chat between messages the way a person does. Every time you send a message, GrannyBakes sends the whole chat so far again, and the oven reads it all from the top. How much it can read at once is its context window.
What fits
The context window is measured in tokens. Everything has to fit in it together:
- your baker's instructions,
- the chat so far,
- pieces from your Pantry documents and any remembered facts,
- your new message,
- and room for the answer.
Today's ovens can read a lot, often hundreds of thousands of tokens: a whole novel. You'll find each oven's number on its page under Reads at once. Remember that everything you send is paid for as input tokens, every single time.
Long chats
When a chat grows too long, GrannyBakes keeps it fitting for you. In SettingsSettings you choose how:
- Summarize older messages (the default): Granny writes a short chat summary of the oldest messages and sends that instead. A small oven does it for a fraction of a cent.
- Only send the latest messages: older ones are left out, which is cheaper but the oven forgets what came before.
Either way the full chat stays saved on this PC; only what's sent changes.
The longest answer
Separately, every oven has a longest answer: the most it can write in one go, including its hidden thinking. That's usually much smaller than what it can read.
Granny's rule of thumb: start a new chat when you start a new topic. It's cheaper, and the oven stays focused.