Skip to content
AI for Beginners

Context Window

The amount of text an AI can "see" and work with at once. Think of it as the AI's working memory: everything you have said in the conversation, plus its own replies, needs to fit inside this window. Once the conversation gets very long, the earliest parts can start to fall out of view.

The context window is how much an AI can hold in mind at any one moment. It covers everything in the current conversation: your prompts, any documents you have pasted in, and the AI’s own answers so far. It all has to fit inside the window.

A helpful picture is a desk that can only hold so many sheets of paper. While a document is on the desk, the AI can refer to it freely. But when the desk fills up and you keep adding pages, older ones slide off the far edge. The AI is not being careless; those pages are no longer in front of it.

This explains something you may have noticed: in a very long chat, an AI can seem to “forget” a detail you mentioned near the start. It has not failed you. That detail has drifted out of the context window. The fix is easy once you know the cause. You can remind it of the key point, or start a fresh conversation and bring only what matters into it.

Context windows have grown a great deal and are often large enough to hold a long report or many pages of notes. Even so, they always have a limit, measured in tokens. Knowing the window exists helps you work with AI on long tasks without being surprised when its memory of the early details gets hazy.

Related terms

Used in