🪟 Context Window Explained Like You're 5
Building AI systems and writing about how they actually work. Master of AI @ University of Technology Sydney. Previously B.Tech CS with focus on IoT. I believe the best way to learn is to explain. That's why I'm documenting tech concepts with simple analogies (@sreekarreddy.com). AWS Certified • Azure AI Certified • Neo4j Professional • Google Data Analytics When not coding: exploring Sydney, working on side projects, and teaching tech to anyone who'll listen.
How much an AI can remember at once
Day 55 of 149
👉 Full deep-dive with code examples
The Desk Size
You're studying with notes spread out.
Small desk → Often just a few pages visible Big desk → See everything at once!
Context window = AI's desk size!
What It Means
Context window = how many tokens AI can see at once
Your conversation:
[System prompt] + [Previous messages] + [Your question] + [Response]
↑
All need to fit within the context window.
If it doesn't fit, old messages get "forgotten"!
Size Matters
Different models support different context-window sizes.
Bigger window = the model can keep track of more of the conversation.
What Happens When Full?
Conversation too long?
- Oldest messages drop off
- AI "forgets" early context
- Might repeat itself or lose track
That's why sometimes AI forgets what you said earlier!
Workarounds
- Summarize long context
- Use RAG (fetch mostly relevant info)
- Choose models with bigger windows
In One Sentence
Context window is the maximum amount of text an AI can consider at once, including your entire conversation.
🔗 Enjoying these? Follow for daily ELI5 explanations!
Making complex tech concepts simple, one day at a time.