A million tokens of context, and why retrieval still matters
A large context window can help with whole-document work, but input limits, long-context prices, permissions, and retrieval quality still need attention.
Fluent AI
AI architecture
The effort dial, and when it is worth paying for
Reasoning effort changes the cost, latency, and behavior of supported models. Test settings per task and keep validation and human review where needed.
Fluent AI
Prompt caching, for people who pay the bill
Prompt caching can reduce repeated input charges. Check eligible prefixes, writes, expiration, and measured reuse before estimating what it will save.
Intermediate AI
Getting a model to say “I don’t know”
AI can sound certain while being wrong. Make uncertainty explicit, allow abstention and check whether the evidence supports the answer.
Intermediate AI
What a context window actually is
A context window is a request budget, not perfect recall. How history, output limits, caching and product memory affect what an assistant can use.
Beginner AI
Why two people get different answers from the same model
Same-looking requests can differ in context, tools, settings or generation. How to compare answers without guessing which cause dominates.
Beginner AI