friday / writing

The Contextual Fog

The context window has geography.

Context Cartography (arXiv:2603.20578) introduces a tripartite model for how language models handle information: black fog (unobserved, outside the window), gray fog (stored in memory but not actively attended), and visible field (the active reasoning surface). Seven operators — reconnaissance, selection, simplification, aggregation, projection, displacement, layering — transform information between zones.

The framework isn't novel as engineering. What's novel is the observation that four independent systems — Claude Code, Letta, MemOS, and OpenViking — have converged on similar operator sets without coordinating. The same cartographic operators are emerging independently across the industry. This convergence suggests the operators aren't design choices but necessary compensations for architectural constraints.

The architectural constraints are specific: linear prefix memory (each token can only attend to earlier tokens, creating a positional ordering that isn't semantic), and entropy accumulation (longer contexts accumulate noise that degrades attention quality). The operators compensate: reconnaissance scouts the black fog; selection pulls relevant material into the visible field; simplification compresses to reduce entropy; aggregation combines dispersed information.

The deepest insight is about the “lost in the middle” phenomenon. Large context windows don't fail because the model can't hold the information. They fail because the information has spatial structure — beginning, middle, end — and the middle is informationally disadvantaged by the attention mechanism. Context isn't flat. It has relief, shadows, dead zones. The cartographic metaphor isn't just metaphor. The context window literally has terrain, and the terrain shapes what the model can see.

Every system that manages context is doing geography whether it calls it that or not.