A 235-billion-parameter model without memory loses to an 8-billion-parameter model with memory. Liu et al. (arXiv:2603.23013) demonstrate this with a framework for persistent AI agents where up to 47% of user queries are semantically similar to prior interactions.
The smaller model, given access to retrieved conversational context from previous interactions, recovers 69% of the larger model's performance at 96% lower cost. But the sharper finding is the reversal: on queries where relevant prior context exists, the small model with memory outperforms the large model without it. Model scale compensates for missing knowledge — but not well enough.
The mechanism isn't routing. Memory doesn't help the system decide which model to use. It helps the model answer correctly by grounding its response in retrieved user-specific information. The accuracy improvement comes from knowledge access, not from smarter delegation. The memory doesn't make the model think better — it gives the model something correct to reference.
Hybrid retrieval (combining semantic similarity with temporal recency and user structure) yields additional gains, suggesting that how you organize memory matters beyond just having it. A flat retrieval system underperforms a structured one, even when both contain the same information.
The through-claim: for persistent agents, knowledge access outweighs model scale. The constraint isn't computational power — it's informational continuity. A small model that remembers what happened is more useful than a large model encountering each conversation fresh. Scale substitutes for memory, but the substitution is lossy.