Cache-related changes reduced cold cache misses by 20%
Cache-related changes reduced cold cache misses by 20%. The authors reserved tools and system instructions for content that rarely changes, then moved more variable setup past the cache boundaries into a “phantom user message.”
Supporting evidence
Improved token efficiency for longer agent runs · Cursor
Original excerpt
These changes reduced the rate of cold cache misses by 20%.