Chapter 3 · Context Scaling 07

Longer contexts unlock
deeper understanding

Evaluation accuracy by context window size

70% 80% 90% 67.2% 4K 72.4% 8K 81.3% 32K 88.7% 128K 93.1% 200K Context window size