2026-07-29 · paper-digest
Gould & Ward et al.: Measuring Puzzle Difficulty in Units of Human Solve Time — Fukai Reads
An AI evaluation paper by Gould, Ward and colleagues. They attached human solve times to 43 benchmarks and over 30,000 problems, and found that the human time of tasks a model completes at 50% success without externalising its reasoning has doubled roughly every 373 days over six years, reaching about three minutes for GPT-5.5. Their difficulty-measurement craft, built partly on Sudoku and crosswords, transfers directly to puzzle design.
