TAG
#verification
0 篇评论 · 2 篇随笔
相关随笔
Waugh：用数独与 Slitherlink 测量 AI 的推理能力——Fukai 解读
Approximate Labs 的 Justin Waugh 撰写的论文(arXiv 预印本)，介绍了以铅笔解谜衡量 LLM 推理能力的基准 Pencil Puzzle Bench。从 62,231 道题、94 种类型中挑选 300 题，核心是机器可以逐步核算每一手是否违反规则，并据此评测了 51 个模型。即使最强的 GPT-5.2，在能动式解法下也只有 56.0%，约一半题目未能解出。
Li et al.: Making Geometry Problem Solving Verifiable with a Solver as Referee — Fukai Reads
An arXiv preprint by Can Li et al. on geometry problem solving (GPS). Their SD-GPS translates diagram-and-text problems into a form a symbolic solver can execute, and at impasses proposes helper lemmas verified by the solver itself. The abstract reports it consistently outperforms existing methods on Geometry3K and PGPS9K. Fukai reads it for its use in solvability-guaranteed puzzle generation.
