基本信息

要点解读

这是什么

该研究指出，现有的仅依赖置信度排序的免验证器测试时扩展方法在复杂任务上会失效，因为全程高置信度往往意味着探索不足。作者提出一种名为 consilience 的选择框架，通过评估置信度随时间的非对称性，显式惩罚初始高置信度并要求最终答案具备确定性。

用在哪里

适合在缺少外部验证工具（如编译器或价值网络）的场景下，用于提升大语言模型在代码生成、数学推理等多步推理任务中的表现。对关注推理可靠性和测试时计算资源分配的研究人员或工程师尤为相关。

可以推断的

推测：在实际应用中，若模型在推理早期即表现出高置信度，可能倾向于保留错误答案，加入时间维度的置信度约束有望纠正这一倾向。
推测：该思路或促使后续研究在推理增强方法中引入置信度演化分析，如在自洽解码或递归思考等策略中加入早期置信度的惩罚机制。

来源摘要/节选

Test-time scaling often uses an external verifier, such as compilers and test cases in coding or trained value functions in robotics applications, to obtain high-quality rollouts. Verifier-free test-time scaling (or VF-TTS) is gaining extensive attention as a mechanism to enhance Large Language Model (LLM) reasoning, primarily because we do not have access to such high-quality verifiers in many real-world applications. Among existing VF-TTS methods, confidence-based VF-TTS methods, which compute and rank rollouts solely by confidence, are particularly promising. Such methods introduce near-zero overhead for sample evaluation and require minimal access to internal model states, making the methods highly flexible across models and tasks. In this paper, we demonstrate a critical limitation of existing confidence-based VF-TTS methods by showing that such methods catastrophically break down on complex tasks. We observe a very interesting phenomenon: uniformly high confidence frequently indicates a failure to explore, favoring confidently wrong answers. To address this, our core insight is that robust cognitive search requires a specific confidence trajectory pattern: such methods perform exploratory branching at the beginning, as manifested by low initial confidence, and converge to a high final confidence solution. To implement this insight, we introduce consilience, a novel selection framework that explicitly evaluates the temporal asymmetry of confidence in reasoning. We operationalize this via a combinatorial metric that actively penalizes high initial confidence while strictly demanding final certainty. Extensive experiments covering both graduate-level mathematics problems and free-form code generation demonstrate that consilience effectively outperforms existing baselines, validating our novel perspective on completion confidence.

来源说明

当前保存的是来源摘要，不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。