基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2608.04001v1
- 发布域名: arxiv.org
- 分类: cs.LG
- 作者: Mohsen Hariri、Weicong Chen、Nahal Shahini 等
要点解读
这是什么
该研究把语言模型在推理阶段使用更多计算资源的方式划分为三种结构模式：单轨迹顺序扩展、叶级扩展以及前缀级扩展，并围绕这三类模式建立了计算核算、评估指标和实验可复现性的完整框架。
用在哪里
适用于想系统比较不同推理策略效率、制定统一的评估规范以及确保实验可复现的研究者和工程师，尤其是在需要在大模型上评估推理质量与计算成本之间权衡的场景。
可以推断的
推测：在实际部署时，单轨迹顺序扩展往往在计算资源受限的环境中占优，而叶级或前缀级扩展则可能在追求更高推理准确率时带来更显著的资源消耗。
推测：文中对评估协议和不确定性的规范可能促使后续的模型对比报告普遍加入推理计算量及其波动范围的说明。
来源摘要/节选
Large language models can solve substantially harder reasoning problems with more inference-time compute. The term “test-time scaling,” however, now covers diverse inference algorithms that extend deliberation along a single trajectory, sample completed candidates and aggregate them through voting or verification, or search over unfinished partial states. These algorithms differ in their statistical structure, compute accounting, and failure modes. Treating these procedures as interchangeable under a single scalar “budget,” or reporting accuracy without the inference protocol that produced it, makes results difficult to compare across studies. We develop a systematic account of test-time scaling along three axes. First, we formalize test-time scaling as budgeted inference over the implicit prefix tree of an autoregressive model and distinguish three structural regimes: single-trajectory sequential scaling, leaf-level scaling with terminal reduction, and prefix-level scaling. Second, we treat the evaluated object as the entire inference system and develop evaluation principles that separate end-to-end system performance from candidate-bank diagnostics. We introduce an evaluation profile whose coordinates and simple functionals recover or bound common repeated-sampling metrics, and prescribe protocol-matched reporting of compute and uncertainty. Third, we specify reproducibility requirements for inference protocols, distinguishing exact replay from distributional reproducibility and identifying the artifacts needed to support each. We also organize the open-weight reasoning ecosystem by model-side and interface mechanisms, apply these principles to broad-knowledge, symbolic-reasoning, and competition-mathematics benchmarks, and assemble over 2 billion full reasoning traces for release with progressively richer verifier and token-level signals.
来源说明
当前保存的是来源摘要，不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。