基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2611.17320v1
- 发布域名: arxiv.org
- 分类: cs.CL
- 作者: Minhae Oh、Jeonghye Kim、Jinwoo Koo 等
要点解读
这是什么
该工作提出一种名为 DiVR 的验证器,用于判断扩散语言模型的部分生成结果是否可能得到正确答案,并据此决定是否重生成文本块及保留哪个候选方案。生成器本身无需改变。
用在哪里
适用于扩散语言模型的推理生成、答案纠错和文本修订场景,尤其适合需要根据中间生成状态决定是否重新生成的任务。
可以推断的
- 推测:把重生成时机判断与生成模型分离,可能便于在现有系统上增加纠错环节,而不必改动主生成流程。
- 推测:这类方法可能提升推理任务的可靠性,但其额外计算成本会影响实际部署取舍。
来源摘要/节选
Remasking allows diffusion language models to revisit generated text, but effective correction requires knowing when and what to revise. Our diagnosis on Sudoku reveals two gaps. Hidden states contain error information that token confidence does not reliably expose, and remasking an isolated error usually reproduces it when the surrounding context remains fixed. These findings motivate DiVR , a verifier that predicts whether a partially generated sequence will reach a correct answer. Trained on the final correctness of the model’s own trajectories, DiVR decides when to regenerate a block and which alternative to retain, while the generator itself stays unchanged. On five reasoning benchmarks with LLaDA-8B-Base, DiVR raises the average accuracy of the fine-tuned generator from 35.3% to 43.4% at $1.9$-$3.5\times$ the cost of greedy decoding, above search baselines that use $3.8$-$7.4\times$. It also complements post-training such as supervised fine-tuning and reinforcement learning, and generalizes to other generators, including Dream.
来源说明
当前保存的是来源摘要,不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。