基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2608.26105v1
- 发布域名: arxiv.org
- 分类: cs.CV
- 作者: Junxiang Xu、Ruisi Wang、Fanyi Pu 等
要点解读
这是什么
VBVR-Pro 是一个闭环测试平台,旨在把视觉生成本身作为推理介质,实现视觉推理任务的可训练、可验证和可优化。平台提供可扩展的任务集、基于确定性规则的奖励评分器,并支持对多种生成模型进行机制分析。
用在哪里
适合从事多模态大模型、视觉推理以及强化学习研究的团队,尤其是需要构建可控训练任务、设计可靠奖励信号或比较不同生成范式表现的研究者。
可以推断的
推测:平台开放的数据、模型、评分器和代码或能让研究者在已有基准上快速实验,降低自行搭建评测环境的成本。
推测:通过对图像、视频以及交错生成方式的对比,团队能够直观了解不同生成模式在需要时空状态跟踪的视觉推理任务中的优势。
来源摘要/节选
Native visual reasoning treats visual generation as the medium of reasoning itself: visual states (i.e. images and videos) are not merely inputs to be understood or outputs to be rendered, but first-class substrates for problem solving beyond language. Yet progress remains bottlenecked by the lack of scalable training tasks, reliable feedback, and controlled comparisons across generative substrates. In this work, we introduce VBVR-Pro, a closed-loop testbed that makes native visual reasoning through generation trainable, verifiable, optimizable, and experimentally controllable. 1) Task scaling. VBVR-Pro turns visual reasoning into a controlled task space of 300 procedurally generated tasks. Models trained on VBVR-Pro show strong transfer beyond the proposed suite across seven external visual reasoning benchmarks such as RISE-Video, MME-CoF-Pro, and BabyVision. 2) Verifiable rewards. VBVR-Pro provides verifiable reward scorers for task-grounded evaluation. Through a systematic study of leading MLLMs as judges, we identify recurring failure modes of the prevalent VLM-as-a-judge paradigm. In contrast, the proposed scorers are grounded in deterministic, task-specific rules, achieve fine-grained alignment with human judgments. Importantly, they serve as reliable reward signals for large-scale multi-task reinforcement learning and demonstrate stronger post-RL performance across visual reasoning tasks. 3) Mechanism study. VBVR-Pro enables controlled modality studies across more than 30 image, video, and interleaved generators. Our analysis shows that video generation remains strongest for tasks requiring persistent spatiotemporal state tracking, while interleaved generation provides a compute-efficient alternative. Critically, ablations and probing suggest the presence of vision-native trajectories that are crucial to visual reasoning. We release all data, models, scorers, and code.
来源说明
当前保存的是来源摘要,不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。