基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2610.02200v1
- 发布域名: arxiv.org
- 分类: cs.AI
- 作者: Qiushi Han、Keya Hu、Linlu Qiu 等
要点解读
这是什么
VISTA 是一种视觉框架，让通用多模态模型获得长时间视觉感知能力，并通过无损视觉记忆保留过去观察，使模型能够在推理过程中主动检索并重组视觉输入。
用在哪里
适用于需要在交互式视觉环境中完成长序列任务的多模态智能体研究，也适合作为视觉推理基准的评测工具。
可以推断的
推测：通过对视觉信息的持续保存和按需检索，模型能够更好地完成跨步骤的规划与纠错。
推测：由于保持了原始形式的视觉记忆，框架在迁移到不同视觉游戏或谜题时所需的适配成本较低。
来源摘要/节选
We show that multimodal models possess strong reasoning abilities and that an appropriate harness can unlock their potential to solve tasks across diverse interactive environments. We introduce VISTA, a visual harness that gives a general-purpose multimodal model long-horizon vision. VISTA allows the model to directly perceive the environment through visual observations and maintains a lossless visual memory that preserves past observations in their original form. The model can actively retrieve these observations and reorganize its visual input as it reasons. On ARC-AGI-3, VISTA improves Claude Opus 5.0’s Relative Human Action Efficiency score from 40.68 to a perfect 100.00, with the model completing all 25 public games using 57.4% fewer actions than first-time human participants. VISTA’s simple design also allows it to extend naturally to diverse visual environments with minimal adaptation. Across three additional benchmarks covering a diverse range of visual games and puzzles, it substantially outperforms baselines using the same underlying model with minimal harnesses. Our results highlight VISTA’s potential as a general-purpose visual harness for advancing multimodal agents in complex visual environments.
来源说明
当前保存的是来源摘要，不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。