基本信息

要点解读

这是什么

MindTopo 是一个用于评估基础模型在拓扑空间直觉能力 的基准,围绕连续性、分离、顺序、闭合和纽结五个概念设计,分别在推理和规划两种认知层次上提供任务。

用在哪里

适用于研究空间认知和抽象拓扑关系的研究者,也适合需要衡量多模态大模型在闭环智能体中表现 的工程师进行模型能力诊断。

可以推断的

推测:当前模型在需要保持拓扑一致性的规划任务上仍有明显短板,基准有助于定位改进方向。
推测:生成的观测虽能保留局部线索,但在跨步骤的状态转换中难以可靠维持拓扑约束,暗示模型对连续变形的理解仍有限。

来源摘要/节选

Spatial reasoning depends not only on metric properties such as distance, angle, and shape, but also on topological relations that remain invariant under continuous deformation. Cognitive science identifies these relations as foundational to spatial understanding, yet foundation-model evaluations largely focus on metric or viewpoint-dependent relations. We introduce MindTopo, a benchmark of topological intuition across five properties grounded in cognitive science and formal topology: continuity, separation, order, enclosure, and knots. MindTopo evaluates each property at two cognitive levels. Reasoning asks a model to identify topological relations or infer how they change. Planning instantiates a foundation model as a closed-loop agent whose policy selects environment actions. MindTopo contains 11,030 instances across 13 procedurally generated task types with controllable difficulty. We benchmark 14 MLLMs and study agent configurations augmented with image and video generation, including 3 video generative models in planning settings. Every MLLM performs better on reasoning than on planning, and the best-performing model remains far below observed human performance. On Qwen3-VL-2B-Instruct, supervised fine-tuning and reinforcement learning improve reasoning more than planning. Generated observations retain local cues and reach plausible endpoints, but audited rollouts do not reliably follow environment dynamics or preserve topology across transitions. Our website is at https://mind-topo.github.io/

来源说明

当前保存的是来源摘要,不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。