基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2611.10501v1
- 发布域名: arxiv.org
- 分类: cs.AI
- 作者: Alfonso Amayuelas、Piotr Piękos、Xin Eric Wang 等
要点解读
这是什么
这篇论文区分了 LLM 智能体的随机探索与真正的“好奇心”:温度、best-of-N、树搜索或 RAG 只能改变采样方式或条件,不会更新智能体对环境的认识。作者提出界定好奇心的框架,强调从交互中在线改进的环境预测、用预期改进指导行动,以及跨上下文窗口保留学习结果。
用在哪里
适用于设计和评估开放式研究任务中的 LLM 智能体,尤其是需要自主决定调查方向并持续与环境交互的系统。它也为如何让这类智能体具备严格意义上的好奇心提供了研究框架。
可以推断的
- 推测:这篇论文主要提出概念定义和研究方向,而非给出完整的智能体实现。
- 推测:若系统仅增加采样随机性或搜索强度,却没有从交互中更新对环境的预测,就不符合论文给出的好奇心标准。
来源摘要/节选
LLM agents are increasingly used for open-ended tasks, very common in research scenarios where they are required to explore, investigate, or act curiously. At inference time, an LLM is a fixed map from context to next-token distribution, the pretrained weights determine the function, and only its conditioning changes as context accumulates. Mechanisms like temperature, best-of-N, tree search, or RAG vary how the distribution is sampled or what it is conditioned on, but do not update the agent’s model of the environment. We argue that current LLM agents do not explore curiously; they explore stochastically. From how curiosity is understood in the RL literature, it requires a predictive structure over how the environment responds to the agent’s actions, which improves online from current interaction, drives action selection through its predicted improvement, and persists beyond the context window. Additionally, in its open-ended form, the agent should intrinsically originate what to investigate. Thus, we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it. In doing so, we identify the research directions its implementation opens up.
来源说明
当前保存的是来源摘要,不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。