基本信息

要点解读

这是什么

这项研究提出“对比式发现”:让智能体同时评估一组相互排斥、覆盖完整备选方案的科学解释,并根据实验后各解释的信念变化判断问题是否解决。

用在哪里

它适用于基于 LLM 智能体的开放式、数据驱动科学发现,可用于重新利用已有证据,或在相同实验预算下指导后续实验搜索。

可以推断的

  • 推测:显式比较竞争解释,可能比单纯判断一个假设是否成立更适合需要确定替代方案的科研任务。
  • 推测:若智能体常因当前假设被否定而停止,加入替代解释可能帮助其继续利用已有证据。

来源摘要/节选

LLM agents are increasingly used for open-ended, data-driven scientific discovery, yet most of them evaluate hypotheses pointwise, testing an empirical claim $h$ only against its complement $\neg h$. When evidence rejects $h$, the agent learns that one explanation is unlikely but not which alternative the evidence supports. To recover that alternative, we introduce Contrastive Discovery, which replaces the single hypothesis with a contrast set, a scientific question paired with mutually exclusive and collectively exhaustive competing explanations. Each experiment is scored by how its evidence redistributes belief across the set, and the question is resolved when belief concentrates on one explanation. Because contrast sets change only the unit an agent proposes and scores, an existing agent can use them to re-evaluate evidence it has already collected or to guide its search. Across six domains, $89%$ of the pointwise candidates with the largest belief shifts are rejections. On the same evidence, contrast sets resolve $73%$ of these candidates to a specific alternative. When contrast sets guide search, the agent resolves $67%$ more questions than pointwise surprisal under the same experiment budget. In a blinded study, $38$ human experts chose the same explanation on $78%$ of resolved questions and on $82%$ of questions where the pointwise agent rejected its hypothesis and stopped. Together, these results support explicit competing explanations as a way for discovery agents to resolve more scientific questions from the same evidence and validation budget.

来源说明

当前保存的是来源摘要,不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。