基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2611.06914v1
- 发布域名: arxiv.org
- 分类: cs.MA
- 作者: Mattia Greiche、Reihaneh Rabbany、Maximilian Puelma Touzel
要点解读
这是什么
这篇论文研究如何通过有控制地补充提示上下文,减少大语言模型智能体在语义不变改写下行为的波动,同时保持对社会环境变化的合理响应。作者提出“上下文增强”和“选择性稳健性”框架,并在囚徒困境类博弈中进行了验证。
用在哪里
该方法适用于社会模拟、智能体行为评估以及提示设计,尤其适合需要检验模型决策是否稳定、是否对重要环境变化敏感的研究者。
可以推断的
- 推测:增加上下文并不必然提升稳健性,背景补充的具体方式可能比信息量本身更关键。
- 推测:同一套上下文增强策略在不同模型上的效果可能不同,跨模型应用时需要单独验证。
来源摘要/节选
Researchers use large language models as agents in social simulations, where agents are prompted with observations and background information intended to shape their actions. Yet LLM agents have been shown to substantially change their behavior under meaning-preserving prompt variations, creating a validation problem for social simulation. One plausible hypothesis is that this brittleness reflects a lack of grounding and can be reduced by enriching the context provided to the agents. Whether richer context improves robustness remains unclear, in part because context richness and robustness are rarely defined in ways that support controlled comparisons. We address the first need with controlled context enrichment, a set of prompt substitution rules that systematically enriches distinct types of context: neutral padding, generic social background, descriptive decision grounding, and normative decision grounding. We address the second by introducing selective robustness as a validation criterion: insensitivity to meaning-preserving prompt variation combined with a directional response to decision-relevant changes in the social world. We demonstrate the framework in a Prisoner’s Dilemma-like game, showing how it can be used to identify which forms of context enrichment produce more desirable and robust agent behavior. We find that these forms of enrichment produce distinct behavioral patterns that vary between the two models tested.
来源说明
当前保存的是来源摘要,不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。