基本信息

要点解读

这是什么

这篇论文研究如何高效计算语言模型提示中各部分对输出的 leave-one-out(LOO)归因值。在稳定性假设下,算法用 sketching 估计所有归因值,并给出匹配的查询次数下界。

用在哪里

它适用于需要判断提示中哪些 token 或片段影响模型输出的场景,例如提示归因、模型行为分析或检索任务中的贡献度评估。研究语言模型可解释性、归因算法与 sketch 技术的读者可能会关注。

可以推断的

  • 推测:在需要同时分析大量提示片段时,sketching 方法可能比逐一移除并重新评估更节省模型调用。
  • 推测:该方法的关键价值不只在计算效率,也在于论文同时给出了理论上匹配的下界,便于判断改进空间。

来源摘要/节选

Context attribution asks how removing parts of a prompt changes a language model’s output. We study leave-one-out (LOO) attribution for a prompt of $n$ tokens and a fixed measurement function. Computing all LOO values directly requires $n$ model evaluations. Under a stability assumption, our algorithm estimates all LOO values to error proportional to $\varepsilon$ with constant probability using $O(\sqrt{\log(1/\varepsilon)}/\varepsilon)$ evaluation calls. To complement our upper bound, we prove a matching $Ω(\sqrt{\log(1/\varepsilon)}/\varepsilon)$ lower bound on the number of evaluation calls in an oracle model. Empirically, we verify coefficient decay consistent with stability and evaluate the performance of our sketching algorithm on a small language-model retrieval task. Technically, our result is based on a sketching algorithm for arithmetic circuits whose Taylor coefficients satisfy the stability condition recently introduced by Gunn [Gun26]. A direct adaptation of their forward differentiation sketches would require $\widetilde{O}(\log(n)/\varepsilon^2)$ evaluation calls. Our key observation is that we can apply forward differentiation to the backpropagation circuit, with only constant overhead over a forward sketch of the same Taylor degree. This reduces the variance of the sketches and is key to our improved evaluation bound. Our lower bound builds on the techniques of Amsel, Chen, Duman Keles, Halikias, Musco, and Musco [ACDH+26, SIAM Journal on Matrix Analysis and Applications] for lower bounding the number of matrix-vector queries to estimate the diagonal elements of random matrices.

来源说明

当前保存的是来源摘要,不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。