基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2608.11197v1
- 发布域名: arxiv.org
- 分类: cs.LG
- 作者: Nikolai Bolik、Lennart Stöpler、Artur Andrzejak
要点解读
这是什么
这是一项关于稀疏自编码器（SAE）激活集合在语言模型中表示语义相似性的研究，比较了基于集合重叠的相似度与传统密集嵌入的相似度，发现SAE集合不能更准确地反映人类对类别边界和典型性的判断。
用在哪里
适用于从事大语言模型可解释性、概念对齐或基于激活模式的模型分析的研究者和工程师，帮助评估在特定任务中是否应采用稀疏特征集合而非密集表示。
可以推断的
推测：在需要模型行为与人类概念对齐的场景下，直接使用SAE激活集合可能导致偏差，需结合其他相似度指标进行校正。
推测：SAE特征的组合可能不遵循简单的集合叠加原则，想要利用它们解释复杂语义变化可能需要引入额外的结构化规则。
来源摘要/节选
Shani et al. (2026) show that LLM representations broadly recover human category boundaries, while failing to reflect fine-grained typicality structure. Their analysis uses cosine similarity over dense model representations. We revisit their approach using overlap over active sparse autoencoder (SAE) latent sets as a more interpretable similarity measure. We first verify that this set-level measure is meaningful: SAE latent sets can recover union-like compositional structure in controlled toy models and induce semantically coherent neighborhoods in natural text. Extending the human-concepts analysis to SAE set similarities, we find that SAE activation sets do not recover human category boundaries or within-category typicality more faithfully than dense embeddings or residual-stream states, but instead track model-internal similarity structure. To probe this gap further, we study active latent sets under well-controlled semantic modifications, revealing a substantial mismatch between human judgements of conceptual change and change in the SAE active set. We interpret this as evidence that, outside idealised settings, SAE features do not compose via simple bag-of-features semantics.
来源说明
当前保存的是来源摘要，不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。