基本信息

要点解读

这是什么

该研究通过在语言模型上训练六个针对不同道德基础类别的线性探针，考察各类别在模型内部表征空间中的几何关系，进而分析模型如何整合与区分道德知识。

用在哪里

适用于对大模型道德推理机制感兴趣的科研人员，尤其在可解释性、价值对齐或人机交互设计中，需要了解模型如何结构化伦理概念。

可以推断的

推测：不同规模的模型在道德表征上可能表现出相似的几何布局，说明其对道德基础的组织具有一定的普遍规律。
推测：在面对道德冲突时，模型会部分组合多个基础方向，而非一次性给出唯一结论，暗示其对道德张力的表现具有内在的冲突编码。

来源摘要/节选

How do large language models (LLMs) organize moral knowledge? Models detect moral content broadly, but detection is a low bar. We ask whether they go further, distinguishing moral foundations from one another and organizing the relationships between them geometrically. We train six independent linear probes on open-weight language models, one per Moral Foundations Theory (MFT) category (care/harm, fair/cheat, lib/oppress, loy/betray, auth/subv, sanc/degrade), and examine how the resulting directions relate to each other in representation space. We find the directions neither collapse into a single moral detector nor isolate from one another. Rather, they span a near-maximal number of independent dimensions while sharing a positive common component. The shared component is the signature of integration, and it is moral-specific relative to a matched non-moral concept battery built identically (mean pairwise cosine 0.26 vs. 0.013). The geometry is consistent across architectures and scale and reaches its integration regime early in pre-training, well before probe accuracy saturates. The structure the model discovers shows no evidence of the individualizing/binding distinction predicted by Moral Foundations Theory (an underpowered test: only 20 candidate partitions exist) but rather reflects corpus statistics. Extending to moral dilemmas, each dilemma direction partially composes from its component foundations, at 2.7x a mismatched-pair baseline, while the majority of its variance encodes conflict-specific structure. The model represents moral tension itself, not a pre-resolved judgment.

来源说明

当前保存的是来源摘要，不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。