基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2608.11181v1
- 发布域名: arxiv.org
- 分类: cs.CC
- 作者: Orr Paradise、Oliver Richardson、Yoshua Bengio 等
要点解读
这是什么
该文提出一种交互式 PCP 框架,能够在多项式时间内检验由概率电路和置信度电路构成的模型,对其产生的众多条件概率回答是否近似一致,并通过稀疏的见证分布作为证明来辅助验证。
用在哪里
适用于需要对大规模概率预测系统进行可信度审查的场景,尤其是 AI 安全性研究中对模型诚实性进行形式化验证的学者,或在实际部署前想确保预测不会自相矛盾的工程师。
可以推断的
推测:此类验证技术若成熟,可为监管机构提供对概率模型输出的可验证保证手段。
推测:实现该协议需要构造稀疏的见证分布,可能在资源受限的环境下带来实现难度。
来源摘要/节选
When a probabilistic predictor answers many conditional-probability queries, are its answers self-consistent, and can this be verified in polynomial time? This problem is of interest for AI safety, where safety is derived from honesty about probabilistic predictions of unwanted outcomes potentially caused by an AI action. We construct an interactive PCP as follows. Let a predictive model be specified by a probability circuit P and a circuit Q which outputs confidence in predictions. Together, P and Q implicitly specify exponentially many probabilistic claims. We show a protocol in which a polynomial-time verifier can verify the approximate consistency of (P,Q). The verifier is given the pair of circuits (P,Q), which it evaluates at only a few points; alongside them it is given a proof oracle, an encoding of a witnessing probability distribution allegedly consistent with the predictions of (P,Q), which it reads at a few locations while interacting with a single untrusted prover. En route, we must ensure the existence of a sparse witnessing distribution consistent with the model’s predictions. To do so, we first consider witness distributions for the consistency of explicit probabilistic claims, rather than claims specified by a predictor: say m claims, each of the form Pr[Y = 1 | X = x] = p, over n Boolean variables. Building on work initiated by Nilsson (Artif. Intell., 1986), we place l_2-approximate probabilistic consistency of explicit claims in NP, with certificates of length O(mn + log B) in the input bit-precision B; we further show how a small additive completeness-soundness gap removes the dependence on B. Together these results provide a complexity-theoretic foundation for certifying the self-consistency of probabilistic predictors. We view our interactive PCP as a first step toward training predictive models to prove their own consistency.
来源说明
当前保存的是来源摘要,不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。