基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2608.02575v1
- 发布域名: arxiv.org
- 分类: cs.LG
- 作者: Shengzhi Deng、Chenqi Ye、Yanze Guo
要点解读
这是什么
该内容说明，扩散模型在硬件实现中所使用的随机数本质上是伪随机规则产生的确定数值轨道；这些轨道结构能够被模型学习，并进而影响训练过程和最终的生成质量。
用在哪里
适用于关注扩散模型随机性来源的研究者、探索随机数生成质量对生成任务影响的研究人员，以及需要在实际训练中对随机输入进行精细控制的算法工程师。
可以推断的
推测：在实际训练中，使用不同的伪随机序列可能导致模型性能出现可测的差异。
推测：模型若能够捕捉伪随机轨道的细微规律，则在选择随机数生成器时需要更严格的评估，以避免隐式结构对模型产生不利影响。
来源摘要/节选
Diffusion models rely on stochastic inputs, yet on finite-precision hardware, the “randomness” they consume is realized as deterministic numerical orbits generated by pseudorandom rules. Accessible orbit structure can become a learnable input and affect both training and generation because the realized loss and its gradient depend on the concrete pseudorandom values consumed at each optimization step. A small multilayer perceptron predicts the next value of an orbit from its recent history, measuring general sequence predictability. A diffusion probe replaces real images with online random tensors while preserving the diffusion architecture and training objective, measuring whether the target system can exploit orbit structure. After controlling marginal statistics and screening out clear dynamical and finite-precision failures, the remaining orbits still produce markedly different diffusion losses and generation quality on MNIST and CIFAR-10. Both measures show strong rank correlations with macroscopic generation degradation, although their local rankings differ. After normalization by the IID baseline, the probe loss and the real-data diffusion loss approximately follow an empirical power law, with different exponents on the two datasets. These results suggest that a pseudorandom source is not only a distributional choice, but also a model-dependent structured input.
来源说明
当前保存的是来源摘要，不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。