基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2609.35767v1
- 发布域名: arxiv.org
- 分类: cs.CV
- 作者: Yijia Fan、Ziqi Huang、Zhongang Cai 等
要点解读
这是什么
该研究提出在统一的多模模型内部，通过跨轮强化学习让模型的“反思”文本与图像生成同步优化，实现自我诊断与修订，而无需外部评判器。
用在哪里
适用于需要模型在生成过程中自行发现并纠正错误的图像生成任务，尤其是统一处理视觉与语言的多模态系统。模型研发者和自动化评测平台可参考此方法提升生成质量。
可以推断的
推测：在需要多轮细化的长流程图像生成场景中，这种联合优化方式可能带来更显著的提升。
推测：由于推理时不再依赖额外的验证模型，整体计算开销和响应延迟有望降低，适合对实时性有要求的应用。
来源摘要/节选
Unified multimodal models can both look at and render images, so in principle they can repair their own generations: diagnose what an image gets wrong, revise it, observe the result, and diagnose again. Whether a revision helps is known only after it is rendered, so the reflection text and the image generation must be learned jointly, over the whole loop. Supervised fine-tuning (SFT) on reflection trajectories gives a cold start but does not find the high-success repair paths, and naive RL that optimizes only the renderer or only one head leaves most of the gain untapped. We introduce UMM-Reflection, which applies reinforcement learning (RL) to complete reflection trajectories inside one unified model: sibling trajectories share one initial image, so the group-relative advantage compares reflection strategies, and one trajectory-level advantage updates both the reflection tokens and the flow-based revisions, avoiding the combinatorial blow-up of per-round credit assignment. Unlike single-round editing or pipelines with an external critic, credit flows across rounds and to both roles of the same model, and no verifier is needed at inference. On BAGEL, UMM-Reflection improves GenEval by 12.05 points over SFT, and the gains transfer to WISE (+10.97), OneIG-Bench (+3.48), and T2I-CompBench++ (+4.63), none of which is used in training.
来源说明
当前保存的是来源摘要，不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。