基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2609.05382v1
- 发布域名: arxiv.org
- 分类: cs.CV
- 作者: GeonU Kim、Shin Dong-Yeon、Tae-Hyun Oh
要点解读
这是什么
该方法是一种无需额外训练的生成式新视角合成技术，专门用于包含镜面的场景。它把镜中像视作两幅互补视角，估计镜面并映射相机位姿形成虚拟视角，随后通过两个阶段的生成步骤——镜门控注意力和反射注入——在多视角扩散模型中显式利用反射关系，实现反射一致且场景连贯的新视角。
用在哪里
适用于需要在真实或合成场景中通过镜面获取隐藏结构的应用，例如室内建模、虚拟现实内容生成或增强现实中的场景补全。研究者或开发者若使用多视角扩散模型进行场景重建，而现有模型对镜面处理不足，可考虑采用该方法进行改进。
可以推断的
推测：该方法在需要保持反射细节的高质量渲染时，可能比未考虑镜面的方案更具优势。
推测：由于不依赖额外微调，它在资源受限或快速原型开发环境中更容易部署。
来源摘要/节选
We propose Ref-GeNVS, a training-free, reflection-aware method for generative novel view synthesis (NVS) in mirror scenes. Existing multi-view diffusion models often fail to recognize the mirror in the scene and cannot exploit reflected content for scene generation. To fix this issue without additional training, our key idea is to treat a mirror image as two complementary views. From input images, we estimate the mirror plane and reflect camera poses to form virtual views. Based on this virtual view setup, we propose a two-stage generation method consisting of Mirror-gated attention and Reflection injection, which enables reflection-consistent NVS by explicitly leveraging reflection relationships in a multi-view diffusion model. Ref-GeNVS inherits the strong generalizability of the multi-view diffusion backbone, while it does not require finetuning. On synthetic and real scenes including mirrors, Ref-GeNVS outperforms recent generative NVS methods by generating reflection-consistent and contextually coherent novel views, revealing scene structure visible only through mirrors. Project page: https://kim-geonu.github.io/Ref-GeNVS/
来源说明
当前保存的是来源摘要，不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。