基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2608.07463v1
- 发布域名: arxiv.org
- 分类: cs.CV
- 作者: Youjun Zhao、Alex Warren、Gary K. L. Tam 等
要点解读
这是什么
MirrorWorld 是一个面向镜面反射生成的视频修复框架，通过语义关系蒸馏和几何变换对齐分别解决“应反射哪些场景内容”和“反射内容在镜面内如何排列”的问题。
用在哪里
适合从事视频特效、虚拟现实或增强现实场景构建的研究者和工程师，特别是需要在动态画面中合成逼真镜面反射的应用。
可以推断的
推测：该框架若能稳定生成一致的镜面反射，有望降低影视后期和游戏引擎中手动添加镜面效果的工作量。
推测：其中的语义关系蒸馏和几何变换对齐思路可能对其他需要保持空间对应关系的视频编辑任务（如阴影、投影）提供参考。
来源摘要/节选
Recent advances in video diffusion models (VDMs) have enabled high-fidelity video synthesis. However, generating mirror reflections remains challenging because the content within a mirror must remain consistent with the surrounding scene. Existing VDMs are not specifically designed to model scene-to-mirror relationships, which can lead to reflections with incorrect content or inconsistent spatial arrangements. We observe that mirror reflection generation involves two complementary challenges: determining what scene content should be reflected and how the reflected content should be spatially arranged within the mirror region. Motivated by this observation, we propose MirrorWorld, a reflection-aware video inpainting framework that models scene-to-mirror relationships during generation. Specifically, we introduce Semantic Relation Distillation (SRD), which transfers relational information from a frozen visual foundation model to encourage semantic associations between visible scene content and mirror regions. We further propose Geometric Transformation Alignment (GTA), which learns a transformation that guides the spatial arrangement of reflected content. The two components play complementary roles, with SRD modeling what should be reflected and GTA modeling how it should be arranged. To facilitate research on this problem, we construct a benchmark for video mirror reflection generation by repurposing four existing video mirror datasets into a unified reflection reconstruction task. Experimental results show that MirrorWorld achieves improved reflection reconstruction quality over representative image-based reflection generation methods and strong video inpainting baselines.
来源说明
当前保存的是来源摘要，不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。