基本信息
- 来源: arxiv
- 原始来源: http://arxiv.org/abs/2608.28549v1
- 发布域名: arxiv.org
- 分类: cs.CV
- 作者: Haosen Yang、Jifei Song、Zhensong Zhang 等
要点解读
这是什么
该工作将预训练的生成式视频模型改造为几何估计框架，通过把深度和表面法线等几何预测任务重新定义为预测后续帧的任务，实现对图像与几何目标的联合建模。
用在哪里
适用于需要在缺乏大量标注数据的情况下进行单目深度和表面法线估计的研究者和工程师，尤其适合希望在不同数据集上实现零样本迁移的视觉系统开发者。
可以推断的
推测：该方法利用视频模型中已有的运动和结构先验，可能在标注数据稀缺的场景下仍保持较好效果。
推测：由于采用统一的生成式建模思路，模型结构或可扩展至其他几何属性（如光流、场景布局）的估计任务。
来源摘要/节选
Recent generative approaches to geometry estimation adapt pretrained image diffusion models and treat the task as image-conditioned generation. Leveraging off-the-shelf image diffusion models, they either (i) train task-specific geometry models (for depth and surface normal estimation) independently, losing the opportunity of exploring the intrinsic correlation of these geometric targets, or (ii) jointly fine-tune modified image diffusion backbones (e.g., altered self-attention), which typically demands substantial labeled data. To overcome these limitations in a principled fashion, we repurpose pretrained video generative models as a unified and data-efficient framework for geometry estimation, formulated innovatively as a next-frames prediction task. Our method, GeoNeXt, inherits naturally structured knowledge and richer priors from the video model, while further adapting them for joint modeling of images and geometry targets (image <-> geometry), enabling more data efficient and effective learning of geometry. Extensive experiments validate our method for zero-shot monocular depth and surface normal estimation across diverse datasets, outperforming both previous task-specific and unified generative competitors while using substantially less training data. Notably, our method rivals discriminative state-of-the-art approaches trained on over 100x more data and even standouts on several benchmarks.
来源说明
当前保存的是来源摘要，不代表论文全文。请以原始来源为准。
「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。