基本信息

要点解读

这是什么

BAL 是一种面向三维人体姿态序列的自监督学习框架,在潜在空间中进行前向与后向的自回归预测,利用日常行为本身的时间顺序学习动作语义。它通过区分全局语义与局部运动信息,避免表示完全塌缩。

用在哪里

该方法可用于从人体动作序列中提取表示,服务于动作描述、动作预测和动作插值等任务。研究人体行为建模、时序表征学习或下游动作理解任务的人可能会关注它。

可以推断的

  • 推测:该方法尤其适合需要同时利用动作前后文的应用场景。
  • 推测:相较依赖人工增强或掩码假设的方法,BAL 的训练目标可能对相关超参数更不敏感。

来源摘要/节选

Learning semantically meaningful human movement representations from 3D pose sequences is essential for human behavior modeling. Existing self-supervised methods derive supervision from artificial assumptions, e.g., invariance to augmentation within a certain range or recoverability of masked regions at a certain temporal scale, introducing heuristic hyperparameters that make the learned semantics sensitive to their settings. We propose BAL, a self-supervised framework that instead exploits supervision intrinsic to human movement: the natural ordering structure of everyday behavior. BAL autoregressively predicts in a semantically abstract latent space, analogous to how humans anticipate others’ actions rather than their precise joint configurations. Bidirectional autoregressive prediction, both forward and backward in time, fully leverages these ordering constraints while enabling representation extraction using both past and future context at inference. To suppress representation collapse, BAL decomposes each prediction target into a global component capturing sequence-level semantics and a local component capturing context-independent movement. We prove that the local targets retain nontrivial angular diversity unless the representations are completely collapsed, preserving a meaningful training signal. Experiments on large-scale datasets demonstrate that BAL’s representations are highly effective for motion captioning, forecasting, and interpolation, outperforming baselines on most evaluation metrics.

来源说明

当前保存的是来源摘要,不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。