基本信息
- 来源: arxiv
- 原始来源: https://arxiv.org/abs/2602.18417v1
- 作者: Joshua Nunley
- 分类: cs.LG
- 论文时间: 2026-02-20T18:35:43Z
- 论文 PDF: https://arxiv.org/pdf/2602.18417v1.pdf
来源摘要/节选
This paper presents a direct framework for sequence models with hidden states on closed subgroups of U(d). We use a minimal axiomatic setup and derive recurrent and transformer templates from a shared skeleton in which subgroup choice acts as a drop-in replacement for state space, tangent projection, and update map. We then specialize to O(d) and evaluate orthogonal-state RNN and transformer models on Tiny Shakespeare and Penn Treebank under parameter-matched settings. We also report a general linear-mixing extension in tangent space, which applies across subgroup choices and improves finite-budget performance in the current O(d) experiments.
来源说明
当前只保存了官方论文摘要,不代表论文全文。请以原始来源为准。
本页只呈现已做哈希绑定的来源证据,不包含基于旧正文或缺失原文的扩展推断。