基本信息

要点解读

这是什么

CliffCompaction 是一种自动压缩技术，用于在保持或提升任务表现的同时，降低处理大规模上下文时的成本。它仅通过截断或丢弃原始内容实现压缩，避免重新表述导致的信息漂移。

用在哪里

适用于需要在受限上下文窗口内跨多个会话处理上百万 token 的编码任务，如代码生成、调试和基准评估。对关注推理成本和效率的开发者或研究人员尤为有用。

可以推断的

  • 推测：在成本受限的环境中，这种压缩方式可以让同等性能的系统以更少的调用次数运行，从而实现费用削减。
  • 推测：因为只删除或截断信息而不重新生成文本，CliffCompaction 可能对需要完整保留上下文的场景有一定局限性。

来源摘要/节选

Agents often work on complex problems that require millions of tokens of context, which necessitates compacting across sessions due to limited context windows. We develop CliffCompaction, an autocompaction technique that reduces cost by up to 50% under a bounded context while maintaining or improving performance on Terminal-Bench and achieving new levels of efficiency for test-time scaling and state-of-the-art results on KernelBench. The per-rollout savings of CliffCompaction make the performance–cost trade-off of test-time scaling more efficient, adding over 10 percentage points on Terminal-Bench for less than the cost of two full-context runs. Under parallel test-time scaling, CliffCompaction lets Kimi K2.6 match Opus 4.7, and exceed Opus 4.6 and GPT-5.3 Codex at lower cost. The key to CliffCompaction’s effectiveness is that it keeps compacted information faithful by only truncating or dropping content, never rephrasing or rewriting it. We never compact a compaction—each pass operates only on original content, and prior compacted output is discarded, preventing context drift from accumulating. These properties sustain continual learning over sessions exceeding a million tokens: on KernelBench, CliffCompaction reaches CUDA kernel speedups of $2.23\times$ after 200 steps and $3.58\times$ after 400 steps, surpassing specialized search algorithms and trained agents despite being a general-purpose compaction technique. We open-source a scaffold-agnostic API-proxy implementation of CliffCompaction usable with Claude Code, Codex and other harnesses.

来源说明

当前保存的是来源摘要，不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。