基本信息

要点解读

这是什么

该内容提出一种量化推理过程中技能切换难度的指标，并在此基础上构建了包含跨技能长时推理任务的评测基准，同时将该指标转化为强化学习训练信号，用于提升模型在复杂推理链中的技能切换能力。

用在哪里

适用于对大语言模型多步推理能力进行标准化评估的研究场景，以及需要改进模型在多技能协同任务中表现的训练流程设计。相关工作对关注模型工具调用、任务规划或复杂问题分解能力的研究者和工程师具有参考价值。

可以推断的

推测：在实际应用中，需要频繁切换技能的任务（如先执行计算再进行逻辑推理）往往更容易出错，该指标或方法有望帮助定位模型在这类场景下的薄弱环节。

推测：若该评测框架和训练方法被后续研究广泛采用，可能会成为评估长时推理模型能力的新标准之一，影响相关模型优化的方向。

来源摘要/节选

Long-horizon reasoning in recent LLMs demands that the model switch between distinct skills inside a reasoning chain, such as first doing a math derivation, then using the result to plan a schedule. We call such problems cross-skill long-horizon tasks: multi-step tasks whose steps require different reasoning skills and depend on earlier outputs. Existing benchmarks often evaluate individual skills, lacking a principled way to measure how well a model switches between skills. We address this gap from both the evaluation and training sides. We introduce Skill Entropy, a measure of the difficulty of switching from one skill to another. We then propose Skill^2-Bench, a benchmark of cross-skill long-horizon tasks built over 558 skills across 9 verifiable and open-ended domains. Each task is assigned a task-level skill-entropy score and grouped into three difficulty levels. Evaluating 8 frontier and 4 open-source models on Skill^2-Bench reveals a skill-switching gap: accuracy decreases on higher-entropy tasks. We then turn skill entropy from a benchmark scale into a training signal. We propose Skill-Entropy RL, an RL framework where the model predicts not only the answer at each step but also the skill used to produce it. The reward combines step-level correctness with a skill-entropy reward that measures the alignment between the model-predicted skill sequence and the gold skill sequence. On Qwen3-4B-Instruct and Qwen3-1.7B, Skill-Entropy RL improves the Skill^2-Bench score from 34.4% to 68.4% and from 14.6% to 40.1%, respectively, outperforming competitive baselines. The same pipeline can be applied to off-the-shelf training data such as OpenR1-Math, indicating that skill entropy is a reusable training signal. Code available at: https://github.com/Gen-Verse/Skill-Entropy-RL

来源说明

当前保存的是来源摘要，不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。