基本信息

要点解读

这是什么

SWE-Prime 是一种两阶段的有监督微调数据筛选方法。它先在轨迹层面依据过程质量、结果质量及数据代表性进行过滤，随后在段层面依据对最终方案的贡献度、可学习性和潜在风险进行细选，只让被选中的段参与损失计算。

用在哪里

适用于需要用少量高质量轨迹微调语言模型以解决实际软件问题的研究团队和工程团队。对关注训练数据噪声控制和筛选策略的从业者同样有参考价值。

可以推断的

推测：在实际软件问题解决轨迹中，常包含冗余或无效步骤，这类噪声会影响模型的学习效果。
推测：通过在轨迹和段两级进行质量评估与筛选，可显著提升监督信号的质量，从而在不增加模型规模的情况下提升性能。

来源摘要/节选

To improve large language models’ ability to resolve real-world software issues, prior work has focused on constructing large-scale agent trajectory datasets and performing supervised fine-tuning (SFT) on successful trajectories. However, task success does not guarantee high-quality supervision: successful trajectories may still contain ineffective, redundant, or risky steps. Directly using such trajectories for SFT can introduce noisy supervision and encourage models to imitate undesirable problem-solving behaviors. Therefore, we propose SWE-Prime, a multi-granularity, two-stage SFT data selection method that progressively filters training data at the trajectory and segment levels. Specifically, the first stage performs trajectory-level screening based on process quality, result quality, and data representativeness, selecting a high-quality and representative subset of successful trajectories. The second stage performs segment-level selection by grouping consecutive steps into semantic segments and assessing each segment based on its contribution to the final solution, learnability, and potential risks. During SFT, all segments remain in the sequence to preserve context, while only selected segments contribute to the loss computation. Experiments on SWE-Bench Pro and SWE-Bench Verified show that training on the 10% trajectory subset selected by SWE-Prime outperforms training on the full resolved dataset, yielding relative performance gains of up to 12.2% and 24.2%, respectively.

来源说明

当前保存的是来源摘要，不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。