基本信息

要点解读

这是什么

该研究将语音的“自然度”拆解为多个语言学维度的评估框架，构建首个面向文本转语音系统的维度级元评估基准，用来检验现有自动评估模型在捕捉人类听觉感知各层面的表现。

用在哪里

适用于 TTS 系统研发团队、语音质量评估研究以及评估标准制定者，帮助他们了解当前自动评估工具的局限，指导更细粒度、解释性更强的评价方法开发。

可以推断的

  • 推测：在实际产品部署中，仅依赖单一的“自然度”得分可能无法捕捉特定的语言错误，需要结合多维评估。
  • 推测：该基准的公开可能会推动社区构建更贴合语言学结构的评估指标，提升语音合成的可解释性。

来源摘要/节选

Automated Text-to-Speech (TTS) evaluation methods (Mean Opinion Score (MOS) predictors and Audio Large Language Models (Audio-LLM) judges) are expected to reflect human perception, yet it is unclear how well they capture the distinct aspects of speech that listeners actually perceive. We deconstruct “naturalness” into a linguistically grounded annotation schema spanning 10 distinct perceptual dimensions, and use it to construct the first dimension-level meta-evaluation benchmark for TTS, comprising 860 utterances annotated by trained linguist raters. Results from benchmarking four MOS predictors and four Audio-LLM judges reveal that MOS predictors collapse onto acoustic signal quality, while Audio-LLM judges show selective, prompt-dependent detection that does not generalise across all dimensions. Neither class reliably captures a breadth of linguistically structured speech errors. Our dataset, annotation schema, and evaluation code are publicly released to support more targeted and interpretable TTS evaluation.

来源说明

当前保存的是来源摘要，不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理，不代表来源的完整表述；标注「推测：」的判断来自编辑，不是来源陈述。