ai.hackcv
论文精选 65arXiv

Coupled but Late: Turn-Taking Between Full-Duplex Speech Models in Unscripted Dialogue· 全双工语音模型的对话时序

Full-duplex speech models are trained to converse with a person, but they are increasingly made to converse with each other, in self-play data generation, agent societies, and model-based evaluation. In that loop no human absorbs a timing error: each model's turn-taking is the other's input. We ask what timing the loop settles into. Two PersonaPlex-7B instances exchange audio tokens on a shared clock in unscripted conversation, and one floor-transfer rule is applied to them and to Switchboard. Their timing is coupled: re-pairing speakers across conversations destroys it. But the floor changes hands late, at a median of 400-560 ms against 137 ms for humans, and the last 120 ms of the partner's turn, where human projection places a tenth of its transfers, holds 1% of theirs. Delaying one dir

AI 解读论文

研究全双工语音模型在自由对话中的轮流说话机制。

核心方法
通过两个PersonaPlex-7B实例在共享时钟下交换音频令牌进行自由对话,并应用单一的发言权转移规则来分析其轮流说话时序。
适合谁读
研究者 / 工程师
要解决的问题
探讨全双工语音模型在相互对话时的轮流说话时序,特别是与人类对话相比是否存在延迟。
关键实验
两个PersonaPlex-7B实例之间的对话实验,比较了与Switchboard对话数据集的人类对话中的轮流说话时序。
主要贡献
揭示了两个全双工语音模型在自由对话中会耦合出特定的轮流说话时序,但相对于人类而言,模型之间的切换时间显著延迟。
意义与局限
此研究有助于理解全双工语音模型在自由对话中的行为特点,为改进模型的自然对话能力提供了依据。局限在于实验仅使用了两个特定模型实例,结果可能不具普遍性。
领域:cs.AI作者:Lichen Zhu、Yueqian Lin、Yiheng Wang
相关推荐
论文精选 65已解读

Simulated Control Evals· 模拟控制评估

Control evaluations measure whether safeguards can prevent an AI model from causing undesi…

领域:cs.AI作者:Jeffrey Olmo、David Zhang、Tyler Tracy
📎 arXiv🕒 10-23 01:26🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考