ai.hackcv
论文精选 65arXiv

Value-Rich, Differently Organized: Measuring Value Expression and Organization in AI-Generated Debates· 价值丰富,组织不同:评估AI生成辩论的价值观

Current evaluation of LLM-generated debate largely focuses on argumentative quality, leaving the value structure of generated arguments underexamined. We introduce a diagnostic metric framework for comparing how values are expressed and organized in human-reference and AI-generated debates. The framework separates value expression, the range of recognizable values a debate invokes, from value organization, how those values are distributed and sustained across turns. Grounded in Schwartz's Basic-10 value theory, it represents debates as multi-level value distributions over argumentative units, utterances, stances, and full debates, enabling metrics for value coverage, alignment, diffusion, and cross-turn dynamics. Across multiple generation systems, AI-generated debates are broadly value-ex

AI 解读论文

评估AI生成辩论中价值观的表达与组织

核心方法
引入基于Schwartz's Basic-10价值理论的诊断度量框架,评估价值覆盖、对齐、扩散及跨轮次动态
适合谁读
研究者、工程师
要解决的问题
现有LLM生成辩论的评估主要集中在论证质量上,而对价值观结构的评估不足
关键实验
跨多个生成系统对AI生成辩论进行了评估,未提供具体实验细节
主要贡献
提供了一套评估AI生成辩论中价值观表达和组织的新方法
意义与局限
有助于更全面地理解AI生成辩论的质量,但可能受限于理论模型的选择
领域:cs.AI作者:Maoyuan Li、Haoyuan Li、Zhongsheng Wang
相关推荐
论文精选 65已解读

Simulated Control Evals· 模拟控制评估

Control evaluations measure whether safeguards can prevent an AI model from causing undesi…

领域:cs.AI作者:Jeffrey Olmo、David Zhang、Tyler Tracy
📎 arXiv🕒 10-23 01:26🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考