Value-Rich, Differently Organized: Measuring Value Expression and Organization in AI-Generated Debates· 价值丰富,组织不同:评估AI生成辩论的价值观
Current evaluation of LLM-generated debate largely focuses on argumentative quality, leaving the value structure of generated arguments underexamined. We introduce a diagnostic metric framework for comparing how values are expressed and organized in human-reference and AI-generated debates. The framework separates value expression, the range of recognizable values a debate invokes, from value organization, how those values are distributed and sustained across turns. Grounded in Schwartz's Basic-10 value theory, it represents debates as multi-level value distributions over argumentative units, utterances, stances, and full debates, enabling metrics for value coverage, alignment, diffusion, and cross-turn dynamics. Across multiple generation systems, AI-generated debates are broadly value-ex
评估AI生成辩论中价值观的表达与组织
- 核心方法
- 引入基于Schwartz's Basic-10价值理论的诊断度量框架,评估价值覆盖、对齐、扩散及跨轮次动态
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 现有LLM生成辩论的评估主要集中在论证质量上,而对价值观结构的评估不足
- 关键实验
- 跨多个生成系统对AI生成辩论进行了评估,未提供具体实验细节
- 主要贡献
- 提供了一套评估AI生成辩论中价值观表达和组织的新方法
- 意义与局限
- 有助于更全面地理解AI生成辩论的质量,但可能受限于理论模型的选择