ai.hackcv
论文精选 65arXiv

Reason-Mediated Behavioral Models for Auditing LLM Social Simulators· 理由中介的行为模型对LLM社会模拟器的审计

Large language models are increasingly used as social simulators, including as synthetic survey respondents. Most evaluations ask whether simulated outcomes resemble human outcomes. We argue that this is necessary but too weak: a simulator can match the final answer while using the wrong rationale-derived reason pattern. We study this problem through a 94-person sunscreen concept test in which each respondent evaluated three product concepts and wrote open-ended rationales. We map those rationales into signed reason states $Z$, where positive signs support adoption and negative signs block it. This gives a practical audit: holding respondent descriptors $D$, category context $K$, and concept treatment $X$ fixed, do human rationale-derived reasons help predict behavior $Y$, and can an LLM s

AI 解读论文

评估LLM社会模拟器的合理性而非仅结果相似性

核心方法
通过94人的防晒产品概念测试,将开放式理由映射为带符号的理由状态$Z$,研究LLM的理由模式是否能预测人类行为
适合谁读
研究者、工程师
要解决的问题
现有评估方法仅关注LLM模拟结果与人类行为是否相似,忽视了理由模式的正确性
关键实验
94人的防晒产品概念测试,包含三个产品概念及开放式理由写作
主要贡献
提出了一种基于理由模式的LLM社会模拟器审计方法,提高了评估的全面性和准确性
意义与局限
该方法有助于更深入地理解LLM在社会模拟中的表现,但可能需要更多的数据和领域验证
领域:cs.AI作者:Atharva Pandey、Gautam Jajoo
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考