ai.hackcv
论文精选 61arXiv

Metacognition in LLMs: Foundations, Progress, and Opportunities· LLMs中的元认知:基础、进展和机遇

Metacognition is a foundational component of intelligence critical to effective learning, problem solving, decision-making, communication, and more. In recent years, it has become increasingly recognized as a cornerstone of capable, transparent AI systems. Yet while LLMs have made significant progress across diverse real-world tasks, it is not yet clear when, how, or to what extent they can exhibit or be endowed with effective metacognitive abilities, nor how such abilities can be adapted to advance the fundamental capabilities, reliability, and intelligence of AI systems. This paper bridges this gap by presenting the first comprehensive overview of the current state of knowledge on metacognition for LLMs. We analyze and taxonomize the landscape of this emerging field and summarize recent technical advancements, including methods and benchmarks to measure and evaluate LLMs' metacognitive abilities, techniques to elicit, improve, and apply metacognition in LLMs, and findings and implications of ongoing research. We also discuss applications, open questions and challenges, and promising directions for future work. Our aim is to provide a detailed and up-to-date review of this topic and stimulate meaningful research and discussion. An organized list of papers can be found at https://github.com/yale-nlp/LLM-Metacognition.

AI 解读论文

LLMs元认知综述:现状、挑战和未来方向

核心方法
论文综述了当前关于LLMs元认知的研究,分类了不同的方法和技术,并总结了用于测量、评估和提升LLMs元认知能力的基准测试和技巧。
适合谁读
研究者
要解决的问题
探讨大型语言模型(LLMs)的元认知能力,包括何时、如何以及在什么程度上能够展现这些能力,并讨论如何通过元认知提升AI的透明度、可靠性和智能水平。
关键实验
未提供
主要贡献
提供了首个关于LLMs元认知的全面综述,包含现有技术和研究发现,并指出了未来研究的开放问题和挑战。
意义与局限
意义在于推动AI系统向更加智能、透明和可靠的方向发展,但目前仍面临诸多挑战和未解问题。
领域:cs.CL作者:Gabrielle Kaili-May Liu、Areeb Gani、Jacqueline Lu
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考