Reinforcing Agentic Creativity in Scientific Ideation with Night Science· AI Night-Scientist: 强化代理创造力
Large language models (LLMs) excel at structured, verifiable tasks, but their low-entropy bias can produce homogeneous and predictable outputs, limiting their utility for open-ended scientific ideation. Effective discovery, however, spans a broader creative spectrum: from structured day science to loosely structured, serendipitous night science that reaches ideas beyond those typically considered. We introduce AI Night-Scientist, an agentic framework that uses reinforcement learning to teach models when and how to depart from predictable reasoning. Grounded in cognitive science, we model creativity along three axes: action (what to do and how creatively), process (when to explore versus exploit), and outcome (the novelty and usefulness of the resulting idea). We use these axes to train mod
使用强化学习框架增强大型语言模型的创造力,以促进科学创意的开放性探索。
- 核心方法
- 开发了AI Night-Scientist框架,基于认知科学的创意三轴模型(行动、过程、结果),通过强化学习教导模型如何和何时偏离可预测的推理。
- 适合谁读
- 研究者
- 要解决的问题
- 大型语言模型在开放性科学创意生成中因低熵偏差而产生的输出过于同质化和可预测,限制了其效用。
- 关键实验
- 未提供
- 主要贡献
- 提出了一种新的框架,能够有效增加大型语言模型生成内容的多样性与创造性,特别适用于科学创意的产生。
- 意义与局限
- 此框架有助于拓宽科学发现的创造性范围,但其效果和通用性仍需进一步验证。