Language models can notice an impossible engineering problem yet still report it as solved· 语言模型可能错误解答不可能的工程问题
Language models draft engineering calculations, but answer accuracy does not show whether they reject an impossible problem. We tested 14 models on 30 pairs of mechanics problems, each with a valid version and one made impossible by changing a given value or assumption. Two independent solvers verified every answer key and showed that each flawed problem was physically impossible. We scored solving of valid problems separately from rejection of their flawed counterparts. Each reply required a "solved" or "cannot solve" status; rejection meant "cannot solve" or withholding an answer. The initial prompts did not warn that problems could be flawed. Across three recent models, 12 of 90 replies failed to reject a flawed problem. In 11 of these replies, the model stated the flaw, answered a corr
语言模型可能未能识别并拒绝不可解的工程问题。
- 核心方法
- 测试了14种语言模型在30对机械问题上的表现，每对问题包括一个有效版本和一个通过改变给定值或假设而变得不可能的问题版本。
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 现有的语言模型在处理工程问题时，可能会错误地给出解决方案，而不是识别问题的不可解性。
- 关键实验
- 实验包括30对机械问题的测试，每对问题中有一个有效版本和一个不可能版本，共14个模型参与测试。
- 主要贡献
- 提出了一种评估语言模型处理不可能问题能力的方法，并发现了一些模型在该任务上的不足。
- 意义与局限
- 研究揭示了语言模型在工程问题解决中的潜在风险，强调了模型识别不可解问题能力的重要性。