Do AI Agents Know When a Task Is Simple? Toward Complexity-Aware Reasoning and Execution· AI代理知道任务何时简单吗?
Large language model (LLM) agents increasingly automate multi-step engineering and informatics workflows, yet they rarely ask how much effort a task actually requires. They often follow a maximum-context-first strategy--re-reading files and dependencies they have already seen--turning a one-line edit into a small code-base audit. We argue the missing capability is task-aware execution-scope estimation: judging a task's difficulty, the information it truly needs, and the shortest reliable path before committing budget. We formalize minimum-sufficient execution and the Agent Cognitive Redundancy Ratio (ACRR), and propose E3 (Estimate, Execute, Expand): the agent estimates an initial operating point, executes a minimum viable path, and expands scope only when verification fails. On MSE-Bench--a deterministic benchmark of 121 edits in a capability-controlled simulator--E3 matches the strongest baseline's 100% success while cutting cost by 85%, tokens by 91%, and inspected files by 92%, and further beats a strong adaptive retrieval baseline by 16%; the gains survive held-out instruction wording and essentially every cost weighting. A companion real-model harness (LLM-Case) corroborates the effect on a live gpt-4o agent editing a real open-source library, with every candidate patch graded by actually running the project's real pytest suite against a measured oracle: the over-reading is milder but real, and E3 is the leanest and fastest policy at comparable task success--its one shortfall a provider rate-limit, not a wrong edit. We frame this as a controlled probe of execution redundancy, not a measurement of any deployed agent, and position task-aware execution as a step toward engineering-grounded AI (EGAI)--agents whose effort is anchored in the engineering reality of the task. We release the framework and benchmark.
研究提出E3方法,使AI代理能智能判断任务复杂度,高效执行。
- 核心方法
- 提出E3(Estimate, Execute, Expand)方法,先估算任务的初始操作点,执行最小可行路径,仅在验证失败时扩大执行范围。
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 现有AI代理在执行任务时,无法有效判断任务的真正需求及复杂度,导致资源浪费。
- 关键实验
- 在MSE-Bench(121个编辑任务的确定性基准)上验证E3方法,与现有最強基线相比,成本、token使用量和文件检查量均大幅减少;并在真实模型LLM-Case上进行了测试。
- 主要贡献
- 减少了85%的成本、91%的token使用量和92%的文件检查,同时保持了任务的成功率。
- 意义与局限
- 提高AI执行任务的效率和经济效益,减少不必要的计算资源消耗;有助于发展基于工程现实的AI代理。