BrickBench: Evaluating Agentic Brick Design· BrickBench: 代理LEGO设计评估
We propose BrickBench, a benchmark for agentic text-conditioned LEGO-set design. Given a prompt, an agent is tasked with producing an assembly that not only satisfies semantic and design criteria, but that can also be physically built. To do so, it must select parts from a discrete library and reason jointly about local and global constraints. We score validity, alignment, and design across three settings that vary in scale and part availability. We provide BrickAgent, an environment for coding agents to construct, inspect, and validate their designs. We find that leading agents largely satisfy verifiable physical and semantic requirements, but fall short of human designs. We release our benchmark and environment at http://www.brickben.ch
提出BrickBench代理LEGO设计评估基准，检验AI生成设计的物理可行性与语义一致性。
- 核心方法
- 通过构建代理环境BrickAgent，代理需从离散部件库中选择合适部件，同时考虑局部与全局约束，生成满足条件的LEGO设计。
- 适合谁读
- 研究者
- 要解决的问题
- 评估代理在给定文本条件下的LEGO设计能力，确保设计能够满足物理建造和语义要求。
- 关键实验
- 在三个不同规模和可用部件数量的设置下对代理设计的有效性、对齐性和设计质量进行了评估。
- 主要贡献
- 建立了首个针对代理LEGO设计的评估基准BrickBench，以及配套的代理环境BrickAgent。
- 意义与局限
- 这项研究有助于推动代理设计能力的发展，但仍存在与人类设计水平差距较大的局限性。