SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions· 从论文修订学习编辑科学图表
Editing the figures in a research paper is a routine and time-consuming part of everyday research practice: authors relabel components, rearrange panels, and restyle visuals as they revise their manuscripts. Automating this editing workflow under a natural-language instruction, however, is challenging, because a scientific figure is a dense infographic in which heterogeneous visual elements such as schematics, plots, photos, captions, and arrows are composed under a tight visual grammar to advance a specific argument. To address this, we present SciDiagramEdit, a benchmark and skill-evolution framework that learns from natural paper revisions and operates on the figure's editable vector source, where users can inspect and co-edit individual primitives alongside the agent. Our benchmark mines before/after figure pairs from arXiv version histories, each grounded in the authors' own revision intent. To accommodate the diversity of editing instructions, we adopt agentic learning via skill evolution: an agentic proposer continually refines the agent's skill specification from execution traces over multiple epochs. The resulting skill progressively lifts edit accuracy on a held-out validation set, providing evidence that natural paper revisions are an effective training signal for instruction-driven figure editing.
从论文修订学习科学图表编辑的自动化方法
- 核心方法
- 提出了SciDiagramEdit框架,通过挖掘arXiv论文修订历史中的图表变化对,学习不同编辑指令下对科学图表的自动编辑。
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 科学论文中的图表编辑是一项繁琐且耗时的工作,需要自动化以提高效率。
- 关键实验
- 实验展示了方法在保持验证集编辑准确性上的有效进步,证明自然论文修订是有效的训练信号。
- 主要贡献
- 创建了一个新的基准和技能进化框架,能够基于自然语言指令自动编辑科学图表。
- 意义与局限
- 该研究为科研工作者提供了高效的图表编辑工具,但可能在复杂图表编辑任务上仍有限制。