ai.hackcv
论文精选 60arXiv

Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillation· Rubric-CEPR: 基于奖励验证的自蒸馏图像编辑

Instruction-guided image editors have become highly capable, yet improving them further still depends on human-edited training pairs or external reward models. Such supervision is costly to obtain and can reward plausible failures: a realistic output may leave the requested change undone or alter content that should be preserved. In this work, we strive to improve a pretrained image editor using only its own generations, without human-edited targets or an external training-time reward model. To this end, we propose a self-evolving framework, named Rubric-CEPR, that verifies the editor's own samples with its internal representations through a rubric-augmented Contrastive Edit-Preservation Reward (CEPR). A Planner proposes structured edit instructions from unlabeled images, the Editor samples multiple candidate edits, and a frozen Critic scores each candidate with decomposed rubric checks for edit realization, removal of the old state, and content preservation, using features already exposed by the editor. Non-compensatory gates reject infeasible candidates, and the best verified candidate is distilled into the editor through lightweight adapter training. On Qwen-Image-Edit, Rubric-CEPR improves ImgEdit from 4.36 to 4.60 (+5.5%), with a +24.9% gain on object isolation, and transfers to GEdit-Bench and Complex-Edit. The same procedure also improves Step1X-Edit by +7.8% on ImgEdit. We hope our approach will serve as a solid baseline for image editors that improve themselves from their own verified samples. Our code is publicly available at $\href{https://riteshthawkar.github.io/Rubric-CEPR/}{\text{this URL}}$

AI 解读论文

无需人工标注或外部奖励模型,通过自蒸馏提升图像编辑精度。

核心方法
提出Rubric-CEPR框架,利用自生成样本和内部表示进行对比编辑保护奖励计算,通过规划器、编辑器和冻结的评分器实现自进化。
适合谁读
研究者、工程师
要解决的问题
现有的图像编辑模型依赖于成本高昂的人工标注数据或外部奖励模型,可能导致编辑不准确或内容破坏。
关键实验
在Qwen-Image-Edit、GEdit-Bench和Complex-Edit等数据集上验证了模型性能,结果表明ImgEdit和Step1X-Edit在图像编辑任务上均有显著提升。
主要贡献
在Qwen-Image-Edit等数据集上显著提升图像编辑性能,特别是在对象隔离方面,同时可迁移至其他编辑任务。
意义与局限
减少了对昂贵标注数据和外部奖励模型的依赖,推动了自进化图像编辑技术的发展,但可能在极端编辑任务上表现有限。
领域:cs.CV作者:Ritesh Thawkar、Shubham Patle、Shravan Venkatraman
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考