Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions

arXiv cs.CV / 4/20/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper argues that many failures in instruction-guided image editing come from poor task formulation (e.g., small targets, implicit spatial relations, or ambiguous instructions) rather than insufficient model capacity.
  • It introduces an adaptive task reformulation framework that rewrites an input image-instruction pair into a sequence of operations determined at runtime.
  • A multimodal LLM (MLLM) agent performs analysis, routing, reformulation, and feedback-driven refinement to execute the generated operation sequence.
  • Experiments across multiple benchmarks (ImgEdit, PICA, and RePlan) and different editing backbones (including Qwen Image Edit and Nano Banana) show consistent improvements, with especially large gains on difficult cases.
  • The results highlight task reformulation as an important, previously underexplored factor for improving editing quality without changing the underlying model.

Abstract

Instruction guided image editing has advanced substantially with recent generative models, yet it still fails to produce reliable results across many seemingly simple cases. We observe that a large portion of these failures stem not from insufficient model capacity, but from poorly formulated editing tasks, such as those involving small targets, implicit spatial relations, or under-specified instructions. In this work, we frame image editing failures as a task formulation problem and propose an adaptive task reformulation framework that improves editing performance without modifying the underlying model. Our key idea is to transform the original image-instruction pair into a sequence of operations that are dynamically determined and executed by a MLLM agent through analysis, routing, reformulation, and feedback-driven refinement. Experiments on multiple benchmarks, including ImgEdit, PICA, and RePlan, across diverse editing backbones such as Qwen Image Edit and Nano Banana, show consistent improvements, with especially large gains on challenging cases. These results suggest that task reformulation is a critical but underexplored factor, and that substantial gains can be achieved by better matching editing tasks to the effective operating regime of existing models.