Papers › MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing
MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing
Kai Zhang, Lingbo Mo, Wenhu Chen, Huan Sun, Yu Su
Text-guided image editing is widely needed in daily life, ranging from personal use to professional applications such as Photoshop. However, existing methods are either zero-shot or trained on an automatically synthesized dataset, which contains a high volume of noise. Thus, they still require lots of manual tuning to produce desirable outcomes in practice. To address this issue, we introduce MagicBrush (https://osu-nlp-group.github.io/MagicBrush/), the first large-scale, manually annotated dataset for instruction-guided real image editing that covers diverse scenarios: single-turn, multi-turn, mask-provided, and mask-free editing. MagicBrush comprises over 10K manually annotated triplets (source image, instruction, target image), which supports trainining large-scale text-guided image editing models. We fine-tune InstructPix2Pix on MagicBrush and show that the new model can produce much better images according to human evaluation. We further conduct extensive experiments to evaluate current image editing baselines from multiple dimensions including quantitative, qualitative, and human evaluations. The results reveal the challenging nature of our dataset and the gap between current baselines and real-world editing needs.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Image Editing | ImgEdit-Data | MagicBrush | Action | 1.22 | #9 of 9 | Archive leaderboard | report |
| Image Editing | ImgEdit-Data | MagicBrush | Add | 2.84 | #9 of 9 | Archive leaderboard | report |
| Image Editing | ImgEdit-Data | MagicBrush | Adjust | 1.58 | #9 of 9 | Archive leaderboard | report |
| Image Editing | ImgEdit-Data | MagicBrush | Background | 1.75 | #9 of 9 | Archive leaderboard | report |
| Image Editing | ImgEdit-Data | MagicBrush | Extract | 1.51 | #9 of 9 | Archive leaderboard | report |
| Image Editing | ImgEdit-Data | MagicBrush | Hybrid | 1.62 | #9 of 9 | Archive leaderboard | report |
| Image Editing | ImgEdit-Data | MagicBrush | Overall | 1.83 | #9 of 9 | Archive leaderboard | report |
| Image Editing | ImgEdit-Data | MagicBrush | Remove | 1.58 | #9 of 9 | Archive leaderboard | report |
| Image Editing | ImgEdit-Data | MagicBrush | Replace | 1.97 | #9 of 9 | Archive leaderboard | report |
| Image Editing | ImgEdit-Data | MagicBrush | Style | 2.38 | #9 of 9 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections