UDP-Edit: Union Dual-Prompt Attention for Local Image Editing in Fast Diffusion Models
Fast-sampling diffusion models have become prominent in text-to-image editing due to their significantly reduced inference time. However, achieving precise local edits with these models remains challenging. For example, altering a teddy bear to a wooden bear should affect only the object, not the background. Prior approaches fail to balance precision and efficiency, often resulting in either global changes or slow inference. In this paper, we propose UDP-Edit, a union dual-prompt cross-attention editing framework for controlled local editing under fast diffusion sampling. UDP-Edit merges cross-attention maps from both source and target prompts to generate a soft semantic mask. This mask constrains edits to relevant regions, preserving global structure while enabling localized transformation. Experiments demonstrate that UDP-Edit achieves accurate local edits and preserves sampling efficiency, validated through both qualitative and quantitative metrics.
Authors
- Van Kiet Nguyen
- Ngan Luu-Thuy Nguyen (ORCID: https://orcid.org/0000-0003-3931-849X)
- Duy-Dinh Le (ORCID: https://orcid.org/0000-0003-0356-5501)
- Vinh-Tiep Nguyen (ORCID: https://orcid.org/0000-0003-4260-7874)
- Thanh Duc Ngo (ORCID: https://orcid.org/0000-0001-6882-0070)
- Trong-Tai Dam Vu (ORCID: https://orcid.org/0009-0005-1549-989X)
Publication Details
- Published
- 2025-08-14
- DOI
- https://doi.org/10.1109/mapr67746.2025.11133898
- Primary Topic
- Stochastic Gradient Optimization Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00