FASTER: A Font-Agnostic Scene Text Editing and Rendering Framework
Scene Text Editing (STE) is a challenging research prob-lem, that primarily aims towards modifying existing texts in an image while preserving the background and the font style of the original text. Despite its utility in numerous real-world applications, existing style-transfer-based approaches have shown sub-par editing performance due to (1) complex image backgrounds, (2) diverse font attributes, and (3) varying word lengths within the text. To address such limitations, in this paper, we propose a novel font-agnostic scene text editing and rendering framework, named FASTER, for simultaneously generating text in arbitrary styles and locations while preserving a natural and realistic appearance and structure. A combined fusion of target mask generation and style transfer units, with a cascaded self-attention mech-anism has been proposed to focus on multi-level text region edits to handle varying word lengths. Extensive evaluation on a real-world database withfurther subjective human eval-uation study indicates the superiority of FASTER in both scene text editing and rendering tasks, in terms of model per-formance and efficiency. The code and pre-trained models have been released in our Gi thub repo.
Authors
- Alloy Das
- Prasun Roy (ORCID: https://orcid.org/0000-0002-1733-5670)
- Sanket Biswas (ORCID: https://orcid.org/0000-0001-6648-8270)
- Josep Lladós (ORCID: https://orcid.org/0000-0002-4533-4739)
- Umapada Pal (ORCID: https://orcid.org/0000-0002-5426-2618)
- Saumik Bhattacharya (ORCID: https://orcid.org/0000-0003-1273-7969)
- Subhankar Ghosh (ORCID: https://orcid.org/0000-0003-3242-3406)
- Michael Blumenstein
Institutions
- University of Technology Sydney (AU)
- Universitat Autònoma de Barcelona (ES)
- Indian Institute of Technology Kharagpur (IN)
- Indian Statistical Institute (IN)
Publication Details
- Published
- 2025-02-26
- DOI
- https://doi.org/10.1109/wacv61041.2025.00196
- Primary Topic
- Video Analysis and Summarization
- Type
- article
- Field-Weighted Citation Impact
- 0.00