FC-Render: Adaptive Font- and Color-Aware Text Diffusion Model

Text-to-image diffusion models have made remarkable progress in generating high-quality images, but achieving fine-grained control over visual text remains a challenge. Existing methods fall short in enabling precise manipulation of font and color in visual text. To address this, we propose FC-Render, a method that introduces adaptive Font and Color control into a pre-trained TextDiffuser-2 model. Our approach consists of two stages: first, we develop independent font and color experts for decoupled control over visual text attributes. Then, we introduce an adaptive router that dynamically adjusts the involvement of each expert in font, color, or combined tasks, enabling precise fusion of font and color features. Through extensive experiments, we demonstrate that FC-Render enables fine-grained control over font and color while maintaining text rendering quality, providing new insights into the interaction between font, color, and spelling accuracy.