Frequency-Decoupled Distillation for Efficient Multimodal Recommendation

Multimodal recommender systems (MMRec) leverage multimodal features, such as visual and textual data, to improve recommendation performance, playing a key role in platforms like online shopping and short videos. However, the large modality encoders and complex processing modules of MMRec significantly reduce its efficiency. A promising solution is compressing MMRec into an ID-based MLP model (MLPRec), which has a simpler structure and avoids complex modality handling. However, traditional knowledge distillation methods struggle to transfer knowledge effectively from MMRec to MLPRec, due to differences in their model structure and capacity. To address this, we propose a frequency-decoupled knowledge distillation framework-FDRec-to efficiently transfer knowledge from MMRec to MLPRec. By analyzing graph signals from a signal processing perspective, we propose decoupling the distillation process into low-frequency and high-frequency components, ensuring effective transmission of challenging high-frequency knowledge while preventing it from being overshadowed by monotonous low-frequency signals. To address the instability and fragmentation issues of KL divergence in traditional distillation approaches, we introduce the Wasserstein distance, which captures geometric structure and provides stable gradients. Additionally, FDRec incorporates an embedding-level contrastive learning method, further enhancing the transfer of refined knowledge from MMRec and injecting graph structure information into MLPRec for more effective distillation. Extensive experiments on four benchmark datasets and five popular MMRec models show that FDRec not only significantly reduces the computational costs and improves the inference efficiency, but also achieves comparable or even superior performance compared to MMRec. Our code is available at: https://github.com/Suehn/FDRec_