Diffusion Models for Automatic Music Mixing

Music mixing is a process that involves fine-tuning the levels, dynamics, and frequency content of musical elements to ensure clarity and harmony in the final music production. In this paper, we present an automatic mixing system based on diffusion models to correct imbalances in music mixes. We manipulate the well mixed stems’ short-time Fourier transform randomly to simulate the frequency and level imbalances commonly encountered in real-world scenarios. The difference between the imbalanced mix and the original mix is treated as noise for the diffusion model to predict, enabling the reverse denoising process to generate an automated mix. We evaluate our model’s performance by calculating the signal-to-distortion ratio between the original and predicted mixes. These results are compared with baseline automatic mixing models, demonstrating significant improvements. Test set results in audio: https://aimg2025submission.github.io/diffmusicmix/