Transformer-Based Multimodal Framework for Music Similarity Analysis and Recommendation Systems

Modern music streaming platforms offer vast catalogs and personalized discovery experiences. Nevertheless, current music recommendation systems often overemphasize popular content and fail to capture complex user preferences or support the exploration of niche genres. This paper addresses these limitations by proposing a deep learning–based multimodal recommendation framework that leverages transformer architectures to analyze audio signals and contextual metadata. The goal is to enhance music similarity modeling and recommendation accuracy by generating enriched embeddings that capture musical structure, instrumentation, and genre subtleties. The research introduces a system that combines audio-based features with metadata through a fusion strategy informed by attention mechanisms. The methodology includes large-scale experimentation on public music datasets and evaluation using standard recommendation quality metrics. Results demonstrate improved personalization and diversity in recommendations compared to baseline models. This work contributes to the field by providing a novel multimodal architecture and demonstrating the effectiveness of audio-content-aware recommendation strategies.

Authors

Publication Details

Published
2025-05-14
DOI
https://doi.org/10.23919/fruct65909.2025.11008194
Citations
1
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
1.49
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transformer-Based Multimodal Framework for Music Similarity Analysis and Recommendation Systems

Mikhail Rumiantcev
1 citations
Music and Audio Processing
1.49
article

Transformer-Based Multimodal Framework for Music Similarity Analysis and Recommendation Systems

Mikhail Rumiantcev
article en
1 citations

Abstract

Modern music streaming platforms offer vast catalogs and personalized discovery experiences. Nevertheless, current music recommendation systems often overemphasize popular content and fail to capture complex user preferences or support the exploration of niche genres. This paper addresses these limitations by proposing a deep learning–based multimodal recommendation framework that leverages transformer architectures to analyze audio signals and contextual metadata. The goal is to enhance music similarity modeling and recommendation accuracy by generating enriched embeddings that capture musical structure, instrumentation, and genre subtleties. The research introduces a system that combines audio-based features with metadata through a fusion strategy informed by attention mechanisms. The methodology includes large-scale experimentation on public music datasets and evaluation using standard recommendation quality metrics. Results demonstrate improved personalization and diversity in recommendations compared to baseline models. This work contributes to the field by providing a novel multimodal architecture and demonstrating the effectiveness of audio-content-aware recommendation strategies.

Openalex Percentile: Top 19%
Music and Audio Processing
1.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Transformer-Based Multimodal Framework for Music Similarity Analysis and Recommendation Systems — Mikhail Rumiantcev · (2025) | TGRS Research Map | TGRS