End-to-end Automatic Music Transcription of Polyphonic Music Using Convolutional Neural Networks

This paper presents an automatic music transcription model based on Convolutional Neural Networks (CNNs) that mimics the “trained ear” in music recognition. The approach pushes forward the fields of signal processing and music technology, with a focus on multi-instrument transcription featuring traditional Turkish instruments like the Qanun and Oud, known for their distinct timbral qualities and early decay characteristics. The study involves creating multipitch datasets from very basic combinations, training the CNN on this data, and achieving high transcription accuracy considering the F1 scores for two-part compositions. The training process equips the model to understand the fundamental traits of individual instruments, enabling it to identify and separate complex patterns in mixed audio. The aim is to enhance the model’s ability to distinguish and analyze specific musical elements, supporting applications in music production, audio engineering, and music education.

Authors

Institutions

Publication Details

Published
2024-12-06
DOI
https://doi.org/10.1109/isas64331.2024.10845524
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

End-to-end Automatic Music Transcription of Polyphonic Music Using Convolutional Neural Networks

Emin Germen, Can Karadoğan
Music and Audio Processing
article

End-to-end Automatic Music Transcription of Polyphonic Music Using Convolutional Neural Networks

Emin Germen, Can Karadoğan
article en

Abstract

This paper presents an automatic music transcription model based on Convolutional Neural Networks (CNNs) that mimics the “trained ear” in music recognition. The approach pushes forward the fields of signal processing and music technology, with a focus on multi-instrument transcription featuring traditional Turkish instruments like the Qanun and Oud, known for their distinct timbral qualities and early decay characteristics. The study involves creating multipitch datasets from very basic combinations, training the CNN on this data, and achieving high transcription accuracy considering the F1 scores for two-part compositions. The training process equips the model to understand the fundamental traits of individual instruments, enabling it to identify and separate complex patterns in mixed audio. The aim is to enhance the model’s ability to distinguish and analyze specific musical elements, supporting applications in music production, audio engineering, and music education.

Eskisehir Technical University (TR), Istanbul Technical University (TR)
Openalex Percentile: Top 71%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.