Undersökning av ljud-till-MIDI-transkriptionsgeneralisering : Utvärdering av en pianotranskriptionsmodell på gitarr

Automatic Music Transcription (AMT) systems are typically trained on specific instruments, raising questions about their ability to generalize across instruments with differing acoustic properties and playing techniques. This study investigates how well the MT3 model—originally trained for piano transcription—performs on acoustic guitar recordings. Using the GuitarSet dataset, we evaluate transcription accuracy through Onset F1 and Onset & Offset F1 scores. The results reveal a substantial performance gap: while MT3 achieves high accuracy on piano (Onset F1: 95.95%; Onset & Offset F1: 83.46%), its performance drops considerably for guitar (Onset F1: 57.00%; Onset & Offset F1: 16.94%). This decline does not correlate strongly with polyphony or note duration, suggesting that the underlying cause lies in differences in timbre and articulation between piano and guitar. Further analysis of monophonic excerpts reveals the model’s tendency to produce spurious notes, likely due to its sensitivity to transient, guitar-specific sounds such as string noise, which differ from the more percussive nature of piano onsets. These findings highlight the limitations of cross-instrument generalization in AMT and point to the need for instrument-specific adaptation—whether through model fine-tuning, architectural changes, or more diverse training data. Future work could explore adaptation strategies, incorporate note velocity information, analyze the effect of spectral differences and extend evaluations to additional instruments such as electric guitar to improve the generalizability of AMT systems.

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Undersökning av ljud-till-MIDI-transkriptionsgeneralisering : Utvärdering av en pianotranskriptionsmodell på gitarr

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Music and Audio Processing
article

Undersökning av ljud-till-MIDI-transkriptionsgeneralisering : Utvärdering av en pianotranskriptionsmodell på gitarr

article en

Abstract

Automatic Music Transcription (AMT) systems are typically trained on specific instruments, raising questions about their ability to generalize across instruments with differing acoustic properties and playing techniques. This study investigates how well the MT3 model—originally trained for piano transcription—performs on acoustic guitar recordings. Using the GuitarSet dataset, we evaluate transcription accuracy through Onset F1 and Onset & Offset F1 scores. The results reveal a substantial performance gap: while MT3 achieves high accuracy on piano (Onset F1: 95.95%; Onset & Offset F1: 83.46%), its performance drops considerably for guitar (Onset F1: 57.00%; Onset & Offset F1: 16.94%). This decline does not correlate strongly with polyphony or note duration, suggesting that the underlying cause lies in differences in timbre and articulation between piano and guitar. Further analysis of monophonic excerpts reveals the model’s tendency to produce spurious notes, likely due to its sensitivity to transient, guitar-specific sounds such as string noise, which differ from the more percussive nature of piano onsets. These findings highlight the limitations of cross-instrument generalization in AMT and point to the need for instrument-specific adaptation—whether through model fine-tuning, architectural changes, or more diverse training data. Future work could explore adaptation strategies, incorporate note velocity information, analyze the effect of spectral differences and extend evaluations to additional instruments such as electric guitar to improve the generalizability of AMT systems.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Openalex Percentile: Top 43%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Undersökning av ljud-till-MIDI-transkriptionsgeneralisering : Utvärdering av en pianotranskriptionsmodell på gitarr · KTH Publication Database DiVA (KTH Royal Institute of Technology) (2025) | TGRS Research Map | TGRS