Can AI Read Sheet Music Like Human Beings?

In this paper, we propose a machine learning model to predict tempo using sheet music alone. The model estimates tempo in a manner analogous to how humans interpret affective and contextual information in sheet music. To construct the dataset for training, we invited wind instrumentalists to provide tempo annotations. After applying data augmentation techniques, the model was trained and evaluated through experiments. The results show that for the training data, 98.0% of the predicted tempo values deviated by less than 10 from the expected values. For the validation data, this percentage was approximately 62.1%. Notably, sheet music with significant tempo deviations is difficult to judge, even for human instrumentalists. Overall, the model demonstrated the ability to predict tempo from sheet music, achieving performance comparable to that of a beginner instrumentalist.

Authors

Institutions

Publication Details

Journal
International Symposium on Affective Science and Engineering
Published
2025-01-01
DOI
https://doi.org/10.5057/isase.2025-c000009
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Can AI Read Sheet Music Like Human Beings?

Hitoaki Yoshida, Satoshi KAWAMURA, Katsushi USHIWATA, Ken’ichi WATANABE et al.
International Symposium on Affective Science and Engineering
Music and Audio Processing
article

Can AI Read Sheet Music Like Human Beings?

Hitoaki Yoshida, Satoshi KAWAMURA, Katsushi USHIWATA, Ken’ichi WATANABE, Takeshi Murakami, Zhongda LIU, Masanori HASEGAWA
article en

Abstract

In this paper, we propose a machine learning model to predict tempo using sheet music alone. The model estimates tempo in a manner analogous to how humans interpret affective and contextual information in sheet music. To construct the dataset for training, we invited wind instrumentalists to provide tempo annotations. After applying data augmentation techniques, the model was trained and evaluated through experiments. The results show that for the training data, 98.0% of the predicted tempo values deviated by less than 10 from the expected values. For the validation data, this percentage was approximately 62.1%. Notably, sheet music with significant tempo deviations is difficult to judge, even for human instrumentalists. Overall, the model demonstrated the ability to predict tempo from sheet music, achieving performance comparable to that of a beginner instrumentalist.

International Symposium on Affective Science and EngineeringVol. ISASE2025(0)
Hokkaido University of Education (JP), Iwate University (JP), Ishinomaki Senshu University (JP), Doshisha Women's College of Liberal Arts (JP), Joetsu University of Education (JP)
Japan Society for the Promotion of Science
Openalex Percentile: Top 87%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Can AI Read Sheet Music Like Human Beings? — Hitoaki Yoshida, Satoshi KAWAMURA, et al. · International Symposium on Affective Science and Engineering (2025) | TGRS Research Map | TGRS