Can AI Read Sheet Music Like Human Beings?
In this paper, we propose a machine learning model to predict tempo using sheet music alone. The model estimates tempo in a manner analogous to how humans interpret affective and contextual information in sheet music. To construct the dataset for training, we invited wind instrumentalists to provide tempo annotations. After applying data augmentation techniques, the model was trained and evaluated through experiments. The results show that for the training data, 98.0% of the predicted tempo values deviated by less than 10 from the expected values. For the validation data, this percentage was approximately 62.1%. Notably, sheet music with significant tempo deviations is difficult to judge, even for human instrumentalists. Overall, the model demonstrated the ability to predict tempo from sheet music, achieving performance comparable to that of a beginner instrumentalist.
Authors
- Hitoaki Yoshida
- Satoshi KAWAMURA
- Katsushi USHIWATA
- Ken’ichi WATANABE
- Takeshi Murakami (ORCID: https://orcid.org/0000-0002-3189-3265)
- Zhongda LIU
- Masanori HASEGAWA
Institutions
- Hokkaido University of Education (JP)
- Iwate University (JP)
- Ishinomaki Senshu University (JP)
- Doshisha Women's College of Liberal Arts (JP)
- Joetsu University of Education (JP)
Publication Details
- Journal
- International Symposium on Affective Science and Engineering
- Published
- 2025-01-01
- DOI
- https://doi.org/10.5057/isase.2025-c000009
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Japan Society for the Promotion of Science