Homophonic Music Composition Using a GAN and LSTM Pipeline for Melody and Harmony Generation

Over the years, various efforts have been made to create music using procedural methods. However, few of these attempts have focused on generating structured music with melodies and chords that naturally complement each other. This research aims to develop a pipeline of neural networks to produce homophonic music, including a melody and accompanying chords, without external input. The goal is for the generated music to feature a natural-sounding melody with harmonies that provide structural coherence, akin to the approach of a human composer. To enhance the quality of the generated music, the research employs a Generative Adversarial Network (GAN) for melody generation and a hierarchical Long Short-Term Memory (LSTM) network for harmony generation. The GAN is used to produce melodies that exhibit natural motifs and variations, while the hierarchical LSTM is utilized to generate chord progressions that contextually support and enrich the melodies. This step-by-step approach ensures that the generated music is both structurally sound and expressive. By focusing on naturalness and consistency in music, this research aims to closely mimic human creativity. The symbolic models used are unconstrained by specific musical guidelines, allowing for the procedural generation of music that closely resembles human composition.

Authors

Institutions

Publication Details

Published
2024-12-11
DOI
https://doi.org/10.1109/ism63611.2024.00024
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Homophonic Music Composition Using a GAN and LSTM Pipeline for Melody and Harmony Generation

Clément Saint-Marc, Katunobu Itou
Music and Audio Processing
article

Homophonic Music Composition Using a GAN and LSTM Pipeline for Melody and Harmony Generation

Clément Saint-Marc, Katunobu Itou
article en

Abstract

Over the years, various efforts have been made to create music using procedural methods. However, few of these attempts have focused on generating structured music with melodies and chords that naturally complement each other. This research aims to develop a pipeline of neural networks to produce homophonic music, including a melody and accompanying chords, without external input. The goal is for the generated music to feature a natural-sounding melody with harmonies that provide structural coherence, akin to the approach of a human composer. To enhance the quality of the generated music, the research employs a Generative Adversarial Network (GAN) for melody generation and a hierarchical Long Short-Term Memory (LSTM) network for harmony generation. The GAN is used to produce melodies that exhibit natural motifs and variations, while the hierarchical LSTM is utilized to generate chord progressions that contextually support and enrich the melodies. This step-by-step approach ensures that the generated music is both structurally sound and expressive. By focusing on naturalness and consistency in music, this research aims to closely mimic human creativity. The symbolic models used are unconstrained by specific musical guidelines, allowing for the procedural generation of music that closely resembles human composition.

Hosei University (JP)
Openalex Percentile: Top 68%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.