AI-Driven Personalized Multisensory Design of Cultural Heritage: A Case Study of Kunqu Opera

With the evolution of global cultural consumption habits, the influence of traditional cultural heritage in contemporary society has gradually diminished. While Kunqu opera is highly regarded for its profound cultural value, its international influence remains limited due to changes in modern cultural consumption habits, language barriers, and the constraints of traditional dissemination methods. To enhance the appeal and impact of traditional culture in modern society, this study takes Kunqu opera, a Chinese intangible cultural heritage, as a case study and explores AI-driven personalized multisensory design strategies. By integrating artificial intelligence technologies, the study aims to create multisensory interactive experiences that engage users’ visual and auditory senses, enabling them to perceive the charm of Kunqu opera, stimulate emotional resonance, and enhance the effectiveness of personalized cultural transmission.This paper proposes a multi-layered design framework that encompasses user data analysis, personalized customization, and multisensory content generation. The study employs AI to deeply analyze and generate the artistic elements and cultural connotations of Kunqu opera. In an innovative approach, it presents Kunqu stories in the form of an animated audio comic, using popular music to express the opera's melodious and delicate vocal style and elegant poetry, while employing a fresh comic style to depict the intricate designs of Kunqu costumes, such as flowing sleeves, fans, and detailed makeup. This transformation of Kunqu's classic performances into dynamic audio-visual experiences allows users to engage interactively and appreciate the opera’s unique charm. On the visual front, generative adversarial networks (GANs) are used to reconstruct Kunqu costumes, stage settings, and performance actions; on the auditory front, deep learning algorithms are applied to perform style transfer and synthesis of traditional singing and music.This research aims to provide new insights for the protection and dissemination of cultural heritage through the AI-driven recreation of Kunqu opera, ultimately enhancing its international recognition and acceptance.

Authors

Publication Details

Journal
AHFE international
Published
2025-01-01
DOI
https://doi.org/10.54941/ahfe1006060
Primary Topic
3D Surveying and Cultural Heritage
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-Driven Personalized Multisensory Design of Cultural Heritage: A Case Study of Kunqu Opera

Jie Zhou, Tián Céng
AHFE international
3D Surveying and Cultural Heritage
article

AI-Driven Personalized Multisensory Design of Cultural Heritage: A Case Study of Kunqu Opera

Jie Zhou, Tián Céng
article en

Abstract

With the evolution of global cultural consumption habits, the influence of traditional cultural heritage in contemporary society has gradually diminished. While Kunqu opera is highly regarded for its profound cultural value, its international influence remains limited due to changes in modern cultural consumption habits, language barriers, and the constraints of traditional dissemination methods. To enhance the appeal and impact of traditional culture in modern society, this study takes Kunqu opera, a Chinese intangible cultural heritage, as a case study and explores AI-driven personalized multisensory design strategies. By integrating artificial intelligence technologies, the study aims to create multisensory interactive experiences that engage users’ visual and auditory senses, enabling them to perceive the charm of Kunqu opera, stimulate emotional resonance, and enhance the effectiveness of personalized cultural transmission.This paper proposes a multi-layered design framework that encompasses user data analysis, personalized customization, and multisensory content generation. The study employs AI to deeply analyze and generate the artistic elements and cultural connotations of Kunqu opera. In an innovative approach, it presents Kunqu stories in the form of an animated audio comic, using popular music to express the opera's melodious and delicate vocal style and elegant poetry, while employing a fresh comic style to depict the intricate designs of Kunqu costumes, such as flowing sleeves, fans, and detailed makeup. This transformation of Kunqu's classic performances into dynamic audio-visual experiences allows users to engage interactively and appreciate the opera’s unique charm. On the visual front, generative adversarial networks (GANs) are used to reconstruct Kunqu costumes, stage settings, and performance actions; on the auditory front, deep learning algorithms are applied to perform style transfer and synthesis of traditional singing and music.This research aims to provide new insights for the protection and dissemination of cultural heritage through the AI-driven recreation of Kunqu opera, ultimately enhancing its international recognition and acceptance.

AHFE internationalVol. 164
Openalex Percentile: Top 78%
3D Surveying and Cultural Heritage
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.