Emotion guided multi scale feature fusion for Qinqiang Opera video restoration

As an important form of China’s intangible cultural heritage, Qinqiang Opera relies on precise facial expression to convey artistic meaning. Conventional video restoration methods often neglect emotion-sensitive regions, leading to loss of expressive detail. We propose an emotion-guided restoration framework that extracts temporal emotion tone vectors from audio using an enhanced MHAtt_ResNet model, and integrates them into the restoration stage through an Emotion-Gated Module and Cross-Stage Feature Fusion. Further, an Emotion-Driven Temporal Aggregation Module with a denoising subnetwork restores facial dynamics under noise. Experiments on Qinqiang videos show that our method achieves superior PSNR, SSIM, MOS, as well as lower temporal metrics (tOF, TGMSD), compared with EDVR, BasicVSR + +, FastDVDnet, UHDVD, and TACE. The model restores subtle facial details while maintaining smooth temporal coherence, significantly improving artistic fidelity. This work provides a technically advanced and culturally adaptive solution for digital preservation of performance heritage.

Authors

Institutions

Publication Details

Journal
npj Heritage Science
Published
2025-11-08
DOI
https://doi.org/10.1038/s40494-025-02134-7
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Emotion guided multi scale feature fusion for Qinqiang Opera video restoration

Tian Xia, Kaiyue Yang, Xiaojun Liu, Yili Yuan et al.
npj Heritage Science
Generative Adversarial Networks and Image Synthesis
article

Emotion guided multi scale feature fusion for Qinqiang Opera video restoration

Tian Xia, Kaiyue Yang, Xiaojun Liu, Yili Yuan, Banyang Qi
article en

Abstract

As an important form of China’s intangible cultural heritage, Qinqiang Opera relies on precise facial expression to convey artistic meaning. Conventional video restoration methods often neglect emotion-sensitive regions, leading to loss of expressive detail. We propose an emotion-guided restoration framework that extracts temporal emotion tone vectors from audio using an enhanced MHAtt_ResNet model, and integrates them into the restoration stage through an Emotion-Gated Module and Cross-Stage Feature Fusion. Further, an Emotion-Driven Temporal Aggregation Module with a denoising subnetwork restores facial dynamics under noise. Experiments on Qinqiang videos show that our method achieves superior PSNR, SSIM, MOS, as well as lower temporal metrics (tOF, TGMSD), compared with EDVR, BasicVSR + +, FastDVDnet, UHDVD, and TACE. The model restores subtle facial details while maintaining smooth temporal coherence, significantly improving artistic fidelity. This work provides a technically advanced and culturally adaptive solution for digital preservation of performance heritage.

npj Heritage ScienceVol. 13(1)
Xi'an University of Science and Technology (CN), Xi'an International Studies University (CN), Xi’an International University (CN)
Education Department of Shaanxi Province
Openalex Percentile: Top 66%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Emotion guided multi scale feature fusion for Qinqiang Opera video restoration — Tian Xia, Kaiyue Yang, et al. · npj Heritage Science (2025) | TGRS Research Map | TGRS