An AI-Driven Workflow for Preserving Traditional Malay Music Videos: A Case Study in Cultural Heritage Enhancement

Preserving cultural heritage like traditional arts and traditional music becomes increasingly challenging during the digital age. We presented a workflow that uses generative AI to preserve traditional Malay music in video format with an emphasis on cultural integrity through photorealistic video generation. Our enhanced framework uses Low-Rank Adaptation (LoRA) combined with Splitter.ai-based vocal isolation and Kling.ai motion synchronization along with other artificial intelligence techniques to completely process and enhance audiovisual elements. We started our research design by deploying generative AI tools throughout a production process starting from concept development, facial synthesis, and training alongside motion-lip synchronization before post-production to ensure visual harmony without sacrificing storytelling elements and technical precision. The workflow consists of expert validation points, loop refinement linked to cultural accuracy loss, and computational performance. The end results show that generative AI techniques create successful links between traditional artistic forms with the present multimedia formats to preserve traditional Malay music. This research introduces a workflow that allows reproducible AI-assisted preservation methods which give opportunities to heritage experts and authorities helpful guidance to integrate technical innovations with cultural integrity.

Authors

Institutions

Publication Details

Published
2025-05-15
DOI
https://doi.org/10.1109/iraset64571.2025.11008319
Citations
1
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
1.49
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An AI-Driven Workflow for Preserving Traditional Malay Music Videos: A Case Study in Cultural Heritage Enhancement

M. Izani, Akhmed Kaleel, M. M. Gabr, Arjang A. Assad et al.
1 citations
Music and Audio Processing
1.49
article

An AI-Driven Workflow for Preserving Traditional Malay Music Videos: A Case Study in Cultural Heritage Enhancement

M. Izani, Akhmed Kaleel, M. M. Gabr, Arjang A. Assad, Khoi Trinh, H. Harumaini
article en
1 citations

Abstract

Preserving cultural heritage like traditional arts and traditional music becomes increasingly challenging during the digital age. We presented a workflow that uses generative AI to preserve traditional Malay music in video format with an emphasis on cultural integrity through photorealistic video generation. Our enhanced framework uses Low-Rank Adaptation (LoRA) combined with Splitter.ai-based vocal isolation and Kling.ai motion synchronization along with other artificial intelligence techniques to completely process and enhance audiovisual elements. We started our research design by deploying generative AI tools throughout a production process starting from concept development, facial synthesis, and training alongside motion-lip synchronization before post-production to ensure visual harmony without sacrificing storytelling elements and technical precision. The workflow consists of expert validation points, loop refinement linked to cultural accuracy loss, and computational performance. The end results show that generative AI techniques create successful links between traditional artistic forms with the present multimedia formats to preserve traditional Malay music. This research introduces a workflow that allows reproducible AI-assisted preservation methods which give opportunities to heritage experts and authorities helpful guidance to integrate technical innovations with cultural integrity.

Higher Colleges of Technology (AE), Sultan Ismail Specialist Hospital (MY)
Sustainable cities and communities
Openalex Percentile: Top 19%
Music and Audio Processing
1.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.