When Artificial Intelligence meets Navarasas - Facial Expression Classification in Kathakali Using DSFD and CNN

Kathakali, an ancient art form that dates back to the 17th century, is renowned for its intricate hand gestures, dance movements, musical accompaniment, elaborate costumes, and makeup. Mastering such an art form is a challenge even for the most dedicated enthusiasts, given its unconventional methods of expression. However, with current advanced technology, we can use this to aid the learning of unfamiliar subjects by classifying factors to help the new learners. In this paper, we focus on classifying one aspect of the play, which is the expressions on the actor’s face given a picture using computer vision methods. To achieve the final model, we use a combination of Dual Shot Face Detector (DSFD) and Convolution Neural Network (CNN) and finally tuning up the epochs of the training process. With our dataset, the proposed model reached an accuracy of 93% among nine classes. This project hopes to introduce Kathakali to a wider audience and facilitate the learning process of this art form.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/spices62143.2024.10779842
Citations
1
Primary Topic
Face and Expression Recognition
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

When Artificial Intelligence meets Navarasas - Facial Expression Classification in Kathakali Using DSFD and CNN

Minh Thuy Le, Ganesh Neelakanta Iyer, Nattapong Saengarunvong
1 citations
Face and Expression Recognition
0.25
article

When Artificial Intelligence meets Navarasas - Facial Expression Classification in Kathakali Using DSFD and CNN

Minh Thuy Le, Ganesh Neelakanta Iyer, Nattapong Saengarunvong
article en
1 citations

Abstract

Kathakali, an ancient art form that dates back to the 17th century, is renowned for its intricate hand gestures, dance movements, musical accompaniment, elaborate costumes, and makeup. Mastering such an art form is a challenge even for the most dedicated enthusiasts, given its unconventional methods of expression. However, with current advanced technology, we can use this to aid the learning of unfamiliar subjects by classifying factors to help the new learners. In this paper, we focus on classifying one aspect of the play, which is the expressions on the actor’s face given a picture using computer vision methods. To achieve the final model, we use a combination of Dual Shot Face Detector (DSFD) and Convolution Neural Network (CNN) and finally tuning up the epochs of the training process. With our dataset, the proposed model reached an accuracy of 93% among nine classes. This project hopes to introduce Kathakali to a wider audience and facilitate the learning process of this art form.

National University of Singapore (SG), Case Western Reserve University (US), King Mongkut's University of Technology Thonburi (TH)
Openalex Percentile: Top 43%
Face and Expression Recognition
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.