Implementasi Pengenalan Ekspresi Wajah dengan Menggunakan Metode Convolutional Neural Network dan OpenCV Berbasis Webcam

Facial expressions play an important role as a non-verbal language rich in emotional information, especially in psychological contexts. The main challenge in this research is to understand and analyse complex facial expressions, which are often difficult for psychologists to interpret. The implementation of webcam-based facial expression recognition leverages the computer's ability to visually recognise human emotions, supported by artificial intelligence and machine learning. Convolutional Neural Network (CNN) and OpenCV methods are used to detect and classify facial expressions directly. The CNN model is trained using a dataset with six expression classes (happy, sad, angry, surprised, neutral, afraid), with four convolution layers for multi-class classification. The implementation of facial expression recognition is successful, the system captures facial images from a webcam, detects faces in the frame, and classifies facial expressions directly on the screen window. The performance of training data against the trained model measured using Classification Accuracy shows an accuracy of 72.34% in training accuracy and 60.54% in validation accuracy. While the performance of the facial expression recognition system calculated using Confusion Matrix resulted in an accuracy of 70.55%. The calculation results show that the model is at the Fair Classification parameter level or able to classify facial expressions in humans with a fairly good level of accuracy, this research has great potential for application development in the field of psychology. However, further optimisation is needed by involving experts to ensure its effectiveness.

Authors

Institutions

Publication Details

Journal
Journal of Computer System and Informatics (JoSYC)
Published
2024-11-30
DOI
https://doi.org/10.47065/josyc.v6i1.6114
Primary Topic
Computer Science and Engineering
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Implementasi Pengenalan Ekspresi Wajah dengan Menggunakan Metode Convolutional Neural Network dan OpenCV Berbasis Webcam

Suharjanto Utomo, Hernawati Hernawati, Sri Sutjiningtyas, Raifvaldhy Jounias Luppus Melatisudra
Journal of Computer System and Informatics (JoSYC)
Computer Science and Engineering
article

Implementasi Pengenalan Ekspresi Wajah dengan Menggunakan Metode Convolutional Neural Network dan OpenCV Berbasis Webcam

Suharjanto Utomo, Hernawati Hernawati, Sri Sutjiningtyas, Raifvaldhy Jounias Luppus Melatisudra
article en

Abstract

Facial expressions play an important role as a non-verbal language rich in emotional information, especially in psychological contexts. The main challenge in this research is to understand and analyse complex facial expressions, which are often difficult for psychologists to interpret. The implementation of webcam-based facial expression recognition leverages the computer's ability to visually recognise human emotions, supported by artificial intelligence and machine learning. Convolutional Neural Network (CNN) and OpenCV methods are used to detect and classify facial expressions directly. The CNN model is trained using a dataset with six expression classes (happy, sad, angry, surprised, neutral, afraid), with four convolution layers for multi-class classification. The implementation of facial expression recognition is successful, the system captures facial images from a webcam, detects faces in the frame, and classifies facial expressions directly on the screen window. The performance of training data against the trained model measured using Classification Accuracy shows an accuracy of 72.34% in training accuracy and 60.54% in validation accuracy. While the performance of the facial expression recognition system calculated using Confusion Matrix resulted in an accuracy of 70.55%. The calculation results show that the model is at the Fair Classification parameter level or able to classify facial expressions in humans with a fairly good level of accuracy, this research has great potential for application development in the field of psychology. However, further optimisation is needed by involving experts to ensure its effectiveness.

Journal of Computer System and Informatics (JoSYC)Vol. 6(1)
Universitas Nurtanio (ID)
Openalex Percentile: Top 72%
Computer Science and Engineering
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.