Predicting Audience Interests from Social Media Captions Using a Semi-Supervised Approach

The aim of this paper is to predict the interests of social media influencers’ audiences. This paper presents a novel approach to the multi-label classification of interests in six categories: sports and fitness, travel, fashion, electronics, photography, and food. Out of the five classifiers, the Multilayer Perceptron (MLP) achieves the highest accuracy of ${9 8 . 2 2 \%}$ on the single-labeled dataset. Regardless, evaluation solely based on single labels only partially captures the complexities of multilabel classification. The Random Forest Classifier appears the most accurate among glass box models in labeling sentences belonging to one category and also showed promise in categorizing captions belonging to multiple categories. On the other hand, the SVM and KNN classifiers struggle with multi-label classification and often mislabel or fail to capture the labels in complex sentences. Despite lower accuracy on the single-labeled dataset, the Gradient Boosting Classifier demonstrates the most promising performance in labeling complex sentences, whereas, although achieving the highest accuracy for single-labeling, the MLP faces challenges with complex sentences containing multiple categories, indicating the need for a significantly larger dataset to improve its performance.

Authors

Institutions

Publication Details

Published
2024-10-17
DOI
https://doi.org/10.1109/uemcon62879.2024.10754685
Primary Topic
Subtitles and Audiovisual Media
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Predicting Audience Interests from Social Media Captions Using a Semi-Supervised Approach

Shivanjali Khare, Sadia Alam Tumpa, Ahmed Omar Salim Adnan, Hosnara Happy
Subtitles and Audiovisual Media
article

Predicting Audience Interests from Social Media Captions Using a Semi-Supervised Approach

Shivanjali Khare, Sadia Alam Tumpa, Ahmed Omar Salim Adnan, Hosnara Happy
article en

Abstract

The aim of this paper is to predict the interests of social media influencers’ audiences. This paper presents a novel approach to the multi-label classification of interests in six categories: sports and fitness, travel, fashion, electronics, photography, and food. Out of the five classifiers, the Multilayer Perceptron (MLP) achieves the highest accuracy of ${9 8 . 2 2 \%}$ on the single-labeled dataset. Regardless, evaluation solely based on single labels only partially captures the complexities of multilabel classification. The Random Forest Classifier appears the most accurate among glass box models in labeling sentences belonging to one category and also showed promise in categorizing captions belonging to multiple categories. On the other hand, the SVM and KNN classifiers struggle with multi-label classification and often mislabel or fail to capture the labels in complex sentences. Despite lower accuracy on the single-labeled dataset, the Gradient Boosting Classifier demonstrates the most promising performance in labeling complex sentences, whereas, although achieving the highest accuracy for single-labeling, the MLP faces challenges with complex sentences containing multiple categories, indicating the need for a significantly larger dataset to improve its performance.

North South University (BD), University of New Haven (US)
Openalex Percentile: Top 65%
Subtitles and Audiovisual Media
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.