Enhancing sentiment analysis with language model adaptation: leveraging large-scale pretrained models

This paper reviews how to enhance the accuracy of sentiment analysis by utilizing language model adaptation and large-scale pre-training models. By introducing language model adaptation, models can better understand and capture emotions in text, thereby improving the accuracy of sentiment analysis. Large-scale pre-training models such as BERT and GPT-3 are widely used in sentiment analysis. They have learned rich language knowledge by training on a large amount of unlabeled text data and can utilize this knowledge in sentiment analysis tasks. Although there are still some challenges, such as data requirements and model interpretability, language model adaptation and large-scale pre-training models bring new possibilities to sentiment analysis and are expected to further improve its accuracy and application scope.

Authors

Institutions

Publication Details

Published
2024-10-16
DOI
https://doi.org/10.1117/12.3033425
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing sentiment analysis with language model adaptation: leveraging large-scale pretrained models

Madhavi Devaraj, Shen Haijie
Sentiment Analysis and Opinion Mining
article

Enhancing sentiment analysis with language model adaptation: leveraging large-scale pretrained models

Madhavi Devaraj, Shen Haijie
article en

Abstract

This paper reviews how to enhance the accuracy of sentiment analysis by utilizing language model adaptation and large-scale pre-training models. By introducing language model adaptation, models can better understand and capture emotions in text, thereby improving the accuracy of sentiment analysis. Large-scale pre-training models such as BERT and GPT-3 are widely used in sentiment analysis. They have learned rich language knowledge by training on a large amount of unlabeled text data and can utilize this knowledge in sentiment analysis tasks. Although there are still some challenges, such as data requirements and model interpretability, language model adaptation and large-scale pre-training models bring new possibilities to sentiment analysis and are expected to further improve its accuracy and application scope.

Mapúa University (PH), Xi'an Siyuan University (CN)
Openalex Percentile: Top 84%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.