Multi-Domain and Multi-View Oriented Deep Neural Network for Sentiment Analysis in Large Language Models

The advancement of Natural Language Processing (NLP) technology has led to a focus on language models (LMs) with a general-purpose, which have achieved greater accuracy than earlier methods. However, specialized LMs still face challenges, particularly in domains with limited resources. To address this issue, this paper proposes a Multi-Domain and Multi-View oriented Deep Neural Network (MDMV-DNN) model for sentiment analysis in Large Language Models (LLMs). A novel architecture, which incorporates a Domain-Integrated Residual Attention enhanced BERT (DIRA-BERT) mechanism for multi-domain integration, and a Multi-Filter Convolutional Neural Network (MF-CNN) and Bidirectional Long Short-Term Memory (Bi-LSTM) enhanced fusion mechanism for Multi-View feature extraction, is introduced and constructed. The DIRA-BERT can enhance the classification accuracy by integrating multiple expert BERT models tailored to specific tasks, thus providing refined and interpretable feature representations. The integration of MF-CNN and Bi-LSTM can further strengthen the learning ability in capturing the local key and sequential features respectively, so as to enable a comprehensive sentiment analysis through multi-view feature extraction. Experiment results demonstrate that the proposed MDMV-DNN consistently outperforms the traditional methods using common BERT models across all evaluation metrics, showcasing its effectiveness in specialized sentiment analysis tasks.

Authors

Institutions

Publication Details

Published
2024-08-19
DOI
https://doi.org/10.1109/ithings-greencom-cpscom-smartdata-cybermatics62450.2024.00045
Citations
1
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Domain and Multi-View Oriented Deep Neural Network for Sentiment Analysis in Large Language Models

Xiaokang Zhou, Shohei Shimizu, Keito Inoshita
1 citations
Sentiment Analysis and Opinion Mining
0.35
article

Multi-Domain and Multi-View Oriented Deep Neural Network for Sentiment Analysis in Large Language Models

Xiaokang Zhou, Shohei Shimizu, Keito Inoshita
article en
1 citations

Abstract

The advancement of Natural Language Processing (NLP) technology has led to a focus on language models (LMs) with a general-purpose, which have achieved greater accuracy than earlier methods. However, specialized LMs still face challenges, particularly in domains with limited resources. To address this issue, this paper proposes a Multi-Domain and Multi-View oriented Deep Neural Network (MDMV-DNN) model for sentiment analysis in Large Language Models (LLMs). A novel architecture, which incorporates a Domain-Integrated Residual Attention enhanced BERT (DIRA-BERT) mechanism for multi-domain integration, and a Multi-Filter Convolutional Neural Network (MF-CNN) and Bidirectional Long Short-Term Memory (Bi-LSTM) enhanced fusion mechanism for Multi-View feature extraction, is introduced and constructed. The DIRA-BERT can enhance the classification accuracy by integrating multiple expert BERT models tailored to specific tasks, thus providing refined and interpretable feature representations. The integration of MF-CNN and Bi-LSTM can further strengthen the learning ability in capturing the local key and sequential features respectively, so as to enable a comprehensive sentiment analysis through multi-view feature extraction. Experiment results demonstrate that the proposed MDMV-DNN consistently outperforms the traditional methods using common BERT models across all evaluation metrics, showcasing its effectiveness in specialized sentiment analysis tasks.

Shiga University (JP), Kansai University (JP)
Openalex Percentile: Top 32%
Sentiment Analysis and Opinion Mining
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.