Semantic sparse attention-based algorithm for sentiment analysis

Financial news serves as a primary conduit for conveying dynamics in financial markets and changes in economic policies. Fully capturing the information in financial news benefits investors, corporations, and governments in understanding and responding to market shifts. This paper addresses challenges encountered in the sentiment analysis of financial news, including slow model convergence and indirect transmission of long-distance dependent information, by proposing a novel deep learning model designed to effectively capture contextual information in financial news texts. The model incorporates a semantic attention mechanism to preliminarily extract semantic information from the text and learn the correlations between words, thereby enhancing model convergence speed. Considering that the model might lead to overly dispersed attention weights and hinder effective focus on crucial local information when processing long sequences, we introduce a sparse attention module capable of efficiently modeling local dependency relations. Experimental validation on a financial news dataset demonstrates that our model outperforms traditional methods in sentiment analysis tasks in terms of accuracy and generalization ability, confirming the effectiveness of the semantic attention mechanism and the sparse attention module.

Authors

Institutions

Publication Details

Published
2024-11-08
DOI
https://doi.org/10.1117/12.3050008
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Semantic sparse attention-based algorithm for sentiment analysis

Longhao Li, Keyong Hu, Jiale Zou
Sentiment Analysis and Opinion Mining
article

Semantic sparse attention-based algorithm for sentiment analysis

Longhao Li, Keyong Hu, Jiale Zou
article en

Abstract

Financial news serves as a primary conduit for conveying dynamics in financial markets and changes in economic policies. Fully capturing the information in financial news benefits investors, corporations, and governments in understanding and responding to market shifts. This paper addresses challenges encountered in the sentiment analysis of financial news, including slow model convergence and indirect transmission of long-distance dependent information, by proposing a novel deep learning model designed to effectively capture contextual information in financial news texts. The model incorporates a semantic attention mechanism to preliminarily extract semantic information from the text and learn the correlations between words, thereby enhancing model convergence speed. Considering that the model might lead to overly dispersed attention weights and hinder effective focus on crucial local information when processing long sequences, we introduce a sparse attention module capable of efficiently modeling local dependency relations. Experimental validation on a financial news dataset demonstrates that our model outperforms traditional methods in sentiment analysis tasks in terms of accuracy and generalization ability, confirming the effectiveness of the semantic attention mechanism and the sparse attention module.

Tianjin University of Technology (CN), Qingdao University of Technology (CN)
Openalex Percentile: Top 82%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Semantic sparse attention-based algorithm for sentiment analysis — Longhao Li, Keyong Hu, et al. · (2024) | TGRS Research Map | TGRS