Thai-English target-based stock sentiment dataset for financial news with ICL-based evaluation

Sentiment analysis of financial documents provides insights into market dynamics and investment decision-making. Among various approaches, target-based sentiment analysis (TBSA) is widely studied for its ability to associate sentiment with specific stock entities. However, existing TBSA datasets are limited to a monolingual setting and lack support for low-resource languages, particularly Thai. While encoder-based models and Large Language Models (LLMs) have been widely applied in TBSA research, the effects of language setup and retrieval strategies on model performance remain underexplored. To address these gaps, we introduce a bilingual TBSA dataset comprising 10,295 Thai and 10,104 English financial news articles from 2018 to 2023. We describe the data collection, preparation, and annotation process, including investment-specific sentiment guidelines. Building on this dataset, we investigate two key research questions in financial TBSA: (1) how cross-lingual transfer and bilingual fine-tuning affect encoder-based models, and (2) how different in-context learning (ICL) settings influence LLMs. Our findings highlight the importance of language-aware modeling choices for encoder-based systems in financial NLP, with the best weighted F1 scores reaching 0.773 for Thai and 0.691 for English. For LLMs, we observe that performance benefits more from well-designed instructions and domain-specific criteria than from merely increasing the number of examples, with the best weighted F1 scores reaching 0.892 for Thai and 0.767 for English. These insights suggest that prompt quality–especially in terms of clarity, contextual alignment, and feedback-informed selection–is more impactful than quantity, offering practical guidance for designing effective LLM applications in bilingual financial analysis.

Authors

Institutions

Publication Details

Journal
Language Resources and Evaluation
Published
2026-10-26
DOI
https://doi.org/10.1007/s10579-026-09934-8
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Thai-English target-based stock sentiment dataset for financial news with ICL-based evaluation

Jayakorn Vongkulbhisal, Chayapat Uthayopas, Sarana Y. Nutanong, Can Udomcharoenchaikit et al.
Language Resources and Evaluation
Sentiment Analysis and Opinion Mining
article

Thai-English target-based stock sentiment dataset for financial news with ICL-based evaluation

Jayakorn Vongkulbhisal, Chayapat Uthayopas, Sarana Y. Nutanong, Can Udomcharoenchaikit, Wannaphong Phatthiyaphaibun, Weerayut Buaphet, Jitkapat Sawatphol, Sitiporn Sae Lim, Chalermpun Mai-On, Jasarin Vorawathanabuncha
article en

Abstract

Sentiment analysis of financial documents provides insights into market dynamics and investment decision-making. Among various approaches, target-based sentiment analysis (TBSA) is widely studied for its ability to associate sentiment with specific stock entities. However, existing TBSA datasets are limited to a monolingual setting and lack support for low-resource languages, particularly Thai. While encoder-based models and Large Language Models (LLMs) have been widely applied in TBSA research, the effects of language setup and retrieval strategies on model performance remain underexplored. To address these gaps, we introduce a bilingual TBSA dataset comprising 10,295 Thai and 10,104 English financial news articles from 2018 to 2023. We describe the data collection, preparation, and annotation process, including investment-specific sentiment guidelines. Building on this dataset, we investigate two key research questions in financial TBSA: (1) how cross-lingual transfer and bilingual fine-tuning affect encoder-based models, and (2) how different in-context learning (ICL) settings influence LLMs. Our findings highlight the importance of language-aware modeling choices for encoder-based systems in financial NLP, with the best weighted F1 scores reaching 0.773 for Thai and 0.691 for English. For LLMs, we observe that performance benefits more from well-designed instructions and domain-specific criteria than from merely increasing the number of examples, with the best weighted F1 scores reaching 0.892 for Thai and 0.767 for English. These insights suggest that prompt quality–especially in terms of clarity, contextual alignment, and feedback-informed selection–is more impactful than quantity, offering practical guidance for designing effective LLM applications in bilingual financial analysis.

Language Resources and EvaluationVol. 60(4)
Vidyasirimedhi Institute of Science and Technology (TH)
Openalex Percentile: Top 14%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon