Comparative Analysis of LLM-based Market Prediction and Human Expertise with Sentiment Analysis and Machine Learning Integration
This study conducts a comparative analysis of market prediction accuracy between Large Language Model (LLM)-based systems and human expertise within the financial analysis domain. Leveraging Quantum, an advanced LLM specialized for financial forecasting, we evaluate its predictive performance against human analysts and general-purpose LLMs, including GPT-3, GPT-4, FinGPT, and FinBERT. Employing a dataset of historical financial data, news headlines, and social media sentiment, we systematically assess predictive accuracy, response efficiency, and interpretability across models. The integration of sentiment analysis and machine learning further strengthens prediction reliability. Results reveal that Quantum’s specialized model demonstrates superior accuracy and speed in financial forecasting compared to human predictions and generalized LLMs, particularly in fast-moving, data-rich contexts. Nevertheless, limitations in nuanced contextual understanding and adaptability persist, highlighting the enduring value of human expertise. This research reinforces the potential of LLMs as robust tools for financial decision-making while identifying key areas for refinement to enhance synergy with human analytical insights. https://chatgpt.com/g/g-bS4Q76v0I-quantum
Authors
- Hua Wang (ORCID: https://orcid.org/0000-0002-8490-2874)
- Mohamed Abdelsamie
Institutions
- Zhejiang International Studies University (CN)
- Zhejiang University (CN)
Publication Details
- Published
- 2024-12-20
- DOI
- https://doi.org/10.1109/dsit61374.2024.10881868
- Citations
- 3
- Primary Topic
- Customer churn and segmentation
- Type
- article
- Field-Weighted Citation Impact
- 1.32