A Hybrid RoBERTa–Rule-Based Aspect-Based Sentiment Analysis Model for Hospital Patient Reviews: Development, Validation, and Case Application in India
Background: Patient Online Reviews (PORs) provide real-time, unsolicited feedback that complements traditional satisfaction surveys. However, existing sentiment analysis tools often handle only monolingual data, broad sentiment categories, or lack review authenticity checks. This study develops a hybrid Aspect-Based Sentiment Analysis (ABSA) model combining RoBERTa with a rule-based aspect detection layer to extract fine-grained sentiment insights from Indian hospital reviews. Methods: We curated and manually annotated 4,862 Google Maps reviews from 25 Indian hospitals across six aspects—Doctor Behavior, Staff Behavior, Cleanliness, Facility Experience, Cost, and Waiting Time. Though the scheme included positive/negative/neutral labels, the final model used binary polarity (positive vs. negative) for reliability given sparse neutral data. The hybrid pipeline integrated RoBERTa fine-tuning with a keyword dictionary to enhance recall on low-frequency or implicit mentions. Review authenticity was verified using Type-Token Ratio, Jaccard similarity, and bigram overlap. External validation used 670 independent reviews. Results: The model achieved an average F1 score of 0.923 and 92.67% accuracy. Sensitivity and specificity averaged 0.905, with PPV 94.27% and NPV 87.82%. Comparative testing showed superior performance over lexicon-based and monolingual transformer models. A case study revealed strong satisfaction with clinical care but concerns over waiting time. Conclusions: The hybrid ABSA framework converts unstructured patient feedback into structured, actionable insights for hospital dashboards, audits, and digital health systems, supporting quality improvement in resource-limited, multilingual settings. Keywords: Sentiment analysis, Healthcare, Patient experience, Hybrid model, India
Authors
- Akash Prabhune (ORCID: https://orcid.org/0000-0002-3046-9067)
- Karpaga Priya P S
- Akhila Rayampalli
- Vinay R Sri Hari
- Ankur S Thakur
- Ebin M Yohannan
Publication Details
- Journal
- Journal of Health Research
- Published
- 2025-12-24
- DOI
- https://doi.org/10.56808/2586-940x.1170
- Primary Topic
- Patient Satisfaction in Healthcare
- Type
- article
- Field-Weighted Citation Impact
- 0.00