Understanding User Intent in Code-Mixed Sexual and Reproductive Health Queries in Urban India: Hierarchical Classification Approach Using Large Language Models
Hierarchical classification revealed persistent gaps in how LLMs handle code-mixed queries. Proprietary models performed best, but Sarvam-M shows that open-weight Indic systems can achieve performance near state-of-the-art models when supported by robust training data, cultural adaptation, and appropriate scale. These findings highlight the potential of localized, culturally aligned models to advance linguistically inclusive artificial intelligence tools and expand equitable access to SRH information in underserved populations globally.
Authors
- Sumon Kanti Dey
- Aradhana Thapa (ORCID: https://orcid.org/0000-0001-8352-6929)
- Meet K. Shah
- Suhani Jalota (ORCID: https://orcid.org/0000-0002-3770-9369)
- Azra Ismail (ORCID: https://orcid.org/0000-0002-7570-9474)
- Tanvi Divate
- S Manvi (ORCID: https://orcid.org/0009-0003-1727-9511)
- Shraddha Kale Kapile
- Zeel Mehta
Institutions
- Hoover Institution (US)
- Emory University (US)
- Hans Raj Mahila Maha Vidyalaya (IN)
- Woodruff Health Sciences Center (US)
- Stanford University (US)
Publication Details
- Journal
- Journal of Medical Internet Research
- Published
- 2026-02-18
- DOI
- https://doi.org/10.2196/86545
- Primary Topic
- ICT in Developing Communities
- Type
- article
- Field-Weighted Citation Impact
- 0.00