Evaluating the Quality of Health Information: Comparison of Human and Artificial Intelligence

AI models demonstrated moderate alignment with human-assigned DISCERN scores for IBS-related TikTok videos, but only when content was produced by non-medical creators. The weaker correlation for content produced by those with a medical background suggests limitations in current AI models' ability to interpret nuanced or technical health information. These findings highlight the need for further validation across broader topics, languages, platforms, and reviewer pools. If refined, AI-generated DISCERN scoring could serve as a scalable tool to help users assess the reliability of health information on social media and curb misinformation.