The quality and scope of health information on online drug platforms: a topic modelling and expert evaluation study of a Polish-language forum

Determining health information quality on online drug platforms is crucial for revealing and shaping substance use practices. The study aims to assess the scope and quality of health-related information on the largest Polish drug forum, Hyperreal. Ultimately, the goal was to explore how the case of Hyperreal illustrates user-driven knowledge construction around drug use and its potential implications for harm reduction strategies on similar online platforms. A multimethod approach was employed for the current research. First, the full content of the forum was scraped, and topic modelling was used to pinpoint and analyse posts (N = 159,145) that discussed drugs in a health-related context. From this, 25 posts were selected for expert analysis using specified selection criteria for each topic. As existing standardized tools were found to be unsuitable for the aims of this study, the research team developed a custom questionnaire to evaluate the quality of posts, with psychiatrists serving as expert reviewers. The topic distribution analysis indicated the most frequent and only sporadically discussed themes. Semantic analysis revealed distinct relationships between specific psychoactive substances and health topics, including associations between ketamine and depression/psychotherapy, marijuana and symptom relief and inflammation, amphetamines and cardiovascular issues, and fentanyl and palliative or oncological care. These patterns closely mirrored associations described in the medical literature, indicating knowledge structures grounded in medical rather than purely anecdotal knowledge. However, although the posts largely adhered to evidence-based medicine, the expert evaluation showed that they contained significant informational gaps. Overall, the mean quality of posts was M = 35.67, SD = 6.70, which indicates moderate health information quality. Experts rated factual accuracy and consistency with medical guidelines as moderate, while safety-related aspects—particularly dosage guidance and encouragement to consult specialists—received the lowest scores. Online drug platforms are an important source of knowledge on psychoactive substances. However, the health information quality of posts was average, which is especially crucial as these forums shape discourses that replace professional narratives. The study is relevant in the context of harm reduction strategies and emphasizes the need to improve the quality of drug platforms’ content.