Development and Preliminary Evaluation of the OCODES Digital Strategy in Response to Health Misinformation: Nominal Group Technique and Retrospective Usability Evaluation Study

Background: Health misinformation has intensified worldwide, especially in digital environments, where low health and media literacy increase vulnerability. Thus, the MEDIATICH program of the University of Zaragoza launched OCODES (Observatorio Contra la Desinformación en Salud), a participatory digital initiative designed to promote health media literacy and provide evidence-based information through a web platform and social media channels. Objective: This study describes the co-design and development of the OCODES strategy using 2 sequential nominal group technique (NGT) sessions, and assesses its preliminary usability, preliminary user perception, and user engagement after 6 months of activity as a digital initiative developed in response to health misinformation. Methods: NGT1 (n=15) aimed to identify and prioritize interventions to strengthen health literacy through an individual yes or no prioritization process, while NGT2 (n=18) translated selected priorities into concrete digital products, including website structure, social media selection, content lines, and interaction mechanisms. In addition, routine user feedback and website analytics data generated through the OCODES digital channels during the first 6 months of activity were retrospectively examined. Usability was explored using the System Usability Scale (SUS), while preliminary user perception was described through 2 study-specific indicators available in the public feedback tools: perceived usefulness (1-5 Likert scale) and willingness to recommend the website. Google Analytics provided complementary website engagement metrics. Results: NGT-1 generated 11 interventions grouped into four categories. Digital actions were prioritized as the core strategy: a health dissemination portal and social media interventions in the context of health misinformation each achieved 93.3% (14 of the 15 participants) agreement. NGT-2 defined the digital architecture of OCODES, including a central website and presence on LinkedIn (Meta), X (formerly known as Twitter; X Corp), and Instagram (Meta), and established guiding principles such as transparency, scientific rigor, accessibility, and clear communication. A total of 99 adults provided routine usability feedback (65/99, 65.7% women; mean age 44.7, SD 12.54 y). The mean SUS score was 83.10 (SD 10.09), with 94.9% (94/99) achieving adequate usability (SUS ≥68). Perceived usefulness scored 4.52 (SD 0.71), and 97.9% (97/99) of users who provided feedback indicated that they would recommend the site. Web metrics showed 5769 new users, 1935 returning users, 19,003 page views, a bounce rate of 53.32%, a total of 3.28 pages per active user, and 4.95 events per session, indicating strong initial engagement. Conclusions: OCODES is a feasible and well-received digital strategy developed through a participatory, consensus-driven process. Its favorable usability indicators, positive preliminary user perception, and encouraging early engagement metrics support its feasibility. However, the current findings do not provide evidence of effectiveness in reducing health misinformation or improving health media literacy. Future efforts should focus on reaching vulnerable populations, expanding evaluation approaches, and assessing long-term impact.

Authors

Institutions

Publication Details

Journal
JMIR Formative Research
Published
2026-08-14
DOI
https://doi.org/10.2196/93910
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development and Preliminary Evaluation of the OCODES Digital Strategy in Response to Health Misinformation: Nominal Group Technique and Retrospective Usability Evaluation Study

Emmanuel Echániz-Serrano, Natalia Barrio-Forné, Pedro José Satústegui-Dordá, Enrique Ramón Arbués et al.
JMIR Formative Research
Misinformation and Its Impacts
article

Development and Preliminary Evaluation of the OCODES Digital Strategy in Response to Health Misinformation: Nominal Group Technique and Retrospective Usability Evaluation Study

Emmanuel Echániz-Serrano, Natalia Barrio-Forné, Pedro José Satústegui-Dordá, Enrique Ramón Arbués, Eva Ruiz, Piedad Gómez-Torres, José Manuel Granada-López, María Teresa Fernández‐Rodrigo, María Esther Samaniego-Díaz de Corcuera
article en

Abstract

Background: Health misinformation has intensified worldwide, especially in digital environments, where low health and media literacy increase vulnerability. Thus, the MEDIATICH program of the University of Zaragoza launched OCODES (Observatorio Contra la Desinformación en Salud), a participatory digital initiative designed to promote health media literacy and provide evidence-based information through a web platform and social media channels. Objective: This study describes the co-design and development of the OCODES strategy using 2 sequential nominal group technique (NGT) sessions, and assesses its preliminary usability, preliminary user perception, and user engagement after 6 months of activity as a digital initiative developed in response to health misinformation. Methods: NGT1 (n=15) aimed to identify and prioritize interventions to strengthen health literacy through an individual yes or no prioritization process, while NGT2 (n=18) translated selected priorities into concrete digital products, including website structure, social media selection, content lines, and interaction mechanisms. In addition, routine user feedback and website analytics data generated through the OCODES digital channels during the first 6 months of activity were retrospectively examined. Usability was explored using the System Usability Scale (SUS), while preliminary user perception was described through 2 study-specific indicators available in the public feedback tools: perceived usefulness (1-5 Likert scale) and willingness to recommend the website. Google Analytics provided complementary website engagement metrics. Results: NGT-1 generated 11 interventions grouped into four categories. Digital actions were prioritized as the core strategy: a health dissemination portal and social media interventions in the context of health misinformation each achieved 93.3% (14 of the 15 participants) agreement. NGT-2 defined the digital architecture of OCODES, including a central website and presence on LinkedIn (Meta), X (formerly known as Twitter; X Corp), and Instagram (Meta), and established guiding principles such as transparency, scientific rigor, accessibility, and clear communication. A total of 99 adults provided routine usability feedback (65/99, 65.7% women; mean age 44.7, SD 12.54 y). The mean SUS score was 83.10 (SD 10.09), with 94.9% (94/99) achieving adequate usability (SUS ≥68). Perceived usefulness scored 4.52 (SD 0.71), and 97.9% (97/99) of users who provided feedback indicated that they would recommend the site. Web metrics showed 5769 new users, 1935 returning users, 19,003 page views, a bounce rate of 53.32%, a total of 3.28 pages per active user, and 4.95 events per session, indicating strong initial engagement. Conclusions: OCODES is a feasible and well-received digital strategy developed through a participatory, consensus-driven process. Its favorable usability indicators, positive preliminary user perception, and encouraging early engagement metrics support its feasibility. However, the current findings do not provide evidence of effectiveness in reducing health misinformation or improving health media literacy. Future efforts should focus on reaching vulnerable populations, expanding evaluation approaches, and assessing long-term impact.

JMIR Formative ResearchVol. 10
Universidad de Granada (ES), Universidad de Zaragoza (ES), Servicio Aragonés de Salud (ES), Universidad San Jorge (ES), Instituto de Investigación Sanitaria Aragón (ES)
Quality Education
Openalex Percentile: Top 4%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.