Adherence of Free-Tier Large Language Models to the 2024 European Society of Cardiology (ESC) Guidelines for the Management of Elevated Blood Pressure and Hypertension: A Comparative Study

Background Hypertension remains the leading modifiable risk factor for cardiovascular disease and premature death worldwide. In 2024, the European Society of Cardiology (ESC) released updated guidelines for the management of elevated blood pressure and hypertension. Concurrently, the integration of artificial intelligence into healthcare has accelerated, with large language models (LLMs) becoming accessible tools for information retrieval. Objective This study aims to evaluate and compare the accuracy and adherence of three popular free-tier LLMs (ChatGPT-5.2, Gemini 3 Flash, and Claude 4.5 Sonnet) in responding to questions based strictly on the 2024 ESC Guidelines. Methods We conducted a comparative cross-sectional study in January 2026 to evaluate the performance of three LLMs. The primary source of ground truth was the 2024 ESC Guidelines. A dataset of 40 specific questions was generated, covering key domains including diagnosis, treatment targets, lifestyle modifications, and comorbidities. Questions comprised both factual queries and clinical case reports. Responses were categorized by a qualified physician as correct, inaccurate, or incorrect based strictly on guidelines. Statistical analysis was performed using the Fisher-Freeman-Halton exact test to evaluate differences in performance. Results The overall accuracy across all models was high, with no statistically significant differences in performance observed (p>0.99). Claude 4.5 Sonnet achieved the highest numerical accuracy, providing correct responses to 33 out of 40 questions (82.5%). ChatGPT-5.2 and Gemini 3 Flash achieved identical correctness rates of 80.0% (32 out of 40 correct answers). A qualitative analysis revealed a distinct tendency toward overly aggressive management in complex clinical scenarios, suggesting a "safety bias" where models default to intensive intervention rather than nuanced guideline steps. Conclusions The evaluated free-tier LLMs demonstrated comparable and high proficiency in interpreting the 2024 ESC Guidelines. Despite this potential, the study identified a recurrent safety bias manifesting as a tendency toward over-medicalization. While these models serve as promising auxiliary tools for medical education, verification of AI-generated advice against official guideline documents remains essential.

Authors

Institutions

Publication Details

Journal
Cureus
Published
2026-02-23
DOI
https://doi.org/10.7759/cureus.104111
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adherence of Free-Tier Large Language Models to the 2024 European Society of Cardiology (ESC) Guidelines for the Management of Elevated Blood Pressure and Hypertension: A Comparative Study

Rania Suleiman, Jędrzej Piotrowski, Natalia Marianna Kubiś, Bartosz Palacz et al.
Cureus
Artificial Intelligence in Healthcare and Education
article

Adherence of Free-Tier Large Language Models to the 2024 European Society of Cardiology (ESC) Guidelines for the Management of Elevated Blood Pressure and Hypertension: A Comparative Study

Rania Suleiman, Jędrzej Piotrowski, Natalia Marianna Kubiś, Bartosz Palacz, Aleksander Polus, Julia Anna Wrona, Maria Magdalena Teper, Anhelina Korolchuk, Anna Gluzicka, Wiktor Perz, Aleksander Tuteja, Anna Matyas, Aleksandra Wielochowska, Dawid Boczkowski, Piotr Sawina
article en

Abstract

Background Hypertension remains the leading modifiable risk factor for cardiovascular disease and premature death worldwide. In 2024, the European Society of Cardiology (ESC) released updated guidelines for the management of elevated blood pressure and hypertension. Concurrently, the integration of artificial intelligence into healthcare has accelerated, with large language models (LLMs) becoming accessible tools for information retrieval. Objective This study aims to evaluate and compare the accuracy and adherence of three popular free-tier LLMs (ChatGPT-5.2, Gemini 3 Flash, and Claude 4.5 Sonnet) in responding to questions based strictly on the 2024 ESC Guidelines. Methods We conducted a comparative cross-sectional study in January 2026 to evaluate the performance of three LLMs. The primary source of ground truth was the 2024 ESC Guidelines. A dataset of 40 specific questions was generated, covering key domains including diagnosis, treatment targets, lifestyle modifications, and comorbidities. Questions comprised both factual queries and clinical case reports. Responses were categorized by a qualified physician as correct, inaccurate, or incorrect based strictly on guidelines. Statistical analysis was performed using the Fisher-Freeman-Halton exact test to evaluate differences in performance. Results The overall accuracy across all models was high, with no statistically significant differences in performance observed (p>0.99). Claude 4.5 Sonnet achieved the highest numerical accuracy, providing correct responses to 33 out of 40 questions (82.5%). ChatGPT-5.2 and Gemini 3 Flash achieved identical correctness rates of 80.0% (32 out of 40 correct answers). A qualitative analysis revealed a distinct tendency toward overly aggressive management in complex clinical scenarios, suggesting a "safety bias" where models default to intensive intervention rather than nuanced guideline steps. Conclusions The evaluated free-tier LLMs demonstrated comparable and high proficiency in interpreting the 2024 ESC Guidelines. Despite this potential, the study identified a recurrent safety bias manifesting as a tendency toward over-medicalization. While these models serve as promising auxiliary tools for medical education, verification of AI-generated advice against official guideline documents remains essential.

CureusVol. 18(2)
Medical University of Silesia (PL), Kielce University of Technology (PL), Jan Kochanowski University (PL), Wroclaw Medical University (PL), Ministry of Interior (HU), Copernicus Memorial Hospital (PL), Hospital El Bierzo (ES), Medical University of Lodz (PL), Ministry of Interior (IT)
Quality Education
Openalex Percentile: Top 48%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.