The Role of Artificial Intelligence (ChatGPT-4o) in Supporting Tumor Board Decisions

<b>Background/Objectives:</b> Artificial intelligence (AI) has emerged as a promising field in the era of personalized oncology due to its potential to save time and workforce while serving as a supportive tool in patient management decisions. Although several studies in the literature have explored the integration of AI into oncology practice across different tumor types, available data remain limited. In our study, we aimed to evaluate the role of AI in the management of complex cancer cases by comparing the decisions of an in-house tumor board and ChatGPT-4o for patients with various tumor types. <b>Methods:</b> A total of 102 patients with diverse cancer types were included. Treatment and follow-up decisions proposed by both the tumor board and ChatGPT-4o were independently evaluated by two medical oncologists using a 5-point Likert scale. <b>Results:</b> Analysis of agreement levels showed high inter-rater reliability (κ = 0.722, <i>p</i> < 0.001 for tumor board decisions; κ = 0.794, <i>p</i> < 0.001 for ChatGPT decisions). However, concordance between the tumor board and ChatGPT was low, as reflected in the assessments of both raters (Rater 1: κ = 0.211, <i>p</i> = 0.003; Rater 2: κ = 0.376, <i>p</i> < 0.001). Both raters more frequently agreed with the tumor board decisions, and a statistically significant difference between tumor board and AI decisions was observed for both (Rater 1: Z = +4.548, <i>p</i> < 0.001; Rater 2: Z = +3.990, <i>p</i> < 0.001). <b>Conclusions:</b> These findings suggest that AI, in its current form, is not yet capable of functioning as a standalone decision-maker in the management of challenging oncology cases. Clinical experience and expert judgment remain the most critical factors in guiding patient care.

Authors

Institutions

Publication Details

Journal
Journal of Clinical Medicine
Published
2025-05-18
DOI
https://doi.org/10.3390/jcm14103535
Citations
10
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
6.54
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Role of Artificial Intelligence (ChatGPT-4o) in Supporting Tumor Board Decisions

Elif Sertesen, Mustafa Büyükkör, Berkan Karabuğa, Yakup Ergün et al.
10 citations
Journal of Clinical Medicine
Artificial Intelligence in Healthcare and Education
6.54
article

The Role of Artificial Intelligence (ChatGPT-4o) in Supporting Tumor Board Decisions

Elif Sertesen, Mustafa Büyükkör, Berkan Karabuğa, Yakup Ergün, Doğan Bayram, Cengiz Karaçin, Osman Bilge Kaya, Ergin Aydemir, Mehmet Emin Yılmaz
article en
10 citations

Abstract

<b>Background/Objectives:</b> Artificial intelligence (AI) has emerged as a promising field in the era of personalized oncology due to its potential to save time and workforce while serving as a supportive tool in patient management decisions. Although several studies in the literature have explored the integration of AI into oncology practice across different tumor types, available data remain limited. In our study, we aimed to evaluate the role of AI in the management of complex cancer cases by comparing the decisions of an in-house tumor board and ChatGPT-4o for patients with various tumor types. <b>Methods:</b> A total of 102 patients with diverse cancer types were included. Treatment and follow-up decisions proposed by both the tumor board and ChatGPT-4o were independently evaluated by two medical oncologists using a 5-point Likert scale. <b>Results:</b> Analysis of agreement levels showed high inter-rater reliability (κ = 0.722, <i>p</i> < 0.001 for tumor board decisions; κ = 0.794, <i>p</i> < 0.001 for ChatGPT decisions). However, concordance between the tumor board and ChatGPT was low, as reflected in the assessments of both raters (Rater 1: κ = 0.211, <i>p</i> = 0.003; Rater 2: κ = 0.376, <i>p</i> < 0.001). Both raters more frequently agreed with the tumor board decisions, and a statistically significant difference between tumor board and AI decisions was observed for both (Rater 1: Z = +4.548, <i>p</i> < 0.001; Rater 2: Z = +3.990, <i>p</i> < 0.001). <b>Conclusions:</b> These findings suggest that AI, in its current form, is not yet capable of functioning as a standalone decision-maker in the management of challenging oncology cases. Clinical experience and expert judgment remain the most critical factors in guiding patient care.

Journal of Clinical MedicineVol. 14(10)
Gülhane Askerî Tıp Akademisi (TR), Ankara Onkoloji Eğitim ve Araştırma Hastanesi (TR)
Openalex Percentile: Top 3%
Artificial Intelligence in Healthcare and Education
6.54
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.