Leveraging LLMs for Collaborative Ontology Engineering in Parkinson Disease Monitoring and Alerting
Ontology engineering plays a critical role in clinical decision support systems for Parkinson’s Disease (PD) monitoring and alerting. While Large Language Models (LLMs) have shown promise in knowledge modeling tasks, their effectiveness in autonomously constructing comprehensive ontologies for complex clinical domains remains unclear. This study investigates four ontology engineering methodologies for PD monitoring and alerting: One-shot (OS) prompting, Decomposed Sequential Prompting (DSP), X-HCOME, and SimX-HCOME+. Multiple LLMs were evaluated across these methodologies. Generated ontologies were assessed against a reference PD ontology using structural evaluation metrics focused on classes and object properties. Expert review was additionally conducted to analyze knowledge extensions beyond the gold standard. LLMs were able to autonomously generate syntactically valid and semantically meaningful ontologies using OS and DSP prompting; however, these ontologies exhibited limited conceptual coverage. Incorporating human expertise through X-HCOME significantly improved ontology completeness and evaluation metrics. Expert review further validated clinically relevant concepts absent from the reference ontology. SimX-HCOME+ demonstrated that iterative, supervised collaboration supports ontology refinement, although challenges persisted in natural language-to-rule formalization. The findings suggest that LLMs are more effective as collaborative assistants rather than standalone ontology engineers in the PD domain. Structured human–LLM collaboration is associated with improved ontology coverage and facilitates the identification of potential knowledge extensions in clinical monitoring applications. While the present evaluation focuses primarily on structural ontology elements, the proposed methodologies provide useful insights for LLM-assisted ontology engineering in complex healthcare domains.
Authors
- Georgios Bouchouras (ORCID: https://orcid.org/0000-0003-0566-3615)
- Konstantinos Kotis (ORCID: https://orcid.org/0000-0001-7838-9691)
- George A. Vouros (ORCID: https://orcid.org/0000-0001-5451-622X)
- Andreas Soularidis (ORCID: https://orcid.org/0009-0006-9769-5583)
- Dimitrios Doumanas
Institutions
- University of Piraeus (GR)
- University of the Aegean (GR)
Publication Details
- Journal
- AI
- Published
- 2026-04-14
- DOI
- https://doi.org/10.3390/ai7040139
- Primary Topic
- Biomedical Text Mining and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00