Tackling Data Sparsity and Combinatorial Challenges in Rare Disease Matching with Medical Informed Machine Learning
With over 7,000 known rare diseases and a prevalence of less than one in a thousand, rare diseases pose substantial challenges to advanced medical support networks. This study investigates the efficacy of Unrare.me, a novel social networking platform designed for individuals affected by rare diseases, including patients, their family members, and medical professionals, addressing data sparsity and combinatorial complexities in user matching. We demonstrate that simple matching heuristics already serve as a decent basis for collecting user feedback on match quality. Leveraging over 10,000 user matching feedback scores from more than 2,000 active users, we evaluate algorithms including collaborative filtering and user embedding similarity with state-of-the-art Large Language Models (LLMs). With a top-10 and top-5 hit-rate of 55% and 37%, respectively, we show that a combination of medical data augmentation and embeddings significantly enhances performance beyond the initial heuristic baseline.
Authors
- Lorenz Grigull (ORCID: https://orcid.org/0000-0001-8807-2874)
- Rafet Sifa
- Max Lübbering (ORCID: https://orcid.org/0000-0001-6291-9459)
- Armin Berger (ORCID: https://orcid.org/0000-0003-3109-4372)
- Ralf Schmidt
- Gundula Ernst (ORCID: https://orcid.org/0000-0002-2483-7206)
- Thiago Bell
- Tom Anglim Lagones
- Lara Fendrich
- Henriette Högl
- David Bascom
Institutions
- Queensland Health (AU)
- University Hospital Bonn (DE)
- Government of Western Australia Department of Health (AU)
- Medizinische Hochschule Hannover (DE)
Publication Details
- Published
- 2024-12-15
- DOI
- https://doi.org/10.1109/bigdata62323.2024.10825404
- Citations
- 4
- Primary Topic
- Machine Learning in Healthcare
- Type
- article
- Field-Weighted Citation Impact
- 1.39
Funders
- Ministry of Education