Validation of generative artificial intelligence techniques for synthetic data generation in multiple sclerosis research: A comparison with real-world evidence from the Italian multiple sclerosis registry
BACKGROUND: The use of generative artificial intelligence to create synthetic data is an emerging strategy to enhance real-world evidence. OBJECTIVE: To assess the validity of artificial intelligence-generated synthetic data in replicating data collected in the Italian Multiple Sclerosis and Related Disorders Register for the evaluation of progression independent of relapse activity risk under early intensive treatment and escalation treatment strategies. METHODS: Artificial intelligence generative models were trained on a sub-cohort of 1666 Italian Multiple Sclerosis and Related Disorders Register patients to generate a synthetic dataset of 4878 patients. Synthetic vAlidation FramEwork, Clinical Synthetic Fidelity, and Nearest Neighbor Distance Ratio were applied. Comparisons between treatment strategies were conducted using both real and synthetic data, focusing on progression independent of relapse activity risk. RESULTS: The synthetic data demonstrated fidelity and privacy preservation. Treatment-effect estimates for escalation treatment versus early intensive treatment were similar across the real and synthetic datasets. Cox proportional hazards models showed that synthetic data preserved the robustness of the estimates for the risk of a first progression independent of relapse activity event. Associations with radiological risk factors were broadly similar across the real and synthetic datasets. CONCLUSION: Artificial intelligence-generated synthetic data reliably replicated treatment-effect outcomes of Italian Multiple Sclerosis and Related Disorders Register data, supporting their potential use in clinically defined research settings.
Authors
- Massimo Filippi (ORCID: https://orcid.org/0000-0002-5485-0479)
- Diana Ferraro (ORCID: https://orcid.org/0000-0003-4818-3806)
- Elisabetta Sauta (ORCID: https://orcid.org/0000-0002-7830-988X)
- Saverio D’Amico (ORCID: https://orcid.org/0000-0003-1877-8497)
- Maria Gabriella Coniglio
- Victor Savevski (ORCID: https://orcid.org/0000-0002-3376-8740)
- María Trojano (ORCID: https://orcid.org/0000-0002-6329-8946)
- Tommaso Guerra (ORCID: https://orcid.org/0000-0002-5248-5981)
- Emilio Portaccio (ORCID: https://orcid.org/0000-0002-9662-1762)
- Maria Pia Amato (ORCID: https://orcid.org/0000-0003-3325-3760)
- Pietro Iaffaldano (ORCID: https://orcid.org/0000-0003-2308-1731)
- Giovanna De Luca (ORCID: https://orcid.org/0000-0002-7693-2256)
- Francesca Caputo (ORCID: https://orcid.org/0000-0002-6734-0523)
- Rocco Totaro (ORCID: https://orcid.org/0000-0001-5852-7743)
- Clara Grazia Chisari (ORCID: https://orcid.org/0000-0003-1607-543X)
- Damiano Paolicelli (ORCID: https://orcid.org/0000-0002-8645-1763)
- Matilde Inglese (ORCID: https://orcid.org/0000-0002-9610-0297)
- Matteo Foschi (ORCID: https://orcid.org/0000-0002-0321-7155)
- Giuseppe Salemi (ORCID: https://orcid.org/0000-0002-3756-4323)
- Massimiliano Copetti (ORCID: https://orcid.org/0000-0002-7960-5947)
- Maria Assunta Rocca (ORCID: https://orcid.org/0000-0003-2358-4320)
- Matteo Giovanni Della Porta (ORCID: https://orcid.org/0000-0002-6915-5970)
- Mattia Delleani (ORCID: https://orcid.org/0009-0004-1136-0930)
- Francesco Paolo Patti (ORCID: https://orcid.org/0000-0002-7975-2947)
- Vincenzo Brescia Morra (ORCID: https://orcid.org/0000-0003-0462-9618)
- Mario Alberto Battaglia
- Giuseppe Lucisano
- Filippo Emanuele Colella (ORCID: https://orcid.org/0009-0008-8618-714X)
Institutions
- Humanitas University (IT)
- Vita-Salute San Raffaele University (IT)
- University of L'Aquila (IT)
- Casa Sollievo della Sofferenza (IT)
- University of Catania (IT)
- University of Chieti-Pescara (IT)
- Azienda Unita' Sanitaria Locale Di Modena (IT)
- Ospedale "Santa Maria delle Croci" di Ravenna (IT)
- Azienda Unità Sanitaria Locale Della Romagna (IT)
- Don Carlo Gnocchi Foundation (IT)
- Federico II University Hospital (IT)
- Ospedale Madonna Delle Grazie (IT)
- Policlinico Universitario di Catania (IT)
- IRCCS Ospedale San Raffaele (IT)
- Tecnologie Avanzate (Italy) (IT)
- Ospedale Policlinico San Martino (IT)
- Ospedale SS. Annunziata (IT)
- Center for Outcomes Research and Clinical Epidemiology (IT)
- IRCCS Humanitas Research Hospital (IT)
- Istituto di Ricovero e Cura a Carattere Scientifico San Raffaele (IT)
- Fondazione Italiana Sclerosi Multipla (IT)
- University of Florence (IT)
- University of Bari Aldo Moro (IT)
- University of Palermo (IT)
Publication Details
- Journal
- Multiple Sclerosis Journal
- Published
- 2026-10-14
- DOI
- https://doi.org/10.1177/13524585261492525
- Primary Topic
- Multiple Sclerosis Research Studies
- Type
- article
- Field-Weighted Citation Impact
- 0.00