Comparative Study of ETL Tools for Transforming Healthcare Data to the OMOP Common Data Model (CDM)
Healthcare data is often complex, sparse, and frequently updated, which makes standardization essential. The OMOP Common Data Model (CDM) is gaining increasing attention because of its ability to standardize healthcare data and enable consistent and reproducible research outputs. This paper evaluates three ETL (Extract, Transform, Load) tools: Pentaho, Apache NiFi, and a custom-built tool to transform healthcare data into the OMOP CDM. The evaluation criteria, based on a literature review, include connectivity and interoperability, user interface and ease of use, performance, and technical flexibility. Results indicate that while minor differences in the tools' features exist, all tools are adequate for basic transformation tasks. Pentaho is noted for its ease of use, particularly helpful for non-expert users, while Apache NiFi is better suited for more advanced users. A custom-built tool, though often offering user-friendly interfaces and more flexibility, comes at the cost of additional development efforts.
Authors
- Florian Katsch (ORCID: https://orcid.org/0000-0001-7952-9326)
- Georg Duftschmid (ORCID: https://orcid.org/0000-0001-8007-0735)
- Maryam Jafarpour (ORCID: https://orcid.org/0000-0001-7266-5018)
- Adnan Jouned
- Heike Düsseldorf
Institutions
- Austrian Institute for Health Technology Assessment GmbH (AT)
- Medical University of Vienna (AT)
Publication Details
- Journal
- Studies in health technology and informatics
- Published
- 2025-05-15
- DOI
- https://doi.org/10.3233/shti250590
- Primary Topic
- Biomedical Text Mining and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00