Pilot Federated Analysis Projects

The Cambrian explosion of Trusted Research Environments (TREs) will inevitably lead to increased data siloing and potentially decrease achievable data science. Federated access to data is a mitigation against this risk. The presentation will cover two major infrastructure demonstrator projects to address this need and start the UK journey towards interconnected TRE’s. TELEPORT was an infrastructure to connect TREs and allow all the data assets to be seen through a single pane of glass while leaving them in situ; the analysis can be performed on each data asset, as well as combining data from multiple TREs to derive knowledge. The analysis is performed within the construct of a pop-up TRE, which is a temporary project-specific TRE. The data governance model is operated in an as-is state, with all egress controls being applied upon extraction of research output. This method has been termed Federated Data. TREFX is a set of infrastructure based around international GA4GH standards and the RO-CRATE concept to provide a platform to send complex workflows to the TRE’s to be performed upon the data assets, with the output post egress checking to be re-packed into the inbound RO-CRATE prior to being returned to the researcher. This method addresses both federated analysis and method reproducibility. This project was extended to cover ADDI workloads for dementia. Both solutions were jointly developed by Swansea University / SeRP and share common elements. Future work will see both these products being combined into a hybrid approach as well as spin-out products and services.

Authors

Institutions

Publication Details

Journal
International Journal for Population Data Science
Published
2024-09-10
DOI
https://doi.org/10.23889/ijpds.v9i5.2515
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Pilot Federated Analysis Projects

Simon Thompson
International Journal for Population Data Science
Data Quality and Management
article

Pilot Federated Analysis Projects

Simon Thompson
article en

Abstract

The Cambrian explosion of Trusted Research Environments (TREs) will inevitably lead to increased data siloing and potentially decrease achievable data science. Federated access to data is a mitigation against this risk. The presentation will cover two major infrastructure demonstrator projects to address this need and start the UK journey towards interconnected TRE’s. TELEPORT was an infrastructure to connect TREs and allow all the data assets to be seen through a single pane of glass while leaving them in situ; the analysis can be performed on each data asset, as well as combining data from multiple TREs to derive knowledge. The analysis is performed within the construct of a pop-up TRE, which is a temporary project-specific TRE. The data governance model is operated in an as-is state, with all egress controls being applied upon extraction of research output. This method has been termed Federated Data. TREFX is a set of infrastructure based around international GA4GH standards and the RO-CRATE concept to provide a platform to send complex workflows to the TRE’s to be performed upon the data assets, with the output post egress checking to be re-packed into the inbound RO-CRATE prior to being returned to the researcher. This method addresses both federated analysis and method reproducibility. This project was extended to cover ADDI workloads for dementia. Both solutions were jointly developed by Swansea University / SeRP and share common elements. Future work will see both these products being combined into a hybrid approach as well as spin-out products and services.

International Journal for Population Data ScienceVol. 9(5)
Swansea University (GB)
Openalex Percentile: Top 82%
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Pilot Federated Analysis Projects — Simon Thompson · International Journal for Population Data Science (2024) | TGRS Research Map | TGRS