RELEASE-AI:Protecting Sensitive Data Across The AI Lifecycle Disclosure Risks and Mitigations in Trusted Research Environments

Trusted Research Environments (TREs) provide secure access to personal and sensitive data, such as Electronic Healthcare Records (EHRs), for approved research. The increasing use of Artificial Intelligence (AI) and Machine Learning (ML) in health research introduces new challenges for managing privacy risks of individuals’ data. We present a comprehensive framework that embeds mitigation strategies throughout the entire AI project lifecycle, structured across six project phases: design, governance, development, evaluation, disclosure control, and release.<br/><br/>This framework aims to empower all stakeholders - researchers, project teams, output checkers, and TRE staff - with clear, phase-specific recommendations on which measures and checks are necessary before model release to help identify potential disclosure risks to data. It promotes early identification of risks with corresponding mitigations and ensures responsibilities are clearly assigned to relevant actors at each stage, from initial planning through to deployment and monitoring. Mitigation strategies include good AI/ML practices, both in terms of code and documentation, privacy-enhancing techniques during training and evaluation, restricting model access via secure query systems, licencing agreements, and adversarial attack testing using tools like SACRO-ML. This process highlights the need to train everyone involved appropriately with relevant role-specific material.<br/><br/>A novel tiering system for disclosure control is proposed, categorising AI projects based on the likelihood of attack and associated sensitive data leakage risks. By integrating a lifecycle-focused risk management process with a scalable disclosure control tiering system, this approach enables innovative AI research while maintaining rigorous data protection standards and public trust.

Publication Details

Journal
Discovery Research Portal (University of Dundee)
Published
2025-09-23
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

RELEASE-AI:Protecting Sensitive Data Across The AI Lifecycle Disclosure Risks and Mitigations in Trusted Research Environments

Discovery Research Portal (University of Dundee)
Scientific Computing and Data Management
article

RELEASE-AI:Protecting Sensitive Data Across The AI Lifecycle Disclosure Risks and Mitigations in Trusted Research Environments

article en

Abstract

Trusted Research Environments (TREs) provide secure access to personal and sensitive data, such as Electronic Healthcare Records (EHRs), for approved research. The increasing use of Artificial Intelligence (AI) and Machine Learning (ML) in health research introduces new challenges for managing privacy risks of individuals’ data. We present a comprehensive framework that embeds mitigation strategies throughout the entire AI project lifecycle, structured across six project phases: design, governance, development, evaluation, disclosure control, and release.<br/><br/>This framework aims to empower all stakeholders - researchers, project teams, output checkers, and TRE staff - with clear, phase-specific recommendations on which measures and checks are necessary before model release to help identify potential disclosure risks to data. It promotes early identification of risks with corresponding mitigations and ensures responsibilities are clearly assigned to relevant actors at each stage, from initial planning through to deployment and monitoring. Mitigation strategies include good AI/ML practices, both in terms of code and documentation, privacy-enhancing techniques during training and evaluation, restricting model access via secure query systems, licencing agreements, and adversarial attack testing using tools like SACRO-ML. This process highlights the need to train everyone involved appropriately with relevant role-specific material.<br/><br/>A novel tiering system for disclosure control is proposed, categorising AI projects based on the likelihood of attack and associated sensitive data leakage risks. By integrating a lifecycle-focused risk management process with a scalable disclosure control tiering system, this approach enables innovative AI research while maintaining rigorous data protection standards and public trust.

Discovery Research Portal (University of Dundee)
Openalex Percentile: Top 19%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.