Coordinated Flaw Disclosure for AI: Beyond Security Vulnerabilities

Harm reporting in Artificial Intelligence (AI) currently lacks a structured process for disclosing and addressing algorithmic flaws, relying largely on an ad-hoc approach. This contrasts sharply with the well-established Coordinated Vulnerability Disclosure (CVD) ecosystem in software security. While global efforts to establish frameworks for AI transparency and collaboration are underway, the unique challenges presented by machine learning (ML) models demand a specialized approach. To address this gap, we propose implementing a Coordinated Flaw Disclosure (CFD) framework tailored to the complexities of ML and AI issues. This paper reviews the evolution of ML disclosure practices, from ad hoc reporting to emerging participatory auditing methods, and compares them with cybersecurity norms. Our framework introduces innovations such as extended model cards, dynamic scope expansion, an independent adjudication panel, and an automated verification process. We also outline a forthcoming real-world pilot of CFD. We argue that CFD could significantly enhance public trust in AI systems. By balancing organizational and community interests, CFD aims to improve AI accountability in a rapidly evolving technological landscape.

Authors

Institutions

Publication Details

Journal
Proceedings of the AAAI/ACM Conference on AI Ethics and Society
Published
2024-10-16
DOI
https://doi.org/10.1609/aies.v7i1.31635
Citations
6
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
2.08
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Coordinated Flaw Disclosure for AI: Beyond Security Vulnerabilities

Avijit Ghosh, Sven Cattell, Lucie-Aimée Kaffee
6 citations
Proceedings of the AAAI/ACM Conference on AI Ethics and Society
Adversarial Robustness in Machine Learning
2.08
article

Coordinated Flaw Disclosure for AI: Beyond Security Vulnerabilities

Avijit Ghosh, Sven Cattell, Lucie-Aimée Kaffee
article en
6 citations

Abstract

Harm reporting in Artificial Intelligence (AI) currently lacks a structured process for disclosing and addressing algorithmic flaws, relying largely on an ad-hoc approach. This contrasts sharply with the well-established Coordinated Vulnerability Disclosure (CVD) ecosystem in software security. While global efforts to establish frameworks for AI transparency and collaboration are underway, the unique challenges presented by machine learning (ML) models demand a specialized approach. To address this gap, we propose implementing a Coordinated Flaw Disclosure (CFD) framework tailored to the complexities of ML and AI issues. This paper reviews the evolution of ML disclosure practices, from ad hoc reporting to emerging participatory auditing methods, and compares them with cybersecurity norms. Our framework introduces innovations such as extended model cards, dynamic scope expansion, an independent adjudication panel, and an automated verification process. We also outline a forthcoming real-world pilot of CFD. We argue that CFD could significantly enhance public trust in AI systems. By balancing organizational and community interests, CFD aims to improve AI accountability in a rapidly evolving technological landscape.

Proceedings of the AAAI/ACM Conference on AI Ethics and SocietyVol. 7
Children’s Village (US), FACE Foundation (US), Hugging Face (US)
Openalex Percentile: Top 11%
Adversarial Robustness in Machine Learning
2.08
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Coordinated Flaw Disclosure for AI: Beyond Security Vulnerabilities — Avijit Ghosh, Sven Cattell, et al. · Proceedings of the AAAI/ACM Conference on AI Ethics and Society (2024) | TGRS Research Map | TGRS