Scoring_Standard_v3_conformance

As artificial intelligence systems become increasingly complex, interconnected, and autonomous, the limitations of existing evaluation metrics become more apparent. Current benchmarks and safety evaluations primarily assess output quality, task performance, or behavioral compliance, but they do not provide a standardized way to measure structural coherence. This creates a critical gap: systems may perform well on benchmarks while remaining fragile, drifting over time, or exhibiting incoherence across interacting scales. This paper proposes the Cognitive Multi-scale Coherence Index (CMCI) as a candidate standardized scoring framework for AI coherence. Inspired by the role of the Common Vulnerability Scoring System (CVSS) in cybersecurity, CMCI is introduced as a shared language for assessing, comparing, and communicating coherence-related system risk. The framework defines coherence as a multi-scale and transversal property of system integrity, proposes a normalized scoring structure with severity bands, a conformance specification that defines what any implementation must produce, and a calibration protocol for the bands. Building on prior work on Dynamic Coherence Windows and Cognitive Immune Protection, this paper positions CMCI not only as an analytical framework but as the basis for a common coherence scoring system. We outline its conceptual foundations, proposed scoring logic, candidate severity levels, and motivating evidence from three benchmark-adjacent analyses (HELM, HarmBench, and SOCRATES), each showing that structural coherence captures a dimension not visible through existing metrics alone. The goal of this paper is not to claim a finalized universal standard, but to establish the need, structure, and initial methodological basis for one. A standardized coherence score could improve evaluation transparency, risk communication, and system governance in AI, while providing a practical foundation for future calibration and cross-domain adoption.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-12
DOI
https://doi.org/10.5281/zenodo.20652381
Primary Topic
Adversarial Robustness in Machine Learning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Scoring_Standard_v3_conformance

Christian St-Louis
Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
preprint

Scoring_Standard_v3_conformance

Christian St-Louis
preprint en

Abstract

As artificial intelligence systems become increasingly complex, interconnected, and autonomous, the limitations of existing evaluation metrics become more apparent. Current benchmarks and safety evaluations primarily assess output quality, task performance, or behavioral compliance, but they do not provide a standardized way to measure structural coherence. This creates a critical gap: systems may perform well on benchmarks while remaining fragile, drifting over time, or exhibiting incoherence across interacting scales. This paper proposes the Cognitive Multi-scale Coherence Index (CMCI) as a candidate standardized scoring framework for AI coherence. Inspired by the role of the Common Vulnerability Scoring System (CVSS) in cybersecurity, CMCI is introduced as a shared language for assessing, comparing, and communicating coherence-related system risk. The framework defines coherence as a multi-scale and transversal property of system integrity, proposes a normalized scoring structure with severity bands, a conformance specification that defines what any implementation must produce, and a calibration protocol for the bands. Building on prior work on Dynamic Coherence Windows and Cognitive Immune Protection, this paper positions CMCI not only as an analytical framework but as the basis for a common coherence scoring system. We outline its conceptual foundations, proposed scoring logic, candidate severity levels, and motivating evidence from three benchmark-adjacent analyses (HELM, HarmBench, and SOCRATES), each showing that structural coherence captures a dimension not visible through existing metrics alone. The goal of this paper is not to claim a finalized universal standard, but to establish the need, structure, and initial methodological basis for one. A standardized coherence score could improve evaluation transparency, risk communication, and system governance in AI, while providing a practical foundation for future calibration and cross-domain adoption.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Scoring_Standard_v3_conformance — Christian St-Louis · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS