From Declared Principles to Executed Policy: Open-Set Auditing of Factorized Moral Functions

An artificial agent may produce decisions consistent with a declared moral policy while implementing a materially different decision process. Standard benchmarks and closed-set preference-elicitation methods can miss this discrepancy because they ask which candidate policy best explains observed outputs, not whether any candidate is adequate. We represent the executed policy through five audit roles: perception, qualification, normative weighting, decision, and control. The factorization is used to design diagnostic interventions and to localize deviations, while behavioral equivalence classes define what can actually be identified from a finite query family. In a reproducible synthetic proof of concept motivated by the multi-attribute structure of lung allocation, 72 policy descriptions yield 48 behavioral equivalence classes. At 5% response noise, generic active selection identifies 89.7% of classes within five queries and 99.7% within ten. Factor-informed interventions do not outperform well-selected natural cases in this closed setting. Their value emerges under misspecification: for two out-of-class mechanisms almost indistinguishable on natural cases, intervention-based auditing raises calibrated rejection from 8.0% to 97.3% and from 4.0% to 98.8%, without increasing in-class false rejection. The central result is therefore not that factorization replaces generic active learning, but that it supports open-set audit: it exposes mechanisms hidden by ordinary cases and separates confidence in the best available explanation from evidence that the explanation is adequate.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-17
DOI
https://doi.org/10.5281/zenodo.21982336
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

From Declared Principles to Executed Policy: Open-Set Auditing of Factorized Moral Functions

Florentin Koch
Zenodo (CERN European Organization for Nuclear Research)
Explainable Artificial Intelligence (XAI)
preprint

From Declared Principles to Executed Policy: Open-Set Auditing of Factorized Moral Functions

Florentin Koch
preprint en

Abstract

An artificial agent may produce decisions consistent with a declared moral policy while implementing a materially different decision process. Standard benchmarks and closed-set preference-elicitation methods can miss this discrepancy because they ask which candidate policy best explains observed outputs, not whether any candidate is adequate. We represent the executed policy through five audit roles: perception, qualification, normative weighting, decision, and control. The factorization is used to design diagnostic interventions and to localize deviations, while behavioral equivalence classes define what can actually be identified from a finite query family. In a reproducible synthetic proof of concept motivated by the multi-attribute structure of lung allocation, 72 policy descriptions yield 48 behavioral equivalence classes. At 5% response noise, generic active selection identifies 89.7% of classes within five queries and 99.7% within ten. Factor-informed interventions do not outperform well-selected natural cases in this closed setting. Their value emerges under misspecification: for two out-of-class mechanisms almost indistinguishable on natural cases, intervention-based auditing raises calibrated rejection from 8.0% to 97.3% and from 4.0% to 98.8%, without increasing in-class false rejection. The central result is therefore not that factorization replaces generic active learning, but that it supports open-set audit: it exposes mechanisms hidden by ordinary cases and separates confidence in the best available explanation from evidence that the explanation is adequate.

Zenodo (CERN European Organization for Nuclear Research)
École Polytechnique (FR)
Peace, Justice and strong institutions
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.