Action Substitution Versus Fallback Shields in Constrained POMDPs Under Distribution Shift

Shields check the actions proposed by learning or planning agents against a safety speciffcation before execution. A fallback shield replaces an unsafe action with a ffxed default, whereas a projection shield selects the nearest admissible action. This study shows that these operators are not interchangeable when the default action is itself inadmissible. It formalizes an admissible action envelope synthesized from a probabilistic temporal-logic speciffcation and proves that a null fallback cannot restore admissibility when the speciffcation requires a positive action. The operators are evaluated in a constrained partially observable Markov decision process (POMDP) model of a three-echelon supply network under distribution shift, using 800 seed-paired runs. Under a ffxed robust policy, projection achieved a service level of 0.670, compared with 0.059 for the fallback (\( E^{+}=1.62\times10^{6} \)). Under a tabular Q-learning policy trained online with shielding, the values were 0.649 and 0.063 (\( E^{+}=9.35\times10^{5} \)). The study also examines warm-up contamination in an adaptive conformal shift detector. Excluding early forecasting scores reduced calibration error in the predicted direction, but the effect did not reach the familywise threshold and explained only part of the observed under-ffagging.

Authors

Publication Details

Journal
Preprints.org
Published
2026-10-26
DOI
https://doi.org/10.20944/preprints202610.2453.v1
Primary Topic
Formal Methods in Verification
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Action Substitution Versus Fallback Shields in Constrained POMDPs Under Distribution Shift

Jorge Hernandez, Hiram Herrera, David Ortiz, Ruben Machucho et al.
Preprints.org
Formal Methods in Verification
preprint

Action Substitution Versus Fallback Shields in Constrained POMDPs Under Distribution Shift

Jorge Hernandez, Hiram Herrera, David Ortiz, Ruben Machucho, Julio Garcia, Jose Lopez
preprint en

Abstract

Shields check the actions proposed by learning or planning agents against a safety speciffcation before execution. A fallback shield replaces an unsafe action with a ffxed default, whereas a projection shield selects the nearest admissible action. This study shows that these operators are not interchangeable when the default action is itself inadmissible. It formalizes an admissible action envelope synthesized from a probabilistic temporal-logic speciffcation and proves that a null fallback cannot restore admissibility when the speciffcation requires a positive action. The operators are evaluated in a constrained partially observable Markov decision process (POMDP) model of a three-echelon supply network under distribution shift, using 800 seed-paired runs. Under a ffxed robust policy, projection achieved a service level of 0.670, compared with 0.059 for the fallback (\( E^{+}=1.62\times10^{6} \)). Under a tabular Q-learning policy trained online with shielding, the values were 0.649 and 0.063 (\( E^{+}=9.35\times10^{5} \)). The study also examines warm-up contamination in an adaptive conformal shift detector. Excluding early forecasting scores reduced calibration error in the predicted direction, but the effect did not reach the familywise threshold and explained only part of the observed under-ffagging.

Preprints.org
Formal Methods in Verification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon