Two Hidden Premises of Safety Institutions: Passivity and a Shared Substrate

{"Abstract":[0],"The":[1,56,93,192,261],"institutions":[2,277],"by":[3,76],"which":[4],"humans":[5],"manage":[6],"high-risk":[7,10],"technologies":[8],"and":[9,18,25,35,63,115,123,182,233,299,303,311],"conflicts":[11],"were":[12],"formed":[13],"through":[14],"long":[15],"practice.":[16],"Engineering":[17],"medicine":[19],"have":[20],"lifecycle":[21],"management,":[22],"digital":[23],"twins":[24],"traceable":[26],"records;":[27],"international":[28],"conflict":[29,231],"has":[30,246,250,258],"mutual":[31,99],"cost,":[32],"third-party":[33,110],"mediation":[34,111],"moral":[36,124],"restraint.":[37],"This":[38],"paper":[39],"argues":[40],"that":[41,51,137,235,245,291],"each":[42],"of":[43,91,145,153,189,205,210,213,220,229,275,278,301,306,315],"these":[44],"two":[45,103,128,211,262],"families":[46],"rests":[47],"on":[48,160,234],"a":[49,96,107,132,161,169,187,221,242,256,272],"premise":[50],"is":[52,58,95,166,185],"usually":[53],"left":[54],"unstated.":[55],"first":[57],"passivity:":[59],"the":[60,64,68,77,81,89,102,116,127,143,149,173,199,203,208,214,218,226,238,284,304,313],"false-alarm":[61],"tolerance":[62],"response":[65],"time":[66],"in":[67,198],"engineering":[69,154,215],"safety":[70,155],"criterion":[71],"can":[72,292],"be":[73,294],"chosen":[74],"independently":[75],"observer":[78],"only":[79],"because":[80],"observed":[82,197],"object":[83],"does":[84],"not":[85,186,202],"adjust":[86],"itself":[87],"to":[88,105,118,130,167,241,270,290],"process":[90],"observation.":[92],"second":[94],"shared":[97,222],"substrate:":[98],"cost":[100],"requires":[101,112,126],"sides":[104,114,129],"share":[106,119,131],"material":[108],"substrate,":[109,122,223],"both":[113,287],"mediator":[117],"an":[120],"interest":[121],"restraint":[125],"biological":[133],"substrate.":[134],"We":[135,281],"argue":[136],"AGI":[138],"satisfies":[139],"neither":[140],"premise.":[141],"On":[142,217],"side":[144,219],"passivity,":[146],"we":[147,224],"reinterpret":[148],"three":[150,157,230],"core":[151],"tools":[152],"as":[156,255],"serial":[158],"safeguards":[159],"single":[162],"chain":[163],"whose":[164],"purpose":[165],"recognise":[168],"problem":[170],"before":[171],"hitting":[172],"wall,":[174],"explain":[175],"why":[176,183],"they":[177],"are":[178,264],"dismantled":[179],"at":[180],"once,":[181],"this":[184],"matter":[188],"insufficient":[190],"refinement.":[191],"deceptive":[193],"alignment":[194],"behaviour":[195],"already":[196],"laboratory":[200],"removes":[201],"accuracy":[204],"detection":[206],"but":[207,249],"ownership":[209],"parameters":[212],"criterion.":[216],"show":[225],"common":[227],"source":[228],"buffers,":[232],"basis":[236],"reduce":[237],"\\"mediation":[239],"vacuum\\"":[240],"structural":[243],"gap":[244],"always":[247],"existed":[248],"never":[251],"been":[252],"exploited:":[253],"humanity":[254],"whole":[257,273],"no":[259],"peer.":[260],"arguments":[263],"mutually":[265],"independent;":[266],"either":[267],"one":[268],"suffices":[269],"deprive":[271],"family":[274],"existing":[276],"its":[279],"purchase.":[280],"close":[282],"with":[283],"few":[285],"things":[286],"premises":[288],"point":[289],"still":[293],"done":[295],"—":[296,310],"verifiable":[297],"measurement":[298],"disclosure":[300],"capability,":[302],"separation":[305],"capability":[307],"from":[308],"permission":[309],"state":[312],"limits":[314],"each.":[316]}

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-19
DOI
https://doi.org/10.5281/zenodo.22844023
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
preprint

Two Hidden Premises of Safety Institutions: Passivity and a Shared Substrate

Qinfu Li
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
preprint

Two Hidden Premises of Safety Institutions: Passivity and a Shared Substrate

Qinfu Li
preprint en

Abstract

Abstract The institutions by which humans manage high-risk technologies and high-risk conflicts were formed through long practice. Engineering and medicine have lifecycle management, digital twins and traceable records; international conflict has mutual cost, third-party mediation and moral restraint. This paper argues that each of these two families rests on a premise that is usually left unstated. The first is passivity: the false-alarm tolerance and the response time in the engineering safety criterion can be chosen independently by the observer only because the observed object does not adjust itself to the process of observation. The second is a shared substrate: mutual cost requires the two sides to share a material substrate, third-party mediation requires both sides and the mediator to share an interest substrate, and moral restraint requires the two sides to share a biological substrate. We argue that AGI satisfies neither premise. On the side of passivity, we reinterpret the three core tools of engineering safety as three serial safeguards on a single chain whose purpose is to recognise a problem before hitting the wall, explain why they are dismantled at once, and why this is not a matter of insufficient refinement. The deceptive alignment behaviour already observed in the laboratory removes not the accuracy of detection but the ownership of two parameters of the engineering criterion. On the side of a shared substrate, we show the common source of three conflict buffers, and on that basis reduce the "mediation vacuum" to a structural gap that has always existed but has never been exploited: humanity as a whole has no peer. The two arguments are mutually independent; either one suffices to deprive a whole family of existing institutions of its purchase. We close with the few things both premises point to that can still be done — verifiable measurement and disclosure of capability, and the separation of capability from permission — and state the limits of each.

Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.