Detecting AI-Induced Risk Blind Spots in Technical Program Management Through Human–AI Decision Comparison
Generative artificial intelligence is increasingly used to support technical program managers in identifying delivery risks, but improved productivity does not necessarily imply more complete risk recognition. A critical failure mode arises when a manager initially identifies a material risk and later removes it after encountering an AI-generated assessment. This paper develops a human–AI decision-comparison method for detecting such omissions without equating disagreement with error. The framework records an unaided initial risk register, randomly assigns decision makers to a human-only second pass, ordinary AI assistance, or AI assistance with a structured challenge step, and assesses final decisions against independently adjudicated scenario risks. It distinguishes risk discovery, risk retention, and severity-weighted coverage using explicit transition measures and a multilevel comparison strategy. Domain-specific scenarios span cloud migration, data platforms, regulated delivery, and automotive system validation. The contribution is a reproducible measurement architecture for identifying whether AI assistance is associated with excess removal of risks that were previously recognized. The paper specifies testable causal contrasts and validity controls; it does not claim that an experiment has already been conducted.
Authors
- Nandkishore R Sawant
Institutions
- National Taiwan University of Science and Technology (TW)
- Applied Technical Services (United States) (US)
Publication Details
- Journal
- Journal of Artificial Intelligence General science (JAIGS)
- Published
- 2026-11-17
- DOI
- https://doi.org/10.60087/jaigs.v10i01.516
- Primary Topic
- Software Engineering Techniques and Practices
- Type
- article
- Field-Weighted Citation Impact
- 0.00