Building Safe & Resource Efficient NN through architectural collapse

Modern Convolutional Neural Networks (CNNs) often suffer from depth redundancy, where sequential layers increase inference latency and memory usage without significantly improving accuracy. To address this, we introduce Layer-by-Layer Structural Reduction (LBL), a post-hoc methodology that identifies contiguous layer blocks and collapses them into a single, lightweight surrogate module. By targeting depth redundancy directly, LBL aims to reduce sequential operations and increase hardware efficiency. While LBL streamlines networks for deployment, ensuring these resource-efficient models remain secure is critical. We are working on evaluating model resilience using Adversarial Particle Swarm Optimization (APSO), a data-agnostic, black-box framework that generates transferable adversarial examples to probe cross-model vulnerabilities. This ongoing work investigates how combining structural collapse with reproducible robustness metrics and Explainable AI (XAI) diagnostics can establish a unified paradigm for building and validating deep learning systems that are both computationally efficient and resilient to inference-time poisoning.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-02-09
DOI
https://doi.org/10.5281/zenodo.18552848
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Building Safe & Resource Efficient NN through architectural collapse

Jamil Gafur
Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
article

Building Safe & Resource Efficient NN through architectural collapse

Jamil Gafur
article en

Abstract

Modern Convolutional Neural Networks (CNNs) often suffer from depth redundancy, where sequential layers increase inference latency and memory usage without significantly improving accuracy. To address this, we introduce Layer-by-Layer Structural Reduction (LBL), a post-hoc methodology that identifies contiguous layer blocks and collapses them into a single, lightweight surrogate module. By targeting depth redundancy directly, LBL aims to reduce sequential operations and increase hardware efficiency. While LBL streamlines networks for deployment, ensuring these resource-efficient models remain secure is critical. We are working on evaluating model resilience using Adversarial Particle Swarm Optimization (APSO), a data-agnostic, black-box framework that generates transferable adversarial examples to probe cross-model vulnerabilities. This ongoing work investigates how combining structural collapse with reproducible robustness metrics and Explainable AI (XAI) diagnostics can establish a unified paradigm for building and validating deep learning systems that are both computationally efficient and resilient to inference-time poisoning.

Zenodo (CERN European Organization for Nuclear Research)
Decent work and economic growth
Openalex Percentile: Top 64%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.