Leveraging Algorithm-based Fault Tolerance for Propagation Error Detection in NPUs

As Deep Neural Networks (DNNs) advance, the need for fault-tolerant Neural Processing Units (NPUs) becomes crucial to prevent system failures in safety-critical applications. Transient faults caused by external disturbances like high-energy neutrons or alpha particles can significantly impact NPU reliability. Algorithm-Based Fault Tolerance (ABFT) uses checksums to detect computation errors efficiently at a low cost but has limitations in addressing propagation errors during data propagation. This paper proposes PED-ABFT, a technique that leverages checksums to detect both propagation and computation errors. PED-ABFT enhances error correction by distinguishing between these errors. Our experimental results show PED-ABFT improves error correction coverage by 1.46x with minimal hardware overhead.

Authors

Institutions

Publication Details

Published
2024-08-19
DOI
https://doi.org/10.1109/isocc62682.2024.10762293
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Leveraging Algorithm-based Fault Tolerance for Propagation Error Detection in NPUs

S. Kim, Seokin Hong
Distributed and Parallel Computing Systems
article

Leveraging Algorithm-based Fault Tolerance for Propagation Error Detection in NPUs

S. Kim, Seokin Hong
article en

Abstract

As Deep Neural Networks (DNNs) advance, the need for fault-tolerant Neural Processing Units (NPUs) becomes crucial to prevent system failures in safety-critical applications. Transient faults caused by external disturbances like high-energy neutrons or alpha particles can significantly impact NPU reliability. Algorithm-Based Fault Tolerance (ABFT) uses checksums to detect computation errors efficiently at a low cost but has limitations in addressing propagation errors during data propagation. This paper proposes PED-ABFT, a technique that leverages checksums to detect both propagation and computation errors. PED-ABFT enhances error correction by distinguishing between these errors. Our experimental results show PED-ABFT improves error correction coverage by 1.46x with minimal hardware overhead.

Sungkyunkwan University (KR)
National Research Foundation
Climate action
Openalex Percentile: Top 75%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.