On the Decoding Complexity of Error Correction Code Transformer

Belief propagation (BP) decoding achieves near-optimal performance with large block lengths but faces performance degradation with short blocks. Recent advances in deep learning have spurred research into neural decoders to overcome the limitations of BP decoding. The error correction code transformer (ECCT) offers state-of-the-art decoding performance, yet it demands substantial computational complexity and memory usage. This paper analyzes the hardware complexity of ECCT compared to the basic neural decoder, neural BP (NBP). We also explore strategies for model simplification, showing that applying quantization techniques can reduce resource overhead while maintaining high performance. This paper highlights the potential for advancing neural decoders to achieve greater efficiency and performance.

Authors

Institutions

Publication Details

Published
2024-10-16
DOI
https://doi.org/10.1109/ictc62082.2024.10826987
Primary Topic
Error Correcting Code Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

On the Decoding Complexity of Error Correction Code Transformer

Seungjun Kim, Youngjoo Lee, Jeongwon Choe
Error Correcting Code Techniques
article

On the Decoding Complexity of Error Correction Code Transformer

Seungjun Kim, Youngjoo Lee, Jeongwon Choe
article en

Abstract

Belief propagation (BP) decoding achieves near-optimal performance with large block lengths but faces performance degradation with short blocks. Recent advances in deep learning have spurred research into neural decoders to overcome the limitations of BP decoding. The error correction code transformer (ECCT) offers state-of-the-art decoding performance, yet it demands substantial computational complexity and memory usage. This paper analyzes the hardware complexity of ECCT compared to the basic neural decoder, neural BP (NBP). We also explore strategies for model simplification, showing that applying quantization techniques can reduce resource overhead while maintaining high performance. This paper highlights the potential for advancing neural decoders to achieve greater efficiency and performance.

Pohang University of Science and Technology (KR)
National Research Foundation of Korea
Openalex Percentile: Top 70%
Error Correcting Code Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.