Kolmogorov-Arnold Networks in Transformer Attention for Low-Light Image Enhancement

Recent advancements in deep learning, particularly in Transformer architectures, have revolutionized tasks that require processing complex, highly-detailed data. One such task is low-light image enhancement, a critical sub-field of image restoration, which has benefited from extensive research into various Transformer models, each offering distinct strengths. This paper introduces a novel Transformer attention mechanism inspired by the Kolmogorov - Arnold representation theorem, leveraging learnable non-linearity and multivariate function de-composition. This attention mechanism is utilized to develop KAN - T, our Transformer network. These enhancements enable greater feature flexibility and broader context capture within the model. Our comprehensive experiments, both quantitative and qualitative, demonstrate that the proposed method achieves state-of-the-art performance in low-light image enhancement, highlighting its effectiveness and wide-ranging applicability.

Authors

Institutions

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/isetc63109.2024.10797300
Citations
5
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
1.60
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Kolmogorov-Arnold Networks in Transformer Attention for Low-Light Image Enhancement

Alexandru Brateanu, Raul Balmez
5 citations
Advanced Image Fusion Techniques
1.60
article

Kolmogorov-Arnold Networks in Transformer Attention for Low-Light Image Enhancement

Alexandru Brateanu, Raul Balmez
article en
5 citations

Abstract

Recent advancements in deep learning, particularly in Transformer architectures, have revolutionized tasks that require processing complex, highly-detailed data. One such task is low-light image enhancement, a critical sub-field of image restoration, which has benefited from extensive research into various Transformer models, each offering distinct strengths. This paper introduces a novel Transformer attention mechanism inspired by the Kolmogorov - Arnold representation theorem, leveraging learnable non-linearity and multivariate function de-composition. This attention mechanism is utilized to develop KAN - T, our Transformer network. These enhancements enable greater feature flexibility and broader context capture within the model. Our comprehensive experiments, both quantitative and qualitative, demonstrate that the proposed method achieves state-of-the-art performance in low-light image enhancement, highlighting its effectiveness and wide-ranging applicability.

University of Manchester (GB)
Openalex Percentile: Top 14%
Advanced Image Fusion Techniques
1.60
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.