Controlled Comparison of KAN and MLP Fusion Heads in Multimodal Sentiment Analysis

This study tests whether Kolmogorov–Arnold Networks (KAN) outperform the Multilayer Perceptron (MLP) as a cross-modal fusion head. Sixteen configurations (BERT/DistilBERT text encoders, ViT/DeiT image encoders, concatenation or gated fusion, and MLP or KAN heads) were compared on MASAD (38,066 binary-labeled text-image pairs) and MVSA-Multiple (17,027 three-class pairs) under identical splits and protocols (ten seeds for the confirmatory BERT+ViT pair, five for the others). The primary metrics were domain-averaged F1 (MASAD) and weighted F1 (MVSA-Multiple). On MASAD, all configurations fell within a 95.3–96.0% weighted F1 band. Among the sixteen configurations, the best mean, 96.01 ± 0.19%, came from BERT+DeiT (concat)+MLP, and the best KAN configuration reached 95.74 ± 0.12%. For the confirmatory BERT+ViT pair, the head effect (KAN − MLP) in domain-averaged F1 was +0.19 points under concatenation (90% CI [−0.11; +0.49]) and −0.08 under gated fusion ([−0.36; +0.21]), within the pre-specified ±0.5-point equivalence margin; no other encoder pair showed a consistent head advantage. On MVSA-Multiple, no head was consistently superior, and wide intervals precluded an equivalence conclusion; a class-macro-F1 gain for gated KAN in the BERT+ViT pair (+1.77 points, 90% CI [0.00; +3.53]) was not reproduced for the other encoder pairs and remains exploratory. The findings do not support the assumption that KAN automatically improves multimodal fusion.

Authors

Institutions

Publication Details

Journal
Electronics
Published
2026-11-13
DOI
https://doi.org/10.3390/electronics15225286
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Controlled Comparison of KAN and MLP Fusion Heads in Multimodal Sentiment Analysis

Fatih Özkaynak, Eser Sert, Vahtettin Cem Baydoğan, Burak Yılmaz
2 links
Electronics
Sentiment Analysis and Opinion Mining
article

Controlled Comparison of KAN and MLP Fusion Heads in Multimodal Sentiment Analysis

Fatih Özkaynak, Eser Sert, Vahtettin Cem Baydoğan, Burak Yılmaz
article en

Abstract

This study tests whether Kolmogorov–Arnold Networks (KAN) outperform the Multilayer Perceptron (MLP) as a cross-modal fusion head. Sixteen configurations (BERT/DistilBERT text encoders, ViT/DeiT image encoders, concatenation or gated fusion, and MLP or KAN heads) were compared on MASAD (38,066 binary-labeled text-image pairs) and MVSA-Multiple (17,027 three-class pairs) under identical splits and protocols (ten seeds for the confirmatory BERT+ViT pair, five for the others). The primary metrics were domain-averaged F1 (MASAD) and weighted F1 (MVSA-Multiple). On MASAD, all configurations fell within a 95.3–96.0% weighted F1 band. Among the sixteen configurations, the best mean, 96.01 ± 0.19%, came from BERT+DeiT (concat)+MLP, and the best KAN configuration reached 95.74 ± 0.12%. For the confirmatory BERT+ViT pair, the head effect (KAN − MLP) in domain-averaged F1 was +0.19 points under concatenation (90% CI [−0.11; +0.49]) and −0.08 under gated fusion ([−0.36; +0.21]), within the pre-specified ±0.5-point equivalence margin; no other encoder pair showed a consistent head advantage. On MVSA-Multiple, no head was consistently superior, and wide intervals precluded an equivalence conclusion; a class-macro-F1 gain for gated KAN in the BERT+ViT pair (+1.77 points, 90% CI [0.00; +3.53]) was not reproduced for the other encoder pairs and remains exploratory. The findings do not support the assumption that KAN automatically improves multimodal fusion.

ElectronicsVol. 15(22)
Fırat University (TR), Malatya Turgut Özal Üniversitesi (TR), Turgut Özal University (TR)
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon