<b>A Novel Utility-Driven Residual Connection Inspired by Debreu's Theorem</b>

This paper proposes a residual connection mechanism based on the idea of Debreu's theorem in economics and applies it to the multi-layer perceptron model (MLP). By introducing a "utility function" module with monotonicity constraints as an auxiliary channel, we add a structure that simulates preference enhancement on the basis of the original feature map to form a "utility residual connection". Experimental results show that on the CIFAR-10 dataset, the improved model has a slight improvement in accuracy, recall rate and F1 score compared with the standard MLP, while the training time is slightly reduced. More importantly, the structure has good versatility and can be extended to convolutional neural networks, graph neural networks and transformer structures, providing a new inspiration path for the design of deep learning structures.

Publication Details

Journal
Figshare
Published
2025-01-01
DOI
https://doi.org/10.6084/m9.figshare.29423786
Primary Topic
Clay minerals and soil interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Novel Utility-Driven Residual Connection Inspired by Debreu's Theorem

Figshare
Clay minerals and soil interactions
article

A Novel Utility-Driven Residual Connection Inspired by Debreu's Theorem

article en

Abstract

This paper proposes a residual connection mechanism based on the idea of Debreu's theorem in economics and applies it to the multi-layer perceptron model (MLP). By introducing a "utility function" module with monotonicity constraints as an auxiliary channel, we add a structure that simulates preference enhancement on the basis of the original feature map to form a "utility residual connection". Experimental results show that on the CIFAR-10 dataset, the improved model has a slight improvement in accuracy, recall rate and F1 score compared with the standard MLP, while the training time is slightly reduced. More importantly, the structure has good versatility and can be extended to convolutional neural networks, graph neural networks and transformer structures, providing a new inspiration path for the design of deep learning structures.

Figshare
Openalex Percentile: Top 69%
Clay minerals and soil interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.