<b>Debreu Activation: A Novel Monotonic and Continuous Function Inspired by Economic Theory for Deep Learning</b>

Activation functions are the core components of nonlinear modeling in neural networks. This paper proposes a new activation function inspired by Gérard Debreu's utility theory and verifies its effectiveness in image classification tasks. Unlike traditional activation functions that only focus on mathematical convenience or gradient propagation characteristics, this paper attempts to introduce the concept of "preferring strict incrementality and continuity" in economics into deep learning. By constructing a composite function structure with strict monotonicity and continuity, we design a new universal activation function, Debreu Activation. Experiments show that this activation function can bring a stable and small performance improvement without increasing the complexity of training, and is applicable to a variety of neural network structures.

Publication Details

Journal
Figshare
Published
2025-01-01
DOI
https://doi.org/10.6084/m9.figshare.29423780.v1
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Debreu Activation: A Novel Monotonic and Continuous Function Inspired by Economic Theory for Deep Learning

Figshare
Explainable Artificial Intelligence (XAI)
article

Debreu Activation: A Novel Monotonic and Continuous Function Inspired by Economic Theory for Deep Learning

article en

Abstract

Activation functions are the core components of nonlinear modeling in neural networks. This paper proposes a new activation function inspired by Gérard Debreu's utility theory and verifies its effectiveness in image classification tasks. Unlike traditional activation functions that only focus on mathematical convenience or gradient propagation characteristics, this paper attempts to introduce the concept of "preferring strict incrementality and continuity" in economics into deep learning. By constructing a composite function structure with strict monotonicity and continuity, we design a new universal activation function, Debreu Activation. Experiments show that this activation function can bring a stable and small performance improvement without increasing the complexity of training, and is applicable to a variety of neural network structures.

Figshare
Decent work and economic growth
Openalex Percentile: Top 74%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.