AISLEX: Approximate individual sample learning entropy with JAX

We present AISLEX, an online anomaly detection module based on the Learning Entropy algorithm, a novel machine learning-based information measure that quantifies the learning effort of neural networks. AISLEX detects anomalous data samples when the learning entropy value is high. The module is designed to be readily usable, with both NumPy and JAX backends, making it suitable for various application fields. The NumPy backend is optimized for devices running Python3, prioritizing limited memory and CPU usage. In contrast, the JAX backend is optimized for fast execution on CPUs, GPUs, and TPUs but requires more computational resources. AISLEX also provides extensive implementation examples in Jupyter notebooks, utilizing in-parameter-linear-nonlinear neural architectures selected for their low data requirements, computational simplicity, convergence analyzability, and dynamical stability.

Authors

Institutions

Publication Details

Journal
SoftwareX
Published
2024-10-07
DOI
https://doi.org/10.1016/j.softx.2024.101915
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AISLEX: Approximate individual sample learning entropy with JAX

Ivo Bukovský, Milan Novák, Ondřej Budík, Florian Sobieczky
SoftwareX
Anomaly Detection Techniques and Applications
article

AISLEX: Approximate individual sample learning entropy with JAX

Ivo Bukovský, Milan Novák, Ondřej Budík, Florian Sobieczky
article en

Abstract

We present AISLEX, an online anomaly detection module based on the Learning Entropy algorithm, a novel machine learning-based information measure that quantifies the learning effort of neural networks. AISLEX detects anomalous data samples when the learning entropy value is high. The module is designed to be readily usable, with both NumPy and JAX backends, making it suitable for various application fields. The NumPy backend is optimized for devices running Python3, prioritizing limited memory and CPU usage. In contrast, the JAX backend is optimized for fast execution on CPUs, GPUs, and TPUs but requires more computational resources. AISLEX also provides extensive implementation examples in Jupyter notebooks, utilizing in-parameter-linear-nonlinear neural architectures selected for their low data requirements, computational simplicity, convergence analyzability, and dynamical stability.

SoftwareXVol. 28
Sewanee: The University of the South (US), University of South Bohemia in České Budějovice (CZ), Software Competence Center Hagenberg (Austria) (AT), Czech Technical University in Prague (CZ)
České Vysoké Učení Technické v Praze, European Commission, Ministerstvo Školství, Mládeže a Tělovýchovy, Interreg
Openalex Percentile: Top 85%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.