AISLEX: Approximate individual sample learning entropy with JAX
We present AISLEX, an online anomaly detection module based on the Learning Entropy algorithm, a novel machine learning-based information measure that quantifies the learning effort of neural networks. AISLEX detects anomalous data samples when the learning entropy value is high. The module is designed to be readily usable, with both NumPy and JAX backends, making it suitable for various application fields. The NumPy backend is optimized for devices running Python3, prioritizing limited memory and CPU usage. In contrast, the JAX backend is optimized for fast execution on CPUs, GPUs, and TPUs but requires more computational resources. AISLEX also provides extensive implementation examples in Jupyter notebooks, utilizing in-parameter-linear-nonlinear neural architectures selected for their low data requirements, computational simplicity, convergence analyzability, and dynamical stability.
Authors
- Ivo Bukovský (ORCID: https://orcid.org/0000-0002-7715-2841)
- Milan Novák (ORCID: https://orcid.org/0000-0003-3636-8002)
- Ondřej Budík
- Florian Sobieczky (ORCID: https://orcid.org/0000-0001-5228-0153)
Institutions
- Sewanee: The University of the South (US)
- University of South Bohemia in České Budějovice (CZ)
- Software Competence Center Hagenberg (Austria) (AT)
- Czech Technical University in Prague (CZ)
Publication Details
- Journal
- SoftwareX
- Published
- 2024-10-07
- DOI
- https://doi.org/10.1016/j.softx.2024.101915
- Primary Topic
- Anomaly Detection Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- České Vysoké Učení Technické v Praze
- European Commission
- Ministerstvo Školství, Mládeže a Tělovýchovy
- Interreg