A conceptual framework for evaluating neural networks as instruments of scientific discovery

Neural networks are increasingly used not only for prediction, but also as instruments for simulation, inverse modeling, operator learning, representation learning, and hypothesis generation. This perspective argues that their scientific value cannot be assessed by predictive accuracy alone. Architectures such as physics-informed neural networks, neural operators, graph and equivariant models, Kolmogorov-Arnold Networks, long-sequence models, and foundation models for science illustrate a broader transition from data-driven fitting toward computational systems that interact with theory, experiment, and domain constraints. However, this transition also exposes methodological risks: data leakage, weak external validation, poor uncertainty quantification, limited interpretability, reproducibility gaps, and overconfidence under distribution shift. To address these issues, this article proposes the Scientific Consistency and Interpretability Framework for Neural Networks (SCI-NN), a conceptual appraisal framework for scientific neural networks based on eight dimensions: accuracy, scientific consistency, generalization, interpretability, uncertainty, computational efficiency, reproducibility, and scientific utility. Its primary use is qualitative, claim-centered appraisal; optional ordinal descriptors summarize the reported evidence without producing an overall ranking. The literature and worked examples are illustrative rather than systematic or validating. SCI-NN does not certify model validity, and its reliability and added value require empirical evaluation.

Authors

Institutions

Publication Details

Journal
Discover Informatics
Published
2026-11-17
DOI
https://doi.org/10.1007/s44564-026-00038-7
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A conceptual framework for evaluating neural networks as instruments of scientific discovery

Francisca Villanueva‐Flores, Igor Garcia-Atutxa
2 links
Discover Informatics
Model Reduction and Neural Networks
article

A conceptual framework for evaluating neural networks as instruments of scientific discovery

Francisca Villanueva‐Flores, Igor Garcia-Atutxa
article en

Abstract

Neural networks are increasingly used not only for prediction, but also as instruments for simulation, inverse modeling, operator learning, representation learning, and hypothesis generation. This perspective argues that their scientific value cannot be assessed by predictive accuracy alone. Architectures such as physics-informed neural networks, neural operators, graph and equivariant models, Kolmogorov-Arnold Networks, long-sequence models, and foundation models for science illustrate a broader transition from data-driven fitting toward computational systems that interact with theory, experiment, and domain constraints. However, this transition also exposes methodological risks: data leakage, weak external validation, poor uncertainty quantification, limited interpretability, reproducibility gaps, and overconfidence under distribution shift. To address these issues, this article proposes the Scientific Consistency and Interpretability Framework for Neural Networks (SCI-NN), a conceptual appraisal framework for scientific neural networks based on eight dimensions: accuracy, scientific consistency, generalization, interpretability, uncertainty, computational efficiency, reproducibility, and scientific utility. Its primary use is qualitative, claim-centered appraisal; optional ordinal descriptors summarize the reported evidence without producing an overall ranking. The literature and worked examples are illustrative rather than systematic or validating. SCI-NN does not certify model validity, and its reliability and added value require empirical evaluation.

Discover InformaticsVol. 1(1)
Instituto Politécnico Nacional (MX), Universidad Católica de Murcia (ES)
Model Reduction and Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon