Statistically Aware Optimization for Resource-constrained and Geometrically-rich Data: Nigerian Agricultural Case Study

Modern machine learning, fueled by large datasets and complex models, faces a critical tension. The statistical principles underpinning learning (generalization, efficiency, robustness) often clash with the computational realities of optimization, especially in a resource constrained environment or when data exhibits inherent geometric structure. This work addresses the theme "Statistics Meets Optimization" by employing an optimization framework explicitly designed to leverage statistical data properties, particularly group invariances/equivariances common in real world data (e.g., spatial rotations in satellite imagery, temporal shifts in sensor data), to achieve significant gains in sample efficiency and convergence speed. We theoretically derive generalization bounds linking the exploitation of data geometry to reduced sample complexity. Empirically, we demonstrate the efficacy of our method on a challenging real world case study, i.e., on predicting crop yield anomalies in Delta State, Nigeria, using limited, noisy, and spatially heterogeneous satellite and meteorological data. Our optimizer achieved a significant performance with 40% less data compared to adaptive baselines (Adam, RMSProp), highlighting the practical impact of statistically-informed optimization, especially for regions facing data scarcity. This work provides a concrete bridge between statistical theory (data structure, efficiency) and optimization practice (algorithm design, scalability), demonstrating that geometry-aware algorithms can democratize effective ML for resource-limited applications.

Authors

Institutions

Publication Details

Journal
International Journal of Systems Science and Applied Mathematics
Published
2025-11-26
DOI
https://doi.org/10.11648/j.ijssam.20251003.12
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Statistically Aware Optimization for Resource-constrained and Geometrically-rich Data: Nigerian Agricultural Case Study

A. Afolalu Sunday, O. Ogutu Joseph, Ejakpovi Uyovwieyovwe, Emunefe Gabriel et al.
International Journal of Systems Science and Applied Mathematics
Machine Learning and Data Classification
article

Statistically Aware Optimization for Resource-constrained and Geometrically-rich Data: Nigerian Agricultural Case Study

A. Afolalu Sunday, O. Ogutu Joseph, Ejakpovi Uyovwieyovwe, Emunefe Gabriel, Akworigbe Avwerosuoghene, Adelakun Olawale, Ovbije Godspower
article en

Abstract

Modern machine learning, fueled by large datasets and complex models, faces a critical tension. The statistical principles underpinning learning (generalization, efficiency, robustness) often clash with the computational realities of optimization, especially in a resource constrained environment or when data exhibits inherent geometric structure. This work addresses the theme "Statistics Meets Optimization" by employing an optimization framework explicitly designed to leverage statistical data properties, particularly group invariances/equivariances common in real world data (e.g., spatial rotations in satellite imagery, temporal shifts in sensor data), to achieve significant gains in sample efficiency and convergence speed. We theoretically derive generalization bounds linking the exploitation of data geometry to reduced sample complexity. Empirically, we demonstrate the efficacy of our method on a challenging real world case study, i.e., on predicting crop yield anomalies in Delta State, Nigeria, using limited, noisy, and spatially heterogeneous satellite and meteorological data. Our optimizer achieved a significant performance with 40% less data compared to adaptive baselines (Adam, RMSProp), highlighting the practical impact of statistically-informed optimization, especially for regions facing data scarcity. This work provides a concrete bridge between statistical theory (data structure, efficiency) and optimization practice (algorithm design, scalability), demonstrating that geometry-aware algorithms can democratize effective ML for resource-limited applications.

International Journal of Systems Science and Applied MathematicsVol. 10(3)
Delta State University (NG), Edwin Clark University (NG), Federal College of Education, Kano (NG), Abiola Ajimobi Technical University Ibadan (NG), Federal University of Petroleum Resource Effurun (NG)
Openalex Percentile: Top 80%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.