Comparative Analysis of AutoML Platforms for Forecasting Raw Material Requirements

Automated machine learning (AutoML) platforms are increasingly adopted in manufacturing to support data-driven decision-making. However, systematic and reproducible evaluations of their practical applicability remain limited. This study presents a controlled benchmarking framework for comparing three selected cloud-based AutoML platforms: Google Vertex AI, Microsoft Azure ML and IBM Watsonx, in the context of raw material demand forecasting for mold manufacturing. A synthetic dataset was generated to reflect essential operational characteristics of industrial production, including batch-based manufacturing, inventory-triggered replenishment and delivery lead times. While the underlying bill of materials logic is deterministic, the interaction of production variability and inventory dynamics introduces nonlinear and time-dependent behavior. All platforms were evaluated using identical data splits, chronological cross-validation and consistent performance metrics to ensure fair comparison and prevent information leakage. Results indicate moderate predictive performance, which is attributed to embedded operational complexity. Performance differences between platforms are marginal, highlighting that practical considerations such as feature handling, deployment readiness and computational effort may be more influential than raw accuracy. Although synthetic data limit external validity, the proposed framework provides a reproducible and transparent basis for applied evaluation of AutoML platforms. Future work will incorporate real industrial data and robustness testing under non-stationary and disrupted production conditions.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-01-29
DOI
https://doi.org/10.3390/app16031389
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Analysis of AutoML Platforms for Forecasting Raw Material Requirements

Ewa Dostatni, Damian Grajewski, Anna Dudkowiak, Jakub Cichocki
Applied Sciences
Machine Learning and Data Classification
article

Comparative Analysis of AutoML Platforms for Forecasting Raw Material Requirements

Ewa Dostatni, Damian Grajewski, Anna Dudkowiak, Jakub Cichocki
article en

Abstract

Automated machine learning (AutoML) platforms are increasingly adopted in manufacturing to support data-driven decision-making. However, systematic and reproducible evaluations of their practical applicability remain limited. This study presents a controlled benchmarking framework for comparing three selected cloud-based AutoML platforms: Google Vertex AI, Microsoft Azure ML and IBM Watsonx, in the context of raw material demand forecasting for mold manufacturing. A synthetic dataset was generated to reflect essential operational characteristics of industrial production, including batch-based manufacturing, inventory-triggered replenishment and delivery lead times. While the underlying bill of materials logic is deterministic, the interaction of production variability and inventory dynamics introduces nonlinear and time-dependent behavior. All platforms were evaluated using identical data splits, chronological cross-validation and consistent performance metrics to ensure fair comparison and prevent information leakage. Results indicate moderate predictive performance, which is attributed to embedded operational complexity. Performance differences between platforms are marginal, highlighting that practical considerations such as feature handling, deployment readiness and computational effort may be more influential than raw accuracy. Although synthetic data limit external validity, the proposed framework provides a reproducible and transparent basis for applied evaluation of AutoML platforms. Future work will incorporate real industrial data and robustness testing under non-stationary and disrupted production conditions.

Applied SciencesVol. 16(3)
Poznań University of Technology (PL)
Openalex Percentile: Top 75%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.