Atomic Design for MLOps: A Modular Approach to Scalable and Reusable ML Pipelines

The increasing complexity of machine learning pipelines presents significant challenges in terms of maintainability, scalability, and reusability. This paper explores the application of atomic design principles—widely used in software engineering—to MLOps pipelines, structuring ML workflows into modular and reusable components. By decomposing AI pipelines into hierarchical elements, such as atoms, modules, stages, templates, and pipelines, this approach aims to improve efficiency, reproducibility, and collaboration in machine learning development. We describe the conceptual framework and its implementation in time series applications, including forecasting, classification, and anomaly detection. Preliminary results demonstrate the feasibility of this methodology, highlighting its potential benefits for streamlining ML workflows and reducing development overhead.

Authors

Institutions

Publication Details

Published
2025-06-16
DOI
https://doi.org/10.23919/splitech65624.2025.11091611
Primary Topic
Parallel Computing and Optimization Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Atomic Design for MLOps: A Modular Approach to Scalable and Reusable ML Pipelines

Mikel Emaldi, Asier Villar, Imanol Echeverria, Bruno Santidrián
Parallel Computing and Optimization Techniques
article

Atomic Design for MLOps: A Modular Approach to Scalable and Reusable ML Pipelines

Mikel Emaldi, Asier Villar, Imanol Echeverria, Bruno Santidrián
article en

Abstract

The increasing complexity of machine learning pipelines presents significant challenges in terms of maintainability, scalability, and reusability. This paper explores the application of atomic design principles—widely used in software engineering—to MLOps pipelines, structuring ML workflows into modular and reusable components. By decomposing AI pipelines into hierarchical elements, such as atoms, modules, stages, templates, and pipelines, this approach aims to improve efficiency, reproducibility, and collaboration in machine learning development. We describe the conceptual framework and its implementation in time series applications, including forecasting, classification, and anomaly detection. Preliminary results demonstrate the feasibility of this methodology, highlighting its potential benefits for streamlining ML workflows and reducing development overhead.

Universidad de Deusto (ES), Tecnalia (ES)
HORIZON EUROPE Framework Programme
Openalex Percentile: Top 81%
Parallel Computing and Optimization Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.