A Multi-Agentic AI Framework for Autonomous and Collaborative Data Science Workflows

In the evolving landscape of data science, traditional monolithic automation tools often lack flexibility, interpretability, and adaptability in complex, real-world workflows. This paper proposes a novel multiagentic framework that leverages Artificial Intelligencedriven specialized agents to autonomously and collaboratively manage the entire data science pipelinefrom preprocessing and exploratory data analysis to model selection and performance evaluation. Each agent is designed with domain-specific intelligence and operates both independently and cooperatively within a decentralized architecture, orchestrated via a lightweight communication protocol. The framework promotes modularity, scalability, and human-AI collaboration, while significantly reducing manual intervention and operational overhead. Experiments conducted on real-world datasets demonstrate the system's ability to deliver high-performing models with improved efficiency and transparency. This approach not only redefines AutoML by introducing agent-based specialization but also sets the stage for the next generation of AI-assisted data science platforms.

Authors

Institutions

Publication Details

Published
2025-05-18
DOI
https://doi.org/10.63169/gcared2025.p31
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Multi-Agentic AI Framework for Autonomous and Collaborative Data Science Workflows

Chirag Chirag, Sarab Nihal Singh Nagra
Scientific Computing and Data Management
article

A Multi-Agentic AI Framework for Autonomous and Collaborative Data Science Workflows

Chirag Chirag, Sarab Nihal Singh Nagra
article en

Abstract

In the evolving landscape of data science, traditional monolithic automation tools often lack flexibility, interpretability, and adaptability in complex, real-world workflows. This paper proposes a novel multiagentic framework that leverages Artificial Intelligencedriven specialized agents to autonomously and collaboratively manage the entire data science pipelinefrom preprocessing and exploratory data analysis to model selection and performance evaluation. Each agent is designed with domain-specific intelligence and operates both independently and cooperatively within a decentralized architecture, orchestrated via a lightweight communication protocol. The framework promotes modularity, scalability, and human-AI collaboration, while significantly reducing manual intervention and operational overhead. Experiments conducted on real-world datasets demonstrate the system's ability to deliver high-performing models with improved efficiency and transparency. This approach not only redefines AutoML by introducing agent-based specialization but also sets the stage for the next generation of AI-assisted data science platforms.

O. P. Jindal Global University (IN)
Openalex Percentile: Top 87%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.