Does Task Decomposition Earn Its Cost? Cost, Accuracy and Evaluation Validity of Single, Reflective and Multi-Agent LLM Analysts

This research investigates whether multi-agent task decomposition justifies its computational cost compared with single-agent and self-reflective LLM systems. Using Gemma 4 31B IT, LangGraph, and ten deterministic analytical tools, the study compares accuracy, token consumption, and latency while examining evaluation reliability and statistical power. The findings show that multi-agent orchestration substantially increases computational cost without demonstrating an accuracy advantage in the tested setting.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-16
DOI
https://doi.org/10.5281/zenodo.23418211
Primary Topic
Artificial Intelligence Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Does Task Decomposition Earn Its Cost? Cost, Accuracy and Evaluation Validity of Single, Reflective and Multi-Agent LLM Analysts

Vanshika Raut
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence Applications
preprint

Does Task Decomposition Earn Its Cost? Cost, Accuracy and Evaluation Validity of Single, Reflective and Multi-Agent LLM Analysts

Vanshika Raut
preprint en

Abstract

This research investigates whether multi-agent task decomposition justifies its computational cost compared with single-agent and self-reflective LLM systems. Using Gemma 4 31B IT, LangGraph, and ten deterministic analytical tools, the study compares accuracy, token consumption, and latency while examining evaluation reliability and statistical power. The findings show that multi-agent orchestration substantially increases computational cost without demonstrating an accuracy advantage in the tested setting.

Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.