Systematic Comparison of Agentic AI Frameworks for Scholarly Literature Processing

Frameworks for agentic artificial intelligence (AI) are becoming popular as instruments for automating intricate processes, such as those related to academic research. Six popu- lar frameworks—AutoGen, Google ADK, CrewAI, LlamaIndex, LangGraph, and Semantic Kernel— were compared in this study, with an emphasis on their architectural features and suitabil- ity for literature processing tasks. We developed a prototype system using AutoGen to summarize preprints from arXiv to demonstrate its practical use. We analyze the interoperability of this system with other frameworks and describe how workflows are orchestrated within it. Although there are still issues with synthesis quality, citation accuracy, and scalability, our initial assessment suggests that agentic AI systems may enable wider source coverage and less manual labor in early stage literature review. The study contributes a taxonomy of framework design patterns, an initial demonstration of agentic workflows for academic tasks, and a discussion of open challenges for future research.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-09-19
DOI
https://doi.org/10.5281/zenodo.17157381
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Systematic Comparison of Agentic AI Frameworks for Scholarly Literature Processing

Zenodo (CERN European Organization for Nuclear Research)
Geochemistry and Geologic Mapping
article

Systematic Comparison of Agentic AI Frameworks for Scholarly Literature Processing

article en

Abstract

Frameworks for agentic artificial intelligence (AI) are becoming popular as instruments for automating intricate processes, such as those related to academic research. Six popu- lar frameworks—AutoGen, Google ADK, CrewAI, LlamaIndex, LangGraph, and Semantic Kernel— were compared in this study, with an emphasis on their architectural features and suitabil- ity for literature processing tasks. We developed a prototype system using AutoGen to summarize preprints from arXiv to demonstrate its practical use. We analyze the interoperability of this system with other frameworks and describe how workflows are orchestrated within it. Although there are still issues with synthesis quality, citation accuracy, and scalability, our initial assessment suggests that agentic AI systems may enable wider source coverage and less manual labor in early stage literature review. The study contributes a taxonomy of framework design patterns, an initial demonstration of agentic workflows for academic tasks, and a discussion of open challenges for future research.

Zenodo (CERN European Organization for Nuclear Research)
Decent work and economic growth
Openalex Percentile: Top 34%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.