Supporting social interactions analyses with multi-agent large language models (MALLM) – an exploratory study

Purpose This study aims to explore the potential of Multi-Agent Large Language Models (MALLM) to enhance Social Network Analysis (SNA) for online education. It compares MALLM with single-agent LLMs in conducting, interpreting and applying SNA, addressing barriers that limit adoption. Design/methodology/approach An exploratory experiment using AutoGen compared MALLM and single-agent LLMs across multistep SNA workflows with a Coursera discussion data set. The process included data exploration, analysis and visualization. Specialized agent teams were assigned to analysis and interpretation. Performance was tested over 20 rounds, evaluated on comprehension, accuracy, execution and educational relevance. Findings Single agents were more efficient in simpler tasks (data exploration 85% vs 25%, visualization 50% vs 45%). MALLM outperformed in complex tasks, with higher SNA precision (30% vs 25%), stronger node-level analysis (95% vs 65%) and greater educational insights (55% vs 35%). However, MALLM faced coordination inefficiencies in linear tasks. Research limitations/implications Limitations include contextual forgetting, token-size constraints and coordination overhead. Results are specific to GPT-4/GPT-4o, with a 30% success rate in complex tasks, indicating LLMs are not yet sufficient for full automation. Practical implications MALLMs can advance online education by supporting personalized learning and engagement while democratizing access to advanced analytics and pedagogical feedback, thereby enhancing educational equity. Originality/value To the best of the authors’ knowledge, this study is among the first to examine MALLMs’ management of multimodal, domain-specific analytics tasks, moving beyond general text-based applications, highlighting their advantages in generating educational insights and informing agent design while providing benchmarks for advancing multi-agent LLM systems.

Authors

Institutions

Publication Details

Journal
Information Discovery and Delivery
Published
2025-10-24
DOI
https://doi.org/10.1108/idd-04-2025-0100
Citations
1
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Supporting social interactions analyses with multi-agent large language models (MALLM) – an exploratory study

Xu Du, Jui-Long Hung, Hao Li, Min Deng et al.
1 citations
Information Discovery and Delivery
AI in Service Interactions
2.48
article

Supporting social interactions analyses with multi-agent large language models (MALLM) – an exploratory study

Xu Du, Jui-Long Hung, Hao Li, Min Deng, Yeye Tang
article en
1 citations

Abstract

Purpose This study aims to explore the potential of Multi-Agent Large Language Models (MALLM) to enhance Social Network Analysis (SNA) for online education. It compares MALLM with single-agent LLMs in conducting, interpreting and applying SNA, addressing barriers that limit adoption. Design/methodology/approach An exploratory experiment using AutoGen compared MALLM and single-agent LLMs across multistep SNA workflows with a Coursera discussion data set. The process included data exploration, analysis and visualization. Specialized agent teams were assigned to analysis and interpretation. Performance was tested over 20 rounds, evaluated on comprehension, accuracy, execution and educational relevance. Findings Single agents were more efficient in simpler tasks (data exploration 85% vs 25%, visualization 50% vs 45%). MALLM outperformed in complex tasks, with higher SNA precision (30% vs 25%), stronger node-level analysis (95% vs 65%) and greater educational insights (55% vs 35%). However, MALLM faced coordination inefficiencies in linear tasks. Research limitations/implications Limitations include contextual forgetting, token-size constraints and coordination overhead. Results are specific to GPT-4/GPT-4o, with a 30% success rate in complex tasks, indicating LLMs are not yet sufficient for full automation. Practical implications MALLMs can advance online education by supporting personalized learning and engagement while democratizing access to advanced analytics and pedagogical feedback, thereby enhancing educational equity. Originality/value To the best of the authors’ knowledge, this study is among the first to examine MALLMs’ management of multimodal, domain-specific analytics tasks, moving beyond general text-based applications, highlighting their advantages in generating educational insights and informing agent design while providing benchmarks for advancing multi-agent LLM systems.

Information Discovery and Delivery
Boise State University (US), Central China Normal University (CN), Minnan Normal University (CN)
Openalex Percentile: Top 8%
AI in Service Interactions
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.