4344-GRP ED-OS: Urgency Stage-Aware Scheduling of AI Tutor Agents on Low-Resource Local LLM Inference

AI tutoring systems based on local agents repeatedly call small language models and external tools to guide students. Agents compete for limited inference resources during concurrent student request in commodity hardware. To resolve this, we build ecosystem where agents’ function as processes, tool calls as I/O operations, and inference slots as physical frames. ED-OS schedules agent operating in urgency with stage-aware priority along with aging. This helps to complete the urgent requests first while no student starves. It also releases or swaps slots during tool calls using an online cost model, shares exercise prefixes, and caches. We evaluate ED-OS by recording 204 three-agent tutor sessions with Qwen2.5-Coder-3B and replaying them on several runs with a Java discrete-event simulator. Compared with plain llama.cpp, the full layer cut the 95th-percentile time to a verified hint by 41% and raised throughput by 61%, while every student received the same hint. The urgency stage-aware scheduler matched FCFS on p95 latency (9.2 s vs. 9.4 s) while round-robin and fair share were 42-67% slower, and giving flagged students priority cut their p95 latency by 26% at a 10% cost to others. The study contributes to providing alternative solution to schedule the agent tasks based on their urgency and agent role priority on low-resource hardware.

Authors

Publication Details

Journal
DigitalCommons - Kennesaw State University (Kennesaw State University)
Published
2026-11-20
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

4344-GRP ED-OS: Urgency Stage-Aware Scheduling of AI Tutor Agents on Low-Resource Local LLM Inference

Manoj Adhikari
DigitalCommons - Kennesaw State University (Kennesaw State University)
Intelligent Tutoring Systems and Adaptive Learning
article

4344-GRP ED-OS: Urgency Stage-Aware Scheduling of AI Tutor Agents on Low-Resource Local LLM Inference

Manoj Adhikari
article en

Abstract

AI tutoring systems based on local agents repeatedly call small language models and external tools to guide students. Agents compete for limited inference resources during concurrent student request in commodity hardware. To resolve this, we build ecosystem where agents’ function as processes, tool calls as I/O operations, and inference slots as physical frames. ED-OS schedules agent operating in urgency with stage-aware priority along with aging. This helps to complete the urgent requests first while no student starves. It also releases or swaps slots during tool calls using an online cost model, shares exercise prefixes, and caches. We evaluate ED-OS by recording 204 three-agent tutor sessions with Qwen2.5-Coder-3B and replaying them on several runs with a Java discrete-event simulator. Compared with plain llama.cpp, the full layer cut the 95th-percentile time to a verified hint by 41% and raised throughput by 61%, while every student received the same hint. The urgency stage-aware scheduler matched FCFS on p95 latency (9.2 s vs. 9.4 s) while round-robin and fair share were 42-67% slower, and giving flagged students priority cut their p95 latency by 26% at a 10% cost to others. The study contributes to providing alternative solution to schedule the agent tasks based on their urgency and agent role priority on low-resource hardware.

DigitalCommons - Kennesaw State University (Kennesaw State University)
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon