Observability and Orchestration for Distributed LLM Agents Across the Cloud-Edge Continuum
This preprint presents a distributed-systems perspective on the deployment, observability, and orchestration of LLM-based agents across the cloud-edge continuum. It synthesizes recent work on agent systems, model serving, cluster scheduling, edge computing, distributed tracing, and zero-trust security. LLM-based agents increasingly combine model inference with retrieval, persistent state, tool calls, and interactions with other services or agents. When these components are distributed across devices, edge nodes, and cloud infrastructure, the application inherits familiar systems problems: placement, latency, state tracking, access control, failure recovery, and end-to-end observability. This paper examines those problems from a distributed-systems perspective. It brings together recent research on LLM agents and agent evaluation with established work on model serving, cluster scheduling, edge computing, distributed tracing, and zero-trust security. The resulting deployment view separates the agent runtime, state, tools, and compute resources while treating observability and policy enforcement as cross-cutting concerns. The paper does not introduce a new agent framework and does not report new performance measurements.
Authors
- Vassil Milev (ORCID: https://orcid.org/0000-0002-0994-2112)
- Marian Ileana (ORCID: https://orcid.org/0009-0008-9624-2202)
- Pavel Petrov (ORCID: https://orcid.org/0009-0006-7596-6215)
Institutions
- University of Pitesti (RO)
- St. Cyril and St. Methodius University of Veliko Tarnovo (BG)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-08-25
- DOI
- https://doi.org/10.5281/zenodo.22091410
- Primary Topic
- Mobile Agent-Based Network Management
- Type
- preprint