Staying Young at the Edge: A Software Aging Perspective for Foundation Models as a Service

Nowadays, the emergence of Foundation Models as a Service enables mobile users to access powerful capabilities such as inference and fine-tuning on demand and without incurring local computational overhead. This paper introduces a software-aware offloading framework for FMaaS that allows edge nodes to forecast software aging and prevent service degradation. Each node employs a lightweight Echo State Network to predict its software age, with tasks dynamically assigned based on communication cost, inference delay, and forecast reliability. Simulation results including ablation studies confirm the effectiveness of software age forecasting in reducing task failures and improving session continuity.