One Constant Moves the Verdict: The Fragility of Threshold-Derived Health Labels in Black-Box LLM Endpoint Monitoring
This preprint presents a black-box measurement study of publicly accessible LLM inference endpoints. Using approximately 64,000 production telemetry probes collected over nine days, the study evaluates latency behavior, right-censored observations, threshold-derived health labels, and measurement limitations in operational monitoring systems.
Authors
- Aathil Felix Clarisa (ORCID: https://orcid.org/0009-0003-9108-2055)
Institutions
- R.M.D. Engineering College
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-06-26
- DOI
- https://doi.org/10.5281/zenodo.20934721
- Primary Topic
- Medical Coding and Health Information
- Type
- preprint