A benchmark for elevator fault diagnosis: Multi-level tasks from perception to diagnostic reasoning
Elevator fault diagnosis is a safety-critical problem that requires capabilities beyond isolated fault classification, including knowledge grounding and structured reasoning for maintenance support. In this work, we present a benchmark for elevator fault diagnosis and organize evaluation into three complementary task groups: (A) sensor-based fault detection and classification, (B) taxonomy-grounded fault classification and cause identification, and (C) reasoning with incomplete or constrained information. To enable reproducible comparison across heterogeneous model families, we standardize task definitions, input/output formats, and scoring protocols and report component-level predictive metrics. Experiments across representative language models show task-dependent performance: higher performance on one task does not necessarily transfer to another. The benchmark is a reproducible testbed for studying diagnostic-assistance methods, not a validation of safe operational deployment.
Authors
- Qiang Zhang (ORCID: https://orcid.org/0000-0003-1636-5269)
- Junjie Huang (ORCID: https://orcid.org/0009-0008-9532-1881)
- Haozhe Sun
- Xinda Wang
Institutions
- Xi’an Jiaotong-Liverpool University (CN)
- Zhejiang University (CN)
Publication Details
- Journal
- PLoS ONE
- Published
- 2026-11-18
- DOI
- https://doi.org/10.1371/journal.pone.0362972
- Primary Topic
- Elevator Systems and Control
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Science and Technology Department of Zhejiang Province