Exploring Variable Potential for LLM-based Log Parsing Efficiency and Reduced Costs
Log parsing extracts structured events from massive system logs and is essential for tasks like compression, anomaly detection, and failure diagnosis. With the rise of LLMs, their strong text understanding and summarization capabilities have enabled more accurate log parsing. However, existing LLM-based methods mainly focus on log constants, overlooking the value of log variables, leading to inefficient sampling, cache use, and context learning. To address this, we propose a variable-centric strategy called VISTA, which fully leverages log variables through dynamic contribution sampling, variable-centric cache, and adaptive variable-aware ICL. Early results show improved parsing efficiency and significantly reduced LLM usage costs.
Authors
- Tong Jia (ORCID: https://orcid.org/0000-0002-5946-9829)
- Yong Yang (ORCID: https://orcid.org/0000-0001-9667-2423)
- Yihan Wu
- Gang Huang (ORCID: https://orcid.org/0000-0002-4686-3181)
- Minghua He (ORCID: https://orcid.org/0000-0003-4439-9810)
- Jinrui Sun
Institutions
- Peking University (CN)
- National Computer Network Emergency Response Technical Team/Coordination Center of Chinar (CN)
Publication Details
- Published
- 2025-06-23
- DOI
- https://doi.org/10.1145/3696630.3728506
- Citations
- 2
- Primary Topic
- Software System Performance and Reliability
- Type
- article
- Field-Weighted Citation Impact
- 2.97