Exploring Variable Potential for LLM-based Log Parsing Efficiency and Reduced Costs

Log parsing extracts structured events from massive system logs and is essential for tasks like compression, anomaly detection, and failure diagnosis. With the rise of LLMs, their strong text understanding and summarization capabilities have enabled more accurate log parsing. However, existing LLM-based methods mainly focus on log constants, overlooking the value of log variables, leading to inefficient sampling, cache use, and context learning. To address this, we propose a variable-centric strategy called VISTA, which fully leverages log variables through dynamic contribution sampling, variable-centric cache, and adaptive variable-aware ICL. Early results show improved parsing efficiency and significantly reduced LLM usage costs.

Authors

Institutions

Publication Details

Published
2025-06-23
DOI
https://doi.org/10.1145/3696630.3728506
Citations
2
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
2.97
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring Variable Potential for LLM-based Log Parsing Efficiency and Reduced Costs

Tong Jia, Yong Yang, Yihan Wu, Gang Huang et al.
2 citations
Software System Performance and Reliability
2.97
article

Exploring Variable Potential for LLM-based Log Parsing Efficiency and Reduced Costs

Tong Jia, Yong Yang, Yihan Wu, Gang Huang, Minghua He, Jinrui Sun
article en
2 citations

Abstract

Log parsing extracts structured events from massive system logs and is essential for tasks like compression, anomaly detection, and failure diagnosis. With the rise of LLMs, their strong text understanding and summarization capabilities have enabled more accurate log parsing. However, existing LLM-based methods mainly focus on log constants, overlooking the value of log variables, leading to inefficient sampling, cache use, and context learning. To address this, we propose a variable-centric strategy called VISTA, which fully leverages log variables through dynamic contribution sampling, variable-centric cache, and adaptive variable-aware ICL. Early results show improved parsing efficiency and significantly reduced LLM usage costs.

Peking University (CN), National Computer Network Emergency Response Technical Team/Coordination Center of Chinar (CN)
Affordable and clean energy
Openalex Percentile: Top 8%
Software System Performance and Reliability
2.97
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.