PaTGen: Temporal Similarity-Driven Proxy Benchmark Generation Method for Cloud Workloads

The rapid expansion of cloud computing has made precise performance evaluation a critical necessity. However, conventional cloud benchmarks often face significant limitations in simulation environments—necessary for scalable and cost-effective testing—due to the complexity of technology stacks and substantial runtime overheads. Proxy benchmarking has thus emerged as a practical alternative. Existing methods primarily focus on the global similarity of micro-architectural metrics between proxy benchmarks and real workloads but neglect their temporal similarity, leading to inaccurate performance evaluations, flawed cache behavior simulations, and misguided architectural optimization decisions. To address this, we present PaTGen , a phase-aware method for generating proxy benchmarks that accurately reflect both global and temporal similarity. By partitioning workloads into phases and formulating proxy generation as nonlinear optimization problems, PaTGen further refines intra-phase execution patterns via the delay-based temporal similarity optimization (DTSO) technique. Evaluations on 15 real-world workloads show PaTGen achieves over 97% global similarity in key metrics while significantly outperforming state-of-the-art methods in temporal similarity. Ablation studies confirm the efficacy of phase division and DTSO. Further experiments confirm its scalability and generalizability across architectures. Moreover, the effectiveness observed in downstream tasks provides empirical evidence that preserving temporal similarity is a fundamental requirement for proxy benchmarks to faithfully capture real workload behavior.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Architecture and Code Optimization
Published
2026-05-30
DOI
https://doi.org/10.1145/3816437
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PaTGen: Temporal Similarity-Driven Proxy Benchmark Generation Method for Cloud Workloads

Haocheng Zhong, Huikang Huang, Xiaoxuan Luo, Haolang Yin et al.
ACM Transactions on Architecture and Code Optimization
Cloud Computing and Resource Management
article

PaTGen: Temporal Similarity-Driven Proxy Benchmark Generation Method for Cloud Workloads

Haocheng Zhong, Huikang Huang, Xiaoxuan Luo, Haolang Yin, Weiwei Lin, Keqin Li
article en

Abstract

The rapid expansion of cloud computing has made precise performance evaluation a critical necessity. However, conventional cloud benchmarks often face significant limitations in simulation environments—necessary for scalable and cost-effective testing—due to the complexity of technology stacks and substantial runtime overheads. Proxy benchmarking has thus emerged as a practical alternative. Existing methods primarily focus on the global similarity of micro-architectural metrics between proxy benchmarks and real workloads but neglect their temporal similarity, leading to inaccurate performance evaluations, flawed cache behavior simulations, and misguided architectural optimization decisions. To address this, we present PaTGen , a phase-aware method for generating proxy benchmarks that accurately reflect both global and temporal similarity. By partitioning workloads into phases and formulating proxy generation as nonlinear optimization problems, PaTGen further refines intra-phase execution patterns via the delay-based temporal similarity optimization (DTSO) technique. Evaluations on 15 real-world workloads show PaTGen achieves over 97% global similarity in key metrics while significantly outperforming state-of-the-art methods in temporal similarity. Ablation studies confirm the efficacy of phase division and DTSO. Further experiments confirm its scalability and generalizability across architectures. Moreover, the effectiveness observed in downstream tasks provides empirical evidence that preserving temporal similarity is a fundamental requirement for proxy benchmarks to faithfully capture real workload behavior.

ACM Transactions on Architecture and Code Optimization
SUNY New Paltz (US), Peng Cheng Laboratory (CN), South China University of Technology (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 2%
Cloud Computing and Resource Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.