Towards Realistic, Applicable and Feasible Configuration-Aware Performance Modeling

In modern software systems, configurability has become essential for optimizing performance across varying scenarios and user demands. However, predicting performance in configurable software remains challenging due to the complex interplay between configuration settings and workload characteristics. Existing performance models lack applicability and ignore the combined influence of configurations and workloads, limiting their applicability in dynamic environments. Additionally, current methods focus on either configurations or workloads in isolation, leaving the interactions between the two insufficiently explored. We conclude these challenges into three parts, which are realistic, applicable and feasible for the performance modeling, This thesis addresses the challenges through four projects. We conduct an empirical study to understand the complex relationships between configurations, workloads, and performance outcomes. Additionally, we develop a systematic sampling method to enhance the applicability and accuracy of configuration performance models, allowing models to learn from historical data actively. To further improve performance prediction, we propose a hybrid modeling approach that integrates configuration and workload variations, thereby increasing model simplicity and precision. Finally, we explore applying large language models (LLMs) to streamline the modeling process, embedding LLM insights into traditional methods to reduce the cost and complexity of performance modeling. These contributions aim to create robust performance models that better support software configuration and workload management, enhancing system reliability and efficiency.

Authors

Institutions

Publication Details

Published
2025-04-27
DOI
https://doi.org/10.1109/icse-companion66252.2025.00027
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards Realistic, Applicable and Feasible Configuration-Aware Performance Modeling

Yuanjie Xia
Software System Performance and Reliability
article

Towards Realistic, Applicable and Feasible Configuration-Aware Performance Modeling

Yuanjie Xia
article en

Abstract

In modern software systems, configurability has become essential for optimizing performance across varying scenarios and user demands. However, predicting performance in configurable software remains challenging due to the complex interplay between configuration settings and workload characteristics. Existing performance models lack applicability and ignore the combined influence of configurations and workloads, limiting their applicability in dynamic environments. Additionally, current methods focus on either configurations or workloads in isolation, leaving the interactions between the two insufficiently explored. We conclude these challenges into three parts, which are realistic, applicable and feasible for the performance modeling, This thesis addresses the challenges through four projects. We conduct an empirical study to understand the complex relationships between configurations, workloads, and performance outcomes. Additionally, we develop a systematic sampling method to enhance the applicability and accuracy of configuration performance models, allowing models to learn from historical data actively. To further improve performance prediction, we propose a hybrid modeling approach that integrates configuration and workload variations, thereby increasing model simplicity and precision. Finally, we explore applying large language models (LLMs) to streamline the modeling process, embedding LLM insights into traditional methods to reduce the cost and complexity of performance modeling. These contributions aim to create robust performance models that better support software configuration and workload management, enhancing system reliability and efficiency.

University of Waterloo (CA)
Openalex Percentile: Top 86%
Software System Performance and Reliability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.