On Reasoning About Black-Box Udfs by Classifying their Performance Characteristics

User defined functions (UDFs) are frequent components of SQL queries and data processing workflows (DPWs). In both of these applications, UDFs are often available as black boxes, i.e., their semantics and performance characteristics are unknown (such functions are further called BBUDFs). This feature prevents from optimizing execution plans of queries and from optimizing the whole DPWs. Discovering the semantics of a BBUDF is often impossible due to high complexity of its code. On the contrary, discovering its performance model seems to be feasible with the support of machine learning. In this paper, we present a solution for classifying BBUDFs into performance classes. This way, if a performance class of a given BBUDF is known, it may allow to reason about some hidden features of the BBUDF. Our solution is supported by experimental evaluation, which reveals that our initial approach, in multiple cases, allows to classify BBUDFs to adequate performance classes.

Authors

Institutions

Publication Details

Journal
Proceedings of the International Conference on Information Systems Development
Published
2024-09-09
DOI
https://doi.org/10.62036/isd.2024.83
Citations
3
Primary Topic
Advanced Database Systems and Queries
Type
article
Field-Weighted Citation Impact
1.05
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

On Reasoning About Black-Box Udfs by Classifying their Performance Characteristics

Robert Wrembel, Michał Bodziony, Bartosz Ciesielski, Anna Lehnhardt
3 citations
Proceedings of the International Conference on Information Systems Development
Advanced Database Systems and Queries
1.05
article

On Reasoning About Black-Box Udfs by Classifying their Performance Characteristics

Robert Wrembel, Michał Bodziony, Bartosz Ciesielski, Anna Lehnhardt
article en
3 citations

Abstract

User defined functions (UDFs) are frequent components of SQL queries and data processing workflows (DPWs). In both of these applications, UDFs are often available as black boxes, i.e., their semantics and performance characteristics are unknown (such functions are further called BBUDFs). This feature prevents from optimizing execution plans of queries and from optimizing the whole DPWs. Discovering the semantics of a BBUDF is often impossible due to high complexity of its code. On the contrary, discovering its performance model seems to be feasible with the support of machine learning. In this paper, we present a solution for classifying BBUDFs into performance classes. This way, if a performance class of a given BBUDF is known, it may allow to reason about some hidden features of the BBUDF. Our solution is supported by experimental evaluation, which reveals that our initial approach, in multiple cases, allows to classify BBUDFs to adequate performance classes.

Proceedings of the International Conference on Information Systems Development
Poznań University of Technology (PL)
Openalex Percentile: Top 21%
Advanced Database Systems and Queries
1.05
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.