End-to-End Performance Analysis of Learning-enabled Systems

We propose a performance analysis tool for learning-enabled systems that allows operators to uncover potential performance issues before deploying DNNs in their systems. The tools that exist for this purpose require operators to faithfully model all components (a white-box approach) or do inefficient black-box local search. We propose a gray-box alternative, which eliminates the need to precisely model all the system's components. Our approach is faster and finds substantially worse scenarios compared to prior work. We show that a state-of-the-art learning-enabled traffic engineering pipeline can underperform the optimal by 6× --- a much higher number compared to what the authors found.

Authors

Institutions

Publication Details

Published
2024-11-11
DOI
https://doi.org/10.1145/3696348.3696875
Citations
1
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.21

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

End-to-End Performance Analysis of Learning-enabled Systems

Santiago Segarra, Michael Schapira, Ramesh Govindan, Pooria Namyar et al.
1 citations
Advanced Memory and Neural Computing
0.21
article

End-to-End Performance Analysis of Learning-enabled Systems

Santiago Segarra, Michael Schapira, Ramesh Govindan, Pooria Namyar, Behnaz Arzani, Ryan Beckett, Siva Kesava Reddy Kakarla
article en
1 citations

Abstract

We propose a performance analysis tool for learning-enabled systems that allows operators to uncover potential performance issues before deploying DNNs in their systems. The tools that exist for this purpose require operators to faithfully model all components (a white-box approach) or do inefficient black-box local search. We propose a gray-box alternative, which eliminates the need to precisely model all the system's components. Our approach is faster and finds substantially worse scenarios compared to prior work. We show that a state-of-the-art learning-enabled traffic engineering pipeline can underperform the optimal by 6× --- a much higher number compared to what the authors found.

University of Southern California (US), Hebrew University of Jerusalem (IL), California Southern University (US), Microsoft Research (United Kingdom) (GB), Rice University (US)
National Science Foundation, Israel Science Foundation
Openalex Percentile: Top 46%
Advanced Memory and Neural Computing
0.21
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.