An automated parameter optimizer for data transfer performance testing
This work presents an automated tool for optimizing control parameters in performance testing of big data transfer over long-fat network connections. Supporting both TCP and UDT protocols, the tool identifies the optimal configurations to enhance the efficiency of large-scale data transfers. A stochastic approximation algorithm is employed for parameter optimization, streamlining the protocol and parameter selection. The tool has been evaluated in various network scenarios, including long-haul connections in real-world high-performance networks. Its modular design also enables straightforward integration of additional data transfer protocols and alternative optimization methods. • A data transfer performance testing framework with both TCP and UDT support. • Automated fast parameter optimization using stochastic approximation. • Straightforward integration of additional data transfer protocols and alternative optimization methods.
Authors
- Daqing Yun (ORCID: https://orcid.org/0000-0002-5249-962X)
- Chase Q. Wu
- Liudong Zuo (ORCID: https://orcid.org/0000-0001-9360-1064)
- Yi Gu
Institutions
- New Jersey Institute of Technology (US)
- Harrisburg University of Science and Technology (US)
- Middle Tennessee State University (US)
- California State University, Dominguez Hills (US)
Publication Details
- Journal
- Software Impacts
- Published
- 2025-04-29
- DOI
- https://doi.org/10.1016/j.simpa.2025.100764
- Primary Topic
- Parallel Computing and Optimization Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00