Alternative mixed integer linear programming optimization for joint job scheduling and data allocation in grid computing
This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To tackle the nonlinearity in the constraint, we alternatively fix a subset of decision variables and optimize the remaining ones via Mixed Integer Linear Programming (MILP). We solve the MILP problem at each iteration via an off-the-shelf MILP solver. Our experimental results show that our method significantly outperforms existing heuristic methods, employing either independent optimization or joint optimization strategies. We have also verified the generalization ability of our method over grid environments with various sizes and its high robustness to the algorithm setting.
Authors
- Yihui Ren (ORCID: https://orcid.org/0000-0002-5750-6964)
- Tatiana Korchuganova (ORCID: https://orcid.org/0000-0001-5792-8182)
- Ozgur O. Kilic (ORCID: https://orcid.org/0000-0003-2129-408X)
- Wei Yang (ORCID: https://orcid.org/0000-0002-6275-5981)
- Raees Khan (ORCID: https://orcid.org/0000-0003-1388-7141)
- Shinjae Yoo (ORCID: https://orcid.org/0000-0003-4378-6448)
- David S. Park (ORCID: https://orcid.org/0000-0002-4490-3784)
- T. Maeno (ORCID: https://orcid.org/0000-0003-0901-1817)
- Norbert Podhorszki (ORCID: https://orcid.org/0000-0001-9647-542X)
- Adolfy Hoisie (ORCID: https://orcid.org/0000-0001-7812-2946)
- P. Nilsson (ORCID: https://orcid.org/0000-0002-6848-7463)
- Sairam Sri Vatsavai (ORCID: https://orcid.org/0000-0003-1847-3976)
- Frédéric Suter (ORCID: https://orcid.org/0000-0003-1902-1955)
- A. Klimentov (ORCID: https://orcid.org/0000-0003-2748-4829)
- Shengyu Feng (ORCID: https://orcid.org/0000-0002-2464-7226)
- Jaehyung Kim (ORCID: https://orcid.org/0009-0008-2622-5087)
- Yiming Yang (ORCID: https://orcid.org/0000-0002-9755-2711)
- Verena Ingrid Martinez Outschoorn
- Joseph Boudreau
- Scott Klasky
- T. Chowdhury (ORCID: https://orcid.org/0000-0002-2681-8105)
Institutions
- Oak Ridge National Laboratory (US)
- University of Pittsburgh (US)
- Yonsei University (KR)
- Brookhaven National Laboratory (US)
- University of Massachusetts Amherst (US)
- SLAC National Accelerator Laboratory (US)
- Carnegie Mellon University (US)
Publication Details
- Journal
- Future Generation Computer Systems
- Published
- 2025-08-18
- DOI
- https://doi.org/10.1016/j.future.2025.108075
- Primary Topic
- Distributed and Parallel Computing Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- U.S. Department of Energy
- Office of Science
- Advanced Scientific Computing Research