ACRS: Adjacent Computation Resource Sharing among Partitioned GPU Sub-Cores
Modern GPUs typically segment Streaming Multiprocessors (SMs) into sub-cores (e.g. 4 sub-cores) to reduce power consumption and chip area. However, this partitioned design prevents potential task distributions across sub-cores, impairing overall execution efficiency. In this paper, we explore the performance benefit of sharing hardware resources among sub-cores and identify functional units (FUs) as critical components for compute-intensive applications. Moreover, our observations reveal that instructions residing in operand collectors can be obstructed by back-end FUs, but there is a high probability that unoccupied FUs are available in adjacent sub-cores during such blockages. In response, we introduce the adjacent computation resource sharing (ACRS) framework to efficiently utilize these unoccupied units among sub-cores. ACRS has two key modules: Shared FU Issue (SF_ISSUE) and Shared FU Write Back (SF_WriteBack). SF_ISSUE monitors the status of operand collectors and functional units, and offloads instructions from blocked sub-cores to unoccupied resources. Meanwhile, SF_WriteBack routes results back to the original sub-core.To minimize wiring overhead, each sub-core is assigned a fixed target core for sharing. We design a series of matching policies and finally filter out the most effective sequential method. Evaluation results show that ACRS improves performance by up to $46.4 \%$, with an average of $14.1 \%$ over the traditional partitioned architecture, while reducing energy consumption by $8.3 \%$. Besides, ACRS achieves an additional 12.3% performance improvement compared with the SOTA method.
Authors
- Chongxi Wang (ORCID: https://orcid.org/0000-0003-1295-279X)
- Penghao Song (ORCID: https://orcid.org/0000-0001-7423-1416)
- Tingting Zhang
- Jian Wang (ORCID: https://orcid.org/0000-0001-5416-0649)
- Tianyi Liu (ORCID: https://orcid.org/0000-0002-5341-1343)
- Haoyu Zhao (ORCID: https://orcid.org/0000-0003-3757-8773)
- Chenji Han (ORCID: https://orcid.org/0009-0007-1247-9644)
Institutions
- Institute of Computing Technology (CN)
- OriginWater (China) (CN)
- The University of Texas at San Antonio (US)
Publication Details
- Published
- 2025-06-22
- DOI
- https://doi.org/10.1109/dac63849.2025.11132550
- Primary Topic
- Parallel Computing and Optimization Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00