Optimization of Triton matrix multiplication for tensor core

Matrix multiplication has important and widespread applications in the field of computer science, serving as the foundation of high-performance computing systems and the core of deep learning model applications. Tensor Core is a hardware unit designed specifically for accelerating matrix multiplication, which can greatly improve the computational efficiency of matrix multiplication. Triton is a flexible and efficient deep learning compiler that simplifies the operator development process while providing efficient training and inference performance. However, its block configuration can affect the computational efficiency of the operator. When a certain dimension of the block configuration is small, it is difficult for memory access and computation to completely overlap in multi-level pipeline optimization, resulting in Tensor Core being unable to fully utilize parallel computing performance. In response to this issue, dual chain splitting optimization was designed and developed to adjust the memory access and computation instructions while improving the shared memory access efficiency. The experiment tested different data storage modes and operand shapes. The average acceleration ratio under different data storage modes is 1.3, and the utilization rate of Tensor Core increased by an average of 4.74%. The average acceleration ratio under different operand shapes is 1.21, and the utilization rate of Tensor Core increased by an average of 3.75%.

Authors

Institutions

Publication Details

Published
2025-05-09
DOI
https://doi.org/10.1117/12.3066960
Citations
2
Primary Topic
Interconnection Networks and Systems
Type
article
Field-Weighted Citation Impact
2.97
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimization of Triton matrix multiplication for tensor core

Yixuan Gao, Xiaonan Chai, Jianan Li, Junxiang Wang et al.
2 citations
Interconnection Networks and Systems
2.97
article

Optimization of Triton matrix multiplication for tensor core

Yixuan Gao, Xiaonan Chai, Jianan Li, Junxiang Wang, Dong Zhang
article en
2 citations

Abstract

Matrix multiplication has important and widespread applications in the field of computer science, serving as the foundation of high-performance computing systems and the core of deep learning model applications. Tensor Core is a hardware unit designed specifically for accelerating matrix multiplication, which can greatly improve the computational efficiency of matrix multiplication. Triton is a flexible and efficient deep learning compiler that simplifies the operator development process while providing efficient training and inference performance. However, its block configuration can affect the computational efficiency of the operator. When a certain dimension of the block configuration is small, it is difficult for memory access and computation to completely overlap in multi-level pipeline optimization, resulting in Tensor Core being unable to fully utilize parallel computing performance. In response to this issue, dual chain splitting optimization was designed and developed to adjust the memory access and computation instructions while improving the shared memory access efficiency. The experiment tested different data storage modes and operand shapes. The average acceleration ratio under different data storage modes is 1.3, and the utilization rate of Tensor Core increased by an average of 4.74%. The average acceleration ratio under different operand shapes is 1.21, and the utilization rate of Tensor Core increased by an average of 3.75%.

Zhengzhou University (CN), Inspur (China) (CN), National Supercomputing Center in Wuxi (CN)
Openalex Percentile: Top 9%
Interconnection Networks and Systems
2.97
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.