Instruction co-optimization based on triton compiler

Triton, as a high-performance compiler tailored for GPU computing, is capable of automatically converting high-level computations into efficient GPU code. Its optimization module includes classic optimization techniques such as instruction normalization, redundant instruction removal, and common subexpression elimination. However, there is still room for optimization regarding debugging instructions and specific computational instruction combinations. Addressing these issues, this paper proposes a collaborative optimization strategy targeting the intermediate representation of the Triton compiler, achieving performance enhancement through two key optimization techniques. Firstly, based on data flow analysis, it automatically identifies and safely removes redundant assert instructions generated during the model’s training or inference process. Secondly, through pattern matching, it converts low-efficiency instruction sequences into more efficient instruction combinations while strictly maintaining semantic consistency. Experimental results show that the average acceleration ratio of eliminating redundant assert instructions can reach 1.31, and the average acceleration ratio of instruction optimization can reach $\mathbf{1. 0 6}$. This collaborative optimization strategy has significantly improved the performance of code generated by the Triton compiler, providing more efficient execution efficiency for the training and inference of deep learning models.

Institutions

Publication Details

Published
2025-06-20
DOI
https://doi.org/10.1109/icecai66283.2025.11170978
Primary Topic
Bioeconomy and Sustainability Development
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Instruction co-optimization based on triton compiler

Bioeconomy and Sustainability Development
article

Instruction co-optimization based on triton compiler

article en

Abstract

Triton, as a high-performance compiler tailored for GPU computing, is capable of automatically converting high-level computations into efficient GPU code. Its optimization module includes classic optimization techniques such as instruction normalization, redundant instruction removal, and common subexpression elimination. However, there is still room for optimization regarding debugging instructions and specific computational instruction combinations. Addressing these issues, this paper proposes a collaborative optimization strategy targeting the intermediate representation of the Triton compiler, achieving performance enhancement through two key optimization techniques. Firstly, based on data flow analysis, it automatically identifies and safely removes redundant assert instructions generated during the model’s training or inference process. Secondly, through pattern matching, it converts low-efficiency instruction sequences into more efficient instruction combinations while strictly maintaining semantic consistency. Experimental results show that the average acceleration ratio of eliminating redundant assert instructions can reach 1.31, and the average acceleration ratio of instruction optimization can reach $\mathbf{1. 0 6}$. This collaborative optimization strategy has significantly improved the performance of code generated by the Triton compiler, providing more efficient execution efficiency for the training and inference of deep learning models.

Zhengzhou University (CN)
Openalex Percentile: Top 34%
Bioeconomy and Sustainability Development
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.