Kernel Instruction Optimization Based on the Triton Compiler

With the continuous growth of model parameter scale and computational density, kernel execution performance has gradually become an important part of overall model inference and training. The programming language Triton, developed by OpenAI, can serve as the backend of Torch Inductor to assist in generating high-performance GPU kernels. Aiming at the problem of low-quality kernels in the Inductor kernel generation process, the Triton compiler can introduce optimization strategies such as redundant instruction elimination. However, when dealing with program features such as complex memory dependencies, repeated loading, and multiple consecutive division operations, there are still issues of insufficient optimization depth and inadequate recognition and mitigation of performance bottlenecks. Therefore, this paper proposes a unified optimization strategy targeting the intermediate representation level based on the Triton compiler. Through the combination of static analysis and equivalence rewriting, it performs fused optimization on instruction redundancy and algebraic computation patterns. Under the premise of preserving semantic consistency, the method restructures data dependency paths and kernel expression forms, effectively reducing redundant memory accesses, decreasing repetitive and inefficient computation overhead, and improving kernel execution efficiency. Experimental results show that the average speedup of redundant instruction optimization reaches 1.47, while the average speedup of algebraic transformation optimization reaches 1.29.

Authors

Institutions

Publication Details

Published
2025-04-25
DOI
https://doi.org/10.1109/iccea65460.2025.11102282
Primary Topic
Embedded Systems and FPGA Design
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Kernel Instruction Optimization Based on the Triton Compiler

Wei Gao, Yangyang Du, Jianan Li, Lin Han
Embedded Systems and FPGA Design
article

Kernel Instruction Optimization Based on the Triton Compiler

Wei Gao, Yangyang Du, Jianan Li, Lin Han
article en

Abstract

With the continuous growth of model parameter scale and computational density, kernel execution performance has gradually become an important part of overall model inference and training. The programming language Triton, developed by OpenAI, can serve as the backend of Torch Inductor to assist in generating high-performance GPU kernels. Aiming at the problem of low-quality kernels in the Inductor kernel generation process, the Triton compiler can introduce optimization strategies such as redundant instruction elimination. However, when dealing with program features such as complex memory dependencies, repeated loading, and multiple consecutive division operations, there are still issues of insufficient optimization depth and inadequate recognition and mitigation of performance bottlenecks. Therefore, this paper proposes a unified optimization strategy targeting the intermediate representation level based on the Triton compiler. Through the combination of static analysis and equivalence rewriting, it performs fused optimization on instruction redundancy and algebraic computation patterns. Under the premise of preserving semantic consistency, the method restructures data dependency paths and kernel expression forms, effectively reducing redundant memory accesses, decreasing repetitive and inefficient computation overhead, and improving kernel execution efficiency. Experimental results show that the average speedup of redundant instruction optimization reaches 1.47, while the average speedup of algebraic transformation optimization reaches 1.29.

Zhengzhou University (CN), National Supercomputing Center in Wuxi (CN)
Openalex Percentile: Top 76%
Embedded Systems and FPGA Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Kernel Instruction Optimization Based on the Triton Compiler — Wei Gao, Yangyang Du, et al. · (2025) | TGRS Research Map | TGRS