XEM: Tensor accelerator for AB21 supercomputing artificial intelligence processor

Abstract As computing systems become increasingly larger, high‐performance computing (HPC) is gaining importance. In particular, as hyperscale artificial intelligence (AI) applications, such as large language models emerge, HPC has become important even in the field of AI. Important operations in hyperscale AI and HPC are mainly linear algebraic operations based on tensors. An AB21 supercomputing AI processor has been proposed to accelerate such applications. This study proposes a XEM accelerator to accelerate linear algebraic operations in an AB21 processor effectively. The XEM accelerator has outer product‐based parallel floating‐point units that can efficiently process tensor operations. We provide hardware details of the XEM architecture and introduce new instructions for controlling the XEM accelerator. Additionally, hardware characteristic analyses based on chip fabrication and simulator‐based functional verification are conducted. In the future, the performance and functionalities of the XEM accelerator will be verified using an AB21 processor.