XEM: Tensor accelerator for AB21 supercomputing artificial intelligence processor

Abstract

As computing systems become increasingly larger, high-performance comput-ing (HPC) is gaining importance. In particular, as hyperscale artificial intelli-gence (AI) applications, such as large language models emerge, HPC has become important even in the field of AI. Important operations in hyperscale AI and HPC are mainly linear algebraic operations based on tensors. An AB21 supercomputing AI processor has been proposed to accelerate such applica-tions. This study proposes a XEM accelerator to accelerate linear algebraic operations in an AB21 processor effectively. The XEM accelerator has outer product-based parallel floating-point units that can efficiently process tensor operations. We provide hardware details of the XEM architecture and intro-duce new instructions for controlling the XEM accelerator. Additionally, hard-ware characteristic analyses based on chip fabrication and simulator-based functional verification are conducted. In the future, the performance and func-tionalities of the XEM accelerator will be verified using an AB21 processor.

Keywords

• artificial intelligence
• high-performance computing
• neural processing unit
• system verification
• tensor computation