FPGA-based heterogeneous acceleration study for multidimensional cubing

Abstract

Today’s information processing not only faces an explosion of data volume and data dimensions, but also has to meet the growing user requirements for timeliness. The increase in the dimensionality of Kylin brings about the problem of dimensional explosion of multidimensional cubes, which puts great pressure on disk and network transmission. To solve the problem of dimensional explosion when building multidimensional cubes in Kylin, this paper proposes a bottom-up three-layer architecture that links from the hardware compression acceleration kernel layer to the query engine layer through the software driver layer. The software-driven layer is implemented through JNI, dynamic link libraries, and global shared resource pools to link the hardware-accelerated kernel layer to the query engine layer. Finally, comparative experiments on the performance of multidimensional cube building are conducted for heterogeneous clusters and normal clusters. The experimental results show that the hardware- accelerated cluster obtains a 3.7 times speedup ratio in build time and a 2 times speedup ratio in average query time, which can alleviate the IO pressure brought by Kylin during the dimensional explosion.

Keywords

• deflate
• fpga
• opencl
• kylin
• olap