大数据 (May 2020)

The usage of dataflow model in GPU and big data processing

  • Huayou SU,
  • Songzhu MEI,
  • Rongchun LI,
  • Yong DOU

Journal volume & issue
Vol. 6
pp. 2020028 – 1

Abstract

Read online

Dataflow model is an efficient computing model.It has been widely used in software and hardware fields due to its natural advantages in parallelism.In terms of hardware architecture,the dataflow model leads the computer architecture to the direction of supporting higher concurrency from the traditional von Neumann architecture.The stream processor based on the long vector processing unit and the SIMT GPU are two instances of using dataflow technology.In terms of programming models,dataflow ideas have been widely used in the field of big data programming models,such as MapReduce and Spark.The architecture of NVIDIA GPU and CUDA programming model were analyzed from the perspective of dataflow model.The applying and trend of dataflow and GPU were analyzed in big data processing,and ideas and methods were provided for applying GPU-based systems to the field of big data processing.

Keywords