Data pipeline model: exploration of the overthe-counter form of streaming data

Abstract

The current exploration of data element market construction mainly focuses on the construction of data trading venues, while the streaming data market refers to the market in which data suppliers continuously and quickly supply specific data to data users.Streaming data is not suitable for transactions in the data trading venues, so the over-the-counter trading model of streaming data needs to be explored.After studying the current operation status of the streaming data market, it was pointed out that market disorder and insufficient regulatory tools were the main problems, and a data pipeline model for the over-the-counter streaming data market was proposed, including pipeline circulation elements (data pipeline, data factory, data supply chain), market regulation elements (data meter, quality sampling device, compliance auditing device), etc.The technical feasibility of the data pipeline model was demonstrated, and it provided theoretical and technical support for the construction, regulation and supervision of the over-the-counter data market.

Keywords

• data market;data pipeline;streaming data;over-the-counter transaction