Data Mesh Meets Blockchain

Abstract

Abstract Effective dataset management is crucial for enterprises to make informed decisions and remain competitive. However, centralized dataset management approaches often result in poor scalability, unclear governance, inaccessible data silos, and duplication of efforts. This paper proposes a distributed blockchain-based framework inspired by the data mesh architecture to address these challenges. Our proposed framework leverages blockchain’s decentralized nature to enable efficient and transparent dataset sharing across enterprise business domains. By turning datasets into digital assets and business domains into peers, our framework utilizes blockchain smart contracts to allow business domains to view, request, and share datasets. In this paper, we describe the details of our framework, and we analyze it from scalability, accessibility, security, and data governance perspectives. To validate our framework, we provide a proof-of-concept implementation with a publicly available source code.

Keywords

• Data mesh
• Blockchain
• Dataset governance
• Dataset sharing