Research on Asynchronous Global Index of Financial Distributed Database

Abstract

With the rapid development of mobile payment, the traditional centralized database used by the  financial core business is confronted with challenges in terms of performance and availability. For this reason, some researchers propose a distributed database solution based on the architecture of separation of computing and storage, and build a physically decentralized and logically centralized distributed database management system through network connection. Global index is an important method for distributed database to improve query efficiency, but current global indexing is mainly achieved through the use of synchronization mechanisms in traditional networks.Under the typical transaction and batch import data scenarios of financial data management, this mechanism faces the problems that need to be solved urgently, such as small number of indices in a single table, reduced throughput, and jittery transaction response time. Therefore, an asynchronous global index architecture of distributed database is proposed. This mechanism is applied to adding MQ message queue and distributed cache, and uses RDMA network to realize an asynchronous global index to meet the demands of the real financial scenarios. Through sufficient comparative experiments with Oracle and CockroachDB, experimental results show that the performance is improved by more than 60% compared with the existing methods, and the demand for system resources is reduced by more than 20% in the batch import and transaction of financial core business data.

Keywords

• distributed database; asynchronous; global index; low latency；rdma network