Influencing Migration Processes by Real-Time Data

Abstract

The current trend, where information systems and informatization move forward in quick steps, also influenced database systems. The current trend of a data transfer from the databases with a rigid structure to the systems with a free data structure created a vast amount of challenges, including problems with backward compatibility, the inconsistency of data types, or possibly with an edit of the data during the transformation transfer. We created MigrationLayer to solve this problem, which can manage the structural and data compatibility between a relational and nonrelational database and is divided into three modules: The first module is a module of the transformation, respectively, of the data transfer from the relational database to the nonrelational database. The second module is based on the catching of the data during change that could influence the data entering the system, and the third module is a module of backward compatibility, that based on the data change evokes a consolidation edit of the structure and of course, the data. Experiments show MigrationLayer can sufficiently effectively catch the incoming data to the transformation module in real-time, and by that to reduce the time needed for the edit after the whole migrations. The module of the backward compatibility effectively helps us to maintain the backward compatibility between the structures of the relational and the nonrelational database.

Keywords

• migrationlayer
• real-time data
• sql databases
• nosql database
• architecture