Data Science Journal (Apr 2009)

Hierarchical Data Replication and Service Monitoring Methods in a Scientific Data Grid

  • Weizhong Lu,
  • Yuanchun Zhou,
  • Kaichao Wu,
  • Baoping Yan

DOI
https://doi.org/10.2481/dsj.007-031
Journal volume & issue
Vol. 8
pp. 113 – 124

Abstract

Read online

In a grid and distributed computing environment, data replication is an effective way to improve data accessibility and data accessing efficiency. It is also significant in developing a real-time service monitoring system for a Chinese Scientific Data Grid to guarantee the system stability and data availability. Hierarchical data replication and service monitoring methods are proposed in this paper. The hierarchical data replication method divides the network into different domains and replicates data in local domains. The nodes in a local domain are classified into hierarchies to improve data accessibility according to bandwidth and storage memory space. An extensible agent-based prototype of a hierarchical service monitoring system is presented. The status information of services in the Chinese Scientific Data Grid is collected from the grid nodes based on agent technology and then is transformed into real-time operational pictures for management needs. This paper presents frameworks of the hierarchical data replication and service monitoring methods and gives detailed resolutions. Simulation analyses have demonstrated improved data accessing efficiency and verified the effectiveness of the methods at the same time.

Keywords