大数据 (Jan 2020)
A scheduler system for large-scale distributed data computing in cloud
Abstract
A novel scheduler system including resource scheduling,application scheduling,configuration and label management center,cloud network and cloud storage services was introduced.The locality of computation and data was ensured by the ability of data topology awareness,and the I/O cost was saved.The impact of network storm was solved by optimizing the resource scheduling of point to point large data reading.The service level protocol was guaranteed by network and disk isolation technology and preemptive way.