Applied Sciences (Jun 2021)

A Modified Quad Q Network Algorithm for Predicting Resource Management

  • Yeonggwang Kim,
  • Jaehyung Park,
  • Jinyoung Kim,
  • Junchurl Yoon,
  • Sangjoon Lee,
  • Jinsul Kim

DOI
https://doi.org/10.3390/app11115154
Journal volume & issue
Vol. 11, no. 11
p. 5154

Abstract

Read online

As the resource management systems continues to grow, the resource distribution system is expected to expand steadily. The demand response system enables producers to reduce the consumption costs of an enterprise during fluctuating periods in order balance the supply grid and resell the remaining resources of the product to generate revenue. Q-learning, a reinforcement learning algorithm based on a resource distribution compensation mechanism, is used to make optimal decisions to schedule the operation of smart factory appliances. In this paper, we proposed an effective resource management system for enterprise demand response using a Quad Q Network algorithm. The proposed algorithm is based on a Deep Q Network algorithm that directly integrates supply-demand inputs into control logic and employs fuzzy inference as a reward mechanism. In addition to using uses the Compare Optimizer method to reduce the loss value of the proposed Q Network Algorithm, Quad Q Network also maintains a high accuracy with fewer epochs. The proposed algorithm was applied to market capitalization data obtained from Google and Apple. Also, we verified that the Compare Optimizer used in Quad Q Network derives the minimum loss value through the double operation of Double Q value.

Keywords