Multi-task Cooperative Optimization Algorithm Based on Adaptive Knowledge Transfer andResource Allocation

Abstract

Multi-task optimization algorithm optimizes each task separately and transfers knowledge among tasks at the same time to improve the comprehensive performance of multiple tasks.However,the negative knowledge transfer between tasks with low similarity leads to the overall performance degradation,and allocating the same computing resources to tasks with different difficulties will lead to resource waste.In addition,it is easy to fall into local optimum by using fixed search step size at different stages of the task.To solve these problems,a multi-task collaborative optimization(AMTO) algorithm based on adaptive know-ledge transfer and dynamic resource allocation is proposed.Firstly,each task is optimized by a single population,and a population is divided into three subpopulations.Three different search strategies are adopted to increase the diversity of search behavior.The search step size is dynamically updated according to the individual update success rate in a single task to enhance the adaptive search ability and avoid falling into local optimum.Secondly,the similarity between tasks is calculated online using the feedback results of knowledge transfer among multiple tasks,and the transfer probability is adjusted adaptively according to the similarity.At the same time,when the similarity between tasks is low,the task deviation should be subtracted to reduce the performance degradation caused by negative knowledge transfer and improve the perception ability of the algorithm to the differences between tasks.Then,the difficulty and optimization state of the task is estimated by evaluating the improvement degree of the task performance,and the resources are dynamically allocated on demand for the tasks with different difficulties and states to maximize the utilization value of resources and reduce the waste of resources.Finally,on the simple and the complex multi-task optimization functions,the proposed algorithm is compared with the classical multi-task algorithms to verify the effectiveness of the adaptive migration strategy,dynamic resource allocation strategy and synthesis.

Keywords

• adaptive knowledge transfer|multi-task collaborative optimization|dynamic group search algorithm|computing resource allocation|inter-task deviation