Unifying The Evaluation Criteria Of Many Objectives Optimization Using Fuzzy Delphi Method

Abstract

Many objective optimizations (MaOO) algorithms that intends to solve problems with many objectives (MaOP) (i.e., the problem with more than three objectives) are widely used in various areas such as industrial manufacturing, transportation, sustainability, and even in the medical sector. Various approaches of MaOO algorithms are available and employed to handle different MaOP cases. In contrast, the performance of the MaOO algorithms assesses based on the balance between the convergence and diversity of the non-dominated solutions measured using different evaluation criteria of the quality performance indicators. Although many evaluation criteria are available, yet most of the evaluation and benchmarking of the MaOO with state-of-art algorithms perform using one or two performance indicators without clear evidence or justification of the efficiency of these indicators over others. Thus, unify a set of most suitable evaluation criteria of the MaOO is needed. This study proposed a distinct unifying model for the MaOO evaluation criteria using the fuzzy Delphi method. The study followed a systematic procedure to analyze 49 evaluation criteria, sub-criteria, and its performance indicators, a penal of 23 domain experts, participated in this study. Lastly, the most suitable criteria outcomes are formulated in the unifying model and evaluate by experts to verify the appropriateness and suitability of the model in assessing the MaOO algorithms fairly and effectively.

Keywords

• Evaluation Criteria, Fuzzy Delphi, Many Objectives Optimization, Unifying Model