IEEE Access (Jan 2023)
An Algorithm for Peer Reviewer Recommendation Based on Scholarly Activity Assessment
Abstract
Journal editors are putting a lot of effort into selecting appropriate reviewers for fair and reliable peer review of submitted manuscripts. Editors consider whether the reviewers have no affinity with any of the authors of manuscripts and have sufficient expertise in reviewing the manuscripts. The affinity can be evaluated by whether any of the reviewers has been a coauthor and/or a coworker in a common institution with any of the authors of the manuscript. The expertise depends on the similarity of the research topic between the reviewer’s published papers and the submitted manuscripts. In this paper we propose an algorithm to recommend appropriate reviewers to editors, based on the assessment of these scholarly activities and achievements. To implement this algorithm, TextRank and GenSim library are used to extract feature sets from abstract and introduction sections of both submitted manuscripts and the reviewer candidates’ papers. Based on the extracted feature sets, affinity and expertise check are implemented. An experiment has been conducted with a data set of over 1,000 papers in the field of DB research to evaluate the performance of this algorithm. The experiment consists of affinity check by using 2-mode network matrix operations and expertise check based on Max Similarity and/or topic clustering. Experimental results show that the recommendation algorithm is reasonable on the basis of scholarly activity assessment and achievements. Our method is designed to optimize the reviewer pool for each journal, client and this algorithm is designed with an open license and has the advantage of being free to use and operate. In addition, our algorithm has the advantage of journal-specific optimization by designing to adjust the expertise of the reviewer selection and the weights for exclusion of interests to reflect journal-specific policies.
Keywords
