Journal of Information Resources Management ›› 2023, Vol. 13 ›› Issue (2): 125-134.doi: 10.13365/j.jirm.2023.02.125

Previous Articles     Next Articles

A New Probe into Peer Review Quality: A Narrative Review of Research on Peer Review Comment Mining

Wang Yongzhen Wang Xianwen   

  1. WISE Lab, Institute of Science of Science and S&T Management, Dalian University of Technology, Dalian 116024
  • Online:2023-03-26 Published:2023-04-20

Abstract: A paradigm shift in peer review quality research——driven by the progressive popularity of open peer review and the rapid advancement of natural language processing jointly——is happening, while peer review comment mining (PRCM) is becoming universal unobtrusively. This paper comprehensively summarizes the relevant literature on PRCM to clarify the general characteristics of this emerging research direction, plus the opportunities and challenges it may bring, with the purpose of providing a reference guide for subsequent studies. The literature review shows, nowadays, the vast majority of PRCM-related research focuses on the investigation of prediction capability, emotion expression, and argumentation logic with respect to peer review comments, with special attention paid to the feasibility and validity of various text mining methods when applied to interpreting and analyzing peer review comments. In addition, the data samples used in PRCM-related research are limited to conference papers on computer science (in English).

Key words: Peer review, Peer review quality, Peer review comment mining, Text mining, Science and technology evaluation

CLC Number: