Journal of Information Resources Management ›› 2026, Vol. 16 ›› Issue (4): 42-53.doi: 10.13365/j.jirm.2026.04.042

Previous Articles     Next Articles

Research on the Construction of LLM-based Intelligent Agent for Academic Paper Evaluation

Zhang Rui1 Zheng Ziyang1 Lin Xin2   

  1. 1.School of Economics and Management, Hubei University of Technology, Wuhan, 430068; 
    2.School of Information Management, Central China Normal University, Wuhan, 430079
  • Online:2026-07-26 Published:2026-09-21
  • About author:Zhang Rui, Ph.D., lecturer, research interests including science measurement and knowledge management; Zheng Ziyang, master candidate, research interests including scientific evaluation; Lin Xin(corresponding author), professor, Ph.D., research interests including knowledge organization and services, Email: xinlin@ccnu.edu.cn.
  • Supported by:
    This research is supported by the National Social Science Fund of China "Research on Semantic Annotation and Object Linking for Multimodal Publishing of Academic Papers"(23BTQ083).

Abstract: As an important carrier for the implementation of large language models(LLMs), intelligent agent provides a novel path for building a generation new paradigm of academic evaluation. This paper presents the inherent logic of LLM enabled academic paper evaluation, clarifies its indicator design, evaluation mechanism, and application requirements. On this basis, the paper further proposes an overall framework comprising agent tier, model tier, data tier, and interaction tier. Then, we describe the collaborative mechanism among agents and the indicator calculation scheme. Based on these components, we form a method for constructing academic paper evaluation agents that integrate perception, cognition, analysis, and decision-making capabilities. Finally, we systematically implemented the intelligent agent framework and analyzed its effectiveness through application cases. This implementation and analysis demonstrate that the LLM-based agent not only further ensures the availability, credibility, and controllability of the evaluation process, but also represents an exploration of a scalable, adaptive, and intelligent solution for academic paper evaluation.

Key words: Academic evaluation, Paper evaluation, Large language model, Academic agent

CLC Number: