融合创新与认可的科研论文学术价值测度方法研究
——以人工智能领域为例

doi:10.13365/j.jirm.2024.06.017

信息资源管理学报 ›› 2024, Vol. 14 ›› Issue (6): 17-30.doi: 10.13365/j.jirm.2024.06.017

融合创新与认可的科研论文学术价值测度方法研究 ——以人工智能领域为例

吴佳纯¹　董克^1,2　陈星源¹　陈丽芳¹　孙佳明¹

1.南京大学数据管理创新研究中心，苏州，215163；　
2.南京大学信息管理学院，南京，210023

出版日期:2024-11-26 发布日期:2024-12-19
作者简介:吴佳纯（通讯作者），博士研究生，研究方向为知识创新与信息计量，Email: hdu_wjc@163.com；董克，博士，研究员，长聘副教授，博士生导师，研究方向为信息计量与评价；陈星源，硕士研究生，研究方向为信息计量与评价；陈丽芳，硕士研究生，研究方向为信息计量与评价；孙佳明，硕士研究生，研究方向为信息计量与评价。
基金资助:
本文系国家社会科学基金项目“面向代表作评价的科研论文学术价值测度研究”（21CTQ017）的研究成果之一。

Measuring the Academic Value of Scientific Papers by Integrating Innovation and Recognition—A Case Study in the Field of Artificial Intelligence

Wu Jiachun1　Dong Ke^1,2　Chen Xingyuan¹　Chen Lifang¹　Sun Jiaming¹

1.Research Institute for Data Management & Innovation, Nanjing University, Suzhou, 215163;　
2. School of Information Management, Nanjing University, Nanjing, 210023

Online:2024-11-26 Published:2024-12-19
About author:Wu Jiachun(corresponding author), Ph.D. candidate, with research interests in knowledge innovation and information measurement, Email: hdu_wjc@163.com; Dong Ke, Ph.D., research fellow, tenured associate professor, doctoral supervisor, with research interests in informetrics and evaluation; Chen Xingyuan, postgraduate, with research interests in informetrics and evaluation; Chen Lifang, postgraduate, with research interests in informetrics and evaluation; Sun Jiaming, postgraduate, with research interests in informetrics and evaluation.
Supported by:
This is an outcome of the project "Research on Measuring the Academic Value of Scientific Research Papers for Representative Work Evaluation"(21CTQ017) supported by the National Foundation for Social Sciences.

摘要/Abstract

摘要： 论文全文本及引用关系传递了大量的学术信息，有助于表征学术价值的内涵和提高价值评估的精度。本研究基于价值认识论，融合基于论文自身的事实性认识和基于外部引用的应然性认识，选取1990—2021年Web of Science数据库中人工智能领域论文为实验数据，构建学术价值的新评价指标。研究提出的学术价值评价指标综合考虑了以创新性为代表的内部创新价值以及基于引用情感、引用强度和引用相似性的外部认可价值，通过与传统计量指标比较发现，内部创新价值与被引次数和被提及次数都不相关；外部认可价值与被提及次数正相关，但与被引次数无显著相关；而学术价值同提及次数、内部创新价值、外部认可价值都呈正相关。结果表明，基于被引次数的影响力指标存在滞后性且不足以反映论文创新性，相对于被引次数，融合引用偏好的被提及次数在测度外部认可价值上略有进步，而本研究提出的学术价值测度方法在融合论文内外部价值及反映综合学术价值上具有一定优势。

关键词: 学术价值, 内部创新价值, 外部认可价值, 评价指标, 科学评价

Abstract: The full text of papers and their citation relationships convey a significant amount of academic information, which helps characterize the connotation of academic value and improve the precision of value assessment. This study builds a new evaluation index of academic value based on the epistemology of value, integrating the factual knowledge based on the papers themselves with the contingent knowledge based on external citations, and selecting papers in the field of artificial intelligence from the Web of Science database from 1990 to 2021 as the experimental data. Compared with traditional metrics, the academic value measurement proposed in this study comprehensively considers the value of internal innovation(represented by innovativeness), external recognition value(based on citation sentiment, citation intensity, and citation similarity). The results showed that:(1) value of internal innovation was not correlated with either the number of citations or the number of mentions;(2) value of external recognition was positively correlated with the number of mentions but not significantly correlated with the number of citations;(3) and academic value was positively correlated with the number of mentions, value of internal innovation, and value of external recognition, although value of external recognition was not significantly correlated with value of internal innovation. The results revealed that the impact indicator based on the number of citations has a lag and is insufficient to reflect the paper’s innovation. Compared to citation counts, the number of mentions, incorporating citation preference, shows slight improvement in measuring value of external recognition. The academic value measure proposed in this study has certain advantages in integrating the internal and external values of the paper and reflecting comprehensive academic value.

Key words: Academic value, Value of internal innovation, Value of external recognition, Evaluation indicators, Scientific evaluation

中图分类号:

G350

吴佳纯　董克　陈星源　陈丽芳　孙佳明. 融合创新与认可的科研论文学术价值测度方法研究 ——以人工智能领域为例[J]. 信息资源管理学报, 2024, 14(6): 17-30.

Wu Jiachun　Dong Ke　Chen Xingyuan　Chen Lifang　Sun Jiaming. Measuring the Academic Value of Scientific Papers by Integrating Innovation and Recognition—A Case Study in the Field of Artificial Intelligence[J]. Journal of Information Resources Management, 2024, 14(6): 17-30.

[1]	陆泉　岳雪琪　刘婷　李易时　陈静. 基于多维特征的网络健康信息可信度评估研究[J]. 信息资源管理学报, 2021, 11(3): 121-131.
[2]	张兆阳　吕妍　罗思琪　张晓含　吴宇晨　赵蓉英. 突发公共卫生事件背景下微博影响力评价——以20家主流媒体微博为例[J]. 信息资源管理学报, 2021, 11(2): 17-27.
[3]	姚胜译　吴丹. APP隐私政策用户友好度评价研究[J]. 信息资源管理学报, 2021, 11(1): 30-39.
[4]	俞立平. 学术评价中一级指标测度方法研究 ——结构方程降维法[J]. 信息资源管理学报, 2020, 10(5): 76-84.
[5]	刘娇月　安璐. 高校图书馆信息化水平评价指标体系研究[J]. 信息资源管理学报, 2015, 5(1): 98-103.
[6]	吴欣. 高层次创新型科技人才评价指标体系研究[J]. 信息资源管理学报, 2014, 4(3): 107-封三.
[7]	莫祖英　马费成　罗毅. 微博信息质量评价模型构建研究[J]. 信息资源管理学报, 2013, 3(2): 12-18.
[8]	蒋楠　王鹏程. 社会化问答服务中用户需求与信息内容的相关性评价研究——以“百度知道”为例[J]. 信息资源管理学报, 2012, 2(3): 35-45.

融合创新与认可的科研论文学术价值测度方法研究 ——以人工智能领域为例

Measuring the Academic Value of Scientific Papers by Integrating Innovation and Recognition—A Case Study in the Field of Artificial Intelligence

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 8

编辑推荐

Metrics

本文评价