图书情报知识 ›› 2025, Vol. 42 ›› Issue (1): 18-28.doi: 10.13366/j.dik.2025.01.018

• 二十大精神研究阐释与践行·提升学术研究的政策影响力 • 上一篇    下一篇

科学论文政策影响力计量的数据库选择——基于Altmetric与Overton的比较

方志超1,2, 郑尔特3   

  1. 1. 中国人民大学信息资源管理学院,北京,100872;
    2. 莱顿大学科学与技术研究中心,莱顿(荷兰),2300 AX;
    3. 谢菲尔德大学信息学院,谢菲尔德(英国),S10 2AH
  • 出版日期:2025-01-10 发布日期:2025-03-19
  • 通讯作者: 方志超(ORCID: 0000-0002-3802-2227),博士,讲师,研究方向:科学学、科学计量学,Email: fangz@ruc.edu.cn。
  • 作者简介:郑尔特(ORCID: 0000-0001-8759-3643),博士研究生,研究方向:科学学、科学计量学,Email: ezheng1@sheffield.ac.uk。
  • 基金资助:
    本文系国家自然科学基金青年科学基金项目“基于社交媒体用户画像的科学论文传播模式与影响力性质研究”(72304274)的研究成果之一。

Database Selection for Measuring the Policy Impact of Scientific Papers: A Comparison Between Altmetric and Overton

FANG Zhichao1,2, ZHENG Er-Te3   

  1. 1. School of Information Resource Management of Renmin University of China, Beijing, 100872;
    2. Centre for Science and Technology Studies of Leiden University, Leiden(The Netherlands), 2300 AX;
    3. Information School of the University of Sheffield, Sheffield(The UK), S10 2AH
  • Online:2025-01-10 Published:2025-03-19
  • Contact: Correspondence should be addressed to FANG Zhichao, Email: fangz@ruc.edu.cn, ORCID: 0000-0002-3802-2227
  • Supported by:
    This is an outcome of the Youth Project "Research on the Communication Patterns and Nature of Impact of Scientific Papers Based on Social Media User Profiles"(72304274)supported by National Natural Science Foundation of China.

摘要: [目的/意义]各类政策引文数据库因索引范围的差异,可能导致围绕科学论文的政策计量分析结果的不同。需要通过比较研究来理解不同数据库所能提供的数据基础的差异,以更好地支持科研成果的政策影响力计量与评价。[研究设计/方法]比较了同时期内Altmetric和Overton两大主流政策引文数据库收录的政策文件范围的异同。并面向约1,700万篇科学论文,比较了Altmetric和Overton数据库提供的政策引文数据在覆盖范围、数据体量、学科分布等方面的差异。[结论/发现]相比于Altmetric,Overton提供了范围更广、数量更多的政策文件和政策引文,表现出显著的数据优势。但Altmetric与Overton收录的政策文件仅有小部分重合,二者代表了不同决策主体不同的政策观点和科学证据使用行为,难以相互替代,可以互为补充。[创新/价值]在科研成果的政策影响力定量评价中,应注意和警示政策引文数据库选择对结果可能造成的影响,制定合理的数据获取策略,以实现更负责任的评价。

关键词: 政策计量, 科研评价, 社会影响力, 科学计量学, 替代计量学

Abstract: [Purpose/Significance] Differences in the scope of indexing among various policy citation databases may lead to different results in the policy metric analyses of scientific papers. In order to better support the measurement and evaluation of the policy impact of scientific research outcomes, a comparative study is needed to understand the differences in the data foundations provided by different databases. [Design/Methodology] This study compared the similarities and differences in the range of policy documents included in Altmetric and Overton, two mainstream policy citation databases, during the same period. It also compared the policy citation data provided by Altmetric and Overton for approximately 17 million scientific papers, focusing on aspects such as data coverage, data volume, and disciplinary distribution. [Findings/Conclusion] Compared to Altmetric, Overton provides a broader range and greater number of policy documents and policy citations, demonstrating a significant data advantage. However, only a small portion of the policy documents included in Altmetric and Overton overlap, representing different policy viewpoints and behaviors of different policymakers regarding the use of scientific evidence. Therefore, these databases are difficult to substitute for one another and can be complementary. [Originality/Value] In the quantitative evaluation of the policy impact of scientific research achievements, we should pay attention to and warn the potential impact of the choice of policy citation database on the results, and develop reasonable data acquisition strategies to achieve more responsible evaluations.

Keywords: Policy metrics, Research evaluation, Societal impact, Scientometrics, Altmetrics