图书情报知识 ›› 2017, Vol. 0 ›› Issue (4): 122-129.doi: 10.13366/j.dik.2017.04.122

• 知识、学习与管理 • 上一篇    

ESI学科排名指标的异化与纠正

何春建   

  • 出版日期:2017-07-10 发布日期:2017-07-10

Alienation and Correction of Evaluation Indicators for ESI Disciplinary Impact

  • Online:2017-07-10 Published:2017-07-10

摘要:

选择进入ESI材料科学前1%的20所机构为样本,按照机构是否为主要负责机构,将机构发文分为P1、P2两部分。通过对比分析P1、P2的自引比重,发现各机构P1部分的自引比重较大,近几年各机构发文的篇均自引数越来越大,篇均他引数小的机构过度自引更为严重,过度自引已经造成ESI学科排名指标异化。本文在排除机构自引、区分机构是否为主要负责机构的基础上,设计了一种新指标——累计综合影响力(TVF)和年度新增影响力(VF(t)), 该指标既能反映机构发文的总他引数量又能反映机构发文的他引文献的质量。实证分析TVF、总被引数、总他引数、篇均他引数、施引文献的h指数、他引文献的总他引数等指标的皮尔森相关性,发现在本样本中总被引数已丧失指标价值,总被引数与篇均他引数以及其与施引文献的h指数的相关性不大;TVF与篇均他引数以及施引文献的h指数的皮尔森相关均为强相关,说明新指标可纠正ESI学科排名指标的异化。

关键词: ESI学科排名, 评价指标, 累计综合影响力(TVF), 年度新增影响力(VF(t)), 异化, 过度自引

Abstract:

This paper chooses 20 institutions whose discipline of material science has ranked the top 1% of ESI and divides their articles into P1 and P2 according to whether the author affiliation is the major one. It evaluates the degree of excessive selfcitation through a comparative analysis of selfcitations proportion of P1 and P2, thus discover the alienation of ESI discipline ranking indicator. Such alienation is due to excessive selfcitations, for there is generally excessive selfcitations among institutions, especially those with a low average other citations. Based on excluding selfcitations and considering whether the author affiliation is the major one, the paper design new indicators: accumulated comprehensive influence (TVF) and indicator VF(t), which can reflect both the quantity and quality of the cited articles. And then this paper makes an empirical analysis of Pearson correlation of such indicators as TVF, total citations, total other citations, average other citations, H index of the cited article and the number of other citations of other cited literatures. Excessive selfcitations lead to the loss of indicator value in total citation, and there are no obvious correlations between average other citations, hindex and total citations,which cannot reflect the quality of either the paper or the cited articles. There exist strong Pearson correlations between average other citations, hindex and TVF, showing that the new index corrects the alienation of ESI discipline ranking indicator to a certain degree.

Key words: ESI discipline ranking, Evaluation indicators, Accumulated comprehensive impact(TVF), Yearly new impact(VF(t)), Alienation, Excessive selfcitations