Documentation, Informaiton & Knowledge ›› 2025, Vol. 42 ›› Issue (1): 6-17,28.doi: 10.13366/j.dik.2025.01.006

• Interpretation and Practice of the Spirit of the 20th National Congress of the CPC:Enhancing the Policy Impact of Academic Research • Previous Articles     Next Articles

What Kinds of Research Are More Likely to Generate Policy Impact: Taking Classification and Multidimensional Characteristics of Academic Articles as Pathways

CAO Zhe1,2 , SHANG Yuanyuan3 ,ZHANG Lin1,2   

  1. 1. School of Information Management, Wuhan University, Wuhan, 430072;
    2. Center for Science, Technology & Education Assessment, Wuhan University, Wuhan, 430072;
    3. Chinese Academy of Social Sciences Evaluation Studies, Beijing, 100732
  • Online:2025-01-10 Published:2025-03-19
  • Contact: Correspondence should be addressed to ZHANG Lin, Email: linzhang1117@whu.edu.cn, ORCID: 0000-0003-0526-9677
  • Supported by:
    This is an outcome of the project "From Indicators to Indicating: Outcome Classification, Collaboration Patterns, and Impact Diffusion of Interdisciplinary Research"(72374160)supported by National Natural Science Foundation of China, and the Graduate Program for Enhancing Popular Science Capabilities "Pathways and Strategies for Social Dissemination of Scientific Research Outcomes"(KXYJS2024016)supported by China Association for Science and Technology.

Abstract: [Purpose/Significance] Supporting policy formulation is one of the significant reflections of the societal value of scientific research achievements, yet the intricate mechanisms of policy impact of scientific research achievements still remain unclear. This study focuses on the origins of policy impact, investigating the characteristics of policy impact produced by different types of academic papers. The relevant results can provide empirical evidence for scientific research managers to better understand and evaluate the societal value of scientific research achievements. [Design/Methodology] By delineating two primary dimensions of whether the research motivation is policy-oriented and whether the research content provides supportive or persuasive information, we construct a theoretical model for categorizing research articles in terms of policy impact. The specific implementation pathway for classifying different types is designed based on the abstracts of articles. Using articles within the field of biomedicine as an example, and following a framework of "policy impact diffusion – diverse impact comparison – research entity retrospective" to design multidimensional indicators, an empirical research is conducted to reveal the similarities and differences among different types of articles. [Findings/Conclusion] Among the articles with policy citations, policy-oriented papers under the types of action recommendation and decision support are more prevalent. Meanwhile, among the subset of articles with high policy citation counts, there is a higher proportion of papers that offer supportive information under the types of information provision and decision support. The immediacy and persistence of policy citations, along with the diversity of citing institutions and countries, all exhibit differentiated characteristics among these four types of articles. These articles demonstrate relatively consistent influence levels across different scenarios, particularly between online dissemination and policy support domains. From the subject perspective, a retrospective analysis of the causes of policy impacts reveals that international collaboration facilitates such impacts, and the four types of papers produced by different countries, along with their respective characteristics of policy impact, exhibit distinctive features. [Originality/Value] This study constructs a classification model and implementation framework for research articles from a policy impact perspective. It provides a new theoretical framework and methodological guidance for dissecting and understanding the policy impact of scientific research.

Keywords: Policy impact, Article classification, Research motivation, Research content, Scientific evaluation