Documentation, Informaiton & Knowledge ›› 2025, Vol. 42 ›› Issue (1): 70-77,88.doi: 10.13366/j.dik.2025.01.070

• Academic Focus (1) : Large Models and Information Resources Management • Previous Articles     Next Articles

Reflections on Some Issues of Science and Technology Innovation Evaluation Driven by Large Models

ZHANG Yang, WU Tingting, HOU Jianhua   

  1. School of Information Management, Sun Yat-sen University, Guangzhou, 510006
  • Online:2025-01-10 Published:2025-03-19
  • Contact: Correspondence should be addressed to HOU Jianhua, Email: houjh5@mail.sysu.edu.cn, ORCID: 0000-0001-7080-7131
  • Supported by:
    This is an outcome of the Major Project "Evaluation System and Enhancement Strategy of Social Impact of Scientific Research Achievements"(23&ZD226)supported by National Social Science Foundation of China.

Abstract: [Purpose/Significance] In the era of big science, the evaluation paradigm for science and technology innovation driven by large models is undergoing a profound change. Clarifying a number of issues on large model-driven evaluation for science and technology innovation can enhance the practical value and strategic guidance of such evaluations and provide powerful support for scientific and technological advancement and social development. [Design/Methodology] Based on the evolution of the evaluation of science and technology innovation and the main features of large model-driven evaluation for science and technology innovation, this paper deeply analyzes the main dimensions of applying large models to evaluate science and technology innovation. Furthermore, it reflects on several challenges faced by large model-driven evaluations and explores future development trends. [Findings/Conclusion] The evaluation of science and technology innovation driven by large models will become a key force for the transformation and progress of the new era's science and technology evaluation paradigm. Large models make science and technology innovation evaluation more intelligent, refined and personalized. The integrated development of large models with scientific research, technology development, science and technology evaluation, science and technology management will become an inevitable trend. [Originality/Value] A number of issues on the application of large models to science and technology innovation evaluation are analyzed to provide a reference and basis for the construction of an evaluation system for science and technology innovation with intelligence, refinement, systematization and personalization as the core and sustainability and responsibility as the orientation.

Keywords: Science and technology innovation evaluation, Large models, Digital Intelligence-drive