Documentation, Informaiton & Knowledge ›› 2026, Vol. 43 ›› Issue (2): 26-34.doi: 10.13366/j.dik.2026.02.026

• Special Section on In-depth Study and Implementation of General Secretary Xi Jinping's Important Speech at the Symposium on Philosophy and Social Sciences Work • Previous Articles     Next Articles

Paradigm Transformation and Implementation Pathway of LLM-Driven Innovation Evaluation in Philosophy and Social Sciences

LU Wei   

  1. School of Information Management, Wuhan University, Wuhan, 430072
  • Online:2026-03-10 Published:2026-05-21
  • Contact: Correspondence should be addressed to LU Wei, Email: weilu@whu.edu.cn, ORCID: 0000-0002-0929-7416
  • Supported by:
    This is an outcome of the Youth Project "Research on the Identification and Evaluation of Academic Originality Driven by Digital Intelligence"(24CTQ054)supported by National Social Science Foundation of China.

Abstract: [Purpose/Significance] Oriented toward the construction of an independent knowledge system for philosophy and social sciences with Chinese characteristics, this paper explores an LLM-driven framework for innovation evaluation, aiming to shift evaluation toward content understanding and evidence-based assessment. [Design/Methodology] This paper constructs a LLM-driven innovation evaluation framework for philosophy and social sciences, proposing a five-dimensional evaluation system—value guidance, problem orientation, innovation contribution, argumentative support, and outcome impact—operationalized into nineteen indicators. Based on this, it designs an implementation pathway using full-text data and multi-source information, supported by model-based analysis and expert involvement. [Findings/Conclusion] LLMs hold significant promise for enhancing content recognition and evidence-based support in the evaluation of innovation, but currently function mainly as auxiliary evaluation tool. [Originality/Value] Grounded in the intrinsic requisites of academic innovation assessment for philosophy and social sciences, this paper constructs an LLM-driven evaluation indicator system and its implementation pathway, providing a reference for reforming innovation evaluation and improving the evaluation system of philosophy and social sciences in China.

Keywords: Philosophy and social sciences, Innovation evaluation, Large language models, Paradigm transformation, Independent knowledge system