Documentation, Informaiton & Knowledge ›› 2026, Vol. 43 ›› Issue (4): 18-27.doi: 10.13366/j.dik.2026.04.018

• Interpretation and Practice of the Spirit of the 20th National Congress of the CPC: High-Quality Datasets Construction • Previous Articles     Next Articles

High-Quality Dataset Construction in the Context of the Token Economy

DING Botao   

  1. Institute of Information Science of Shanghai Academy of Social Sciences,Shanghai,200234
  • Online:2026-07-10 Published:2026-10-06
  • Contact: Correspondence should be addressed to DING Botao, Email: dbt@sass.org.cn, ORCID: 0000-0001-9661-6448
  • Supported by:
    This is an outcome of the Special Project "Research on the Governance System of Artificial Intelligence for Sovereign AI"(2026VQH015)affiliated to the project "Interpretation of the Spirit of the Fourth Plenary Session of the 20th Central Committee of the Communist Party of China" supported by a grant from the Philosophy and Social Science Planning Program of Shanghai , and the Major Project "Research on Corpus Development and Governance of Manufacturing 'Veteran Skilled Workers' Based on Tacit Knowledge Transformation Theory"(2026ZD015)supported by Shanghai Academy of Social Sciences.

Abstract: [Purpose/Significance] Token economy has reshaped the value accounting logic of large model industries, and the traditional scale-prioritized dataset construction mode has led to a prominent efficiency paradox. This paper aims to clarify the logic behind the transformation of objective in the construction of high-quality datasets under the token economy, and establish a new full-process dataset construction mode adaptable to token efficiency constraints. [Design/Methodology] This paper constructs an "Objective-Mode" analysis framework, sorts out differentiated data requirements throughout the full lifecycle of large models, analyzes the lock-in effect of original institutional complementarities in each link of dataset construction, and deduces full-link transformation solutions covering data collection, cleaning, annotation and evaluation. [Findings/Conclusion] The core objective of dataset construction has shifted from merely expanding data volume to maximizing the marginal value per token. Under new economic constraints, the original collaborative division system across all dataset development stages have fallen out of balance. Partial incremental enhancements, while beneficial, are insufficient to resolve structural contradictions. Consequently, a systematic transformation of the entire lifecycle is indispensable. Dataset construction needs to shift to a new operation system featuring targeted collection, semantic-level cleaning, pragmatic annotation, and dynamic token efficiency evaluation. [Originality/Value] This paper proposes a dynamic evaluation system centered on token consumption and inference benefits, and develops an integrated governance scheme covering the whole chain from data production to model inference. It can provide countermeasure references for government data standard formulation, enterprises datasets development, and industry data collaborative construction.

Keywords: Token economy, High-Quality datasets, Data industry, Artificial Intelligence, Large Language Models, Paradigm shift