Documentation, Informaiton & Knowledge ›› 2026, Vol. 43 ›› Issue (4): 55-67.doi: 10.13366/j.dik.2026.04.055

• Academic Focus(2): AI Hallucination • Previous Articles     Next Articles

Differential Effects of Risk Warnings and Explanatory Information on Users' Detection of AI Hallucinations

GENG Ruili1,2,3, AN Guilu1, LI Sentao1, YANG Ruixian1,2,3, SUN Zhuo1,2,3, ZHENG Xiang1,2,3   

  1. 1. School of Information Management, Zhengzhou University, Zhengzhou, 450001;
    2. Zhengzhou Data Science Research Center, Zhengzhou, 450001;
    3. Henan Data Governance Research Center, Zhengzhou, 450001
  • Online:2026-07-10 Published:2026-10-06
  • Contact: Correspondence should be addressed to SUN Zhuo, Email: sunzhuo@zzu.edu.cn, ORCID: 0000-0002-7808-1416
  • Supported by:
    This is an outcome of the project "Henan Province Higher Education Institutions Philosophy and Social Sciences Innovative Talents Support Plan"(2025-CXRC-24)supported by Henan Provincial Department of Education, and the project "Zhengzhou University Young Student Basic Research Projects(PhD Students)"(ZDBJ2026010)supported by Zhengzhou University.

Abstract: [Purpose/Significance] Artificial Intelligence Generated Content(AIGC)is reshaping the fundamental paradigm of contemporary information production and dissemination. When encountering AIGC, users often find it difficult to detect the hidden hallucinatory information due to the superficial rationality of the content. Therefore, effective intervention mechanisms are urgently needed to be explored to improve users' ability to identify AI hallucinations. [Design/Methodology] This study adopted a between-subjects experimental design: 2(text type: with vs. without hallucinations)× 2(intervention type: risk warning vs. explanatory information). Popular science summaries generated by DeepSeek were used as experimental materials, and 651 participants were recruited to engage in a scenario-based experiment. Non-parametric tests and generalized linear models were employed for data analysis. [Findings/Conclusion] In the absence of intervention, users demonstrated limited ability to identify AI hallucinations, and intuitive processing alone was insufficient for effectively distinguishing hallucinated information. The effects of the interventions was jointly constrained by both the characteristics of the content and user traits: explanatory information can significantly improve the identification of texts containing hallucinations, whereas risk warnings had a relatively limited effect; users' AI literacy and prior knowledge negatively moderated the intervention effects, reflecting a substitution effect of cognitive resources and indicating individual differences in intervention effectiveness. [Originality/Value] The findings confirm the explanatory power of Dual-System Theory in the context of AI hallucination recognition , providing a new perspective for understanding cognitive processes involved in human-AI interaction. The conclusions offer implications for optimizing human-AI interaction interfaces and improving the governance of AI hallucinations.

Keywords: Generative artificial intelligence, AI hallucination, Risk warning, Explanatory information, Between-subjects design