Impact of ChatGPT-Driven Automated Feedback on University Students' Engagement and Electroencephalogram Activity in Design

WU Xin; CHEN Fei

doi:10.19554/j.cnki.1001-3563.2025.22.032

PDF(830 KB)

Packaging Engineering ›› 2025, Vol. 46 ›› Issue (22) : 352-362. DOI: 10.19554/j.cnki.1001-3563.2025.22.032

Impact of ChatGPT-Driven Automated Feedback on University Students' Engagement and Electroencephalogram Activity in Design

WU Xin¹, CHEN Fei^2,*

Author information +

History +

Abstract

The work aims to investigate the impact of ChatGPT-based automated feedback technology on university students' engagement and electroencephalogram activity in design education, with a particular focus on students' behavioral patterns, cognitive strategies, emotional responses, and attention states during their interactions with ChatGPT. Using a mixed-methods approach, the research conducted a multiple case study of four design students. Data on participation was collected from multiple perspectives, including revision behaviors, application of cognitive strategies, and emotional responses to feedback, based on ChatGPT's dialogue generation mechanism. The findings revealed that students' interaction patterns with ChatGPT significantly correlated with their creative performance. Students with higher creativity demonstrated more sophisticated and refined characteristics in prompt strategy construction, iterative processing of feedback, and metacognitive regulation abilities, while those with lower creativity tended to adopt simpler linear thinking patterns. Although students generally acknowledge ChatGPT's design value and emotional appeal, they inevitably face cognitive load challenges in complex prompt construction and multi-level feedback integration. This study provides theoretical and practical references for researchers planning to incorporate automated feedback technology in design activities.

Key words

ChatGPT / design behavior / engagement / electroencephalogram / concentration level

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

WU Xin, CHEN Fei. Impact of ChatGPT-Driven Automated Feedback on University Students' Engagement and Electroencephalogram Activity in Design[J]. Packaging Engineering. 2025, 46(22): 352-362 https://doi.org/10.19554/j.cnki.1001-3563.2025.22.032

References

[1] 吴丹, 郭清玥. “十四五” 时期图情学科愿景展望——基于全球战略蓝图的分析[J]. 图书情报知识, 2021, 38(3): 14-26.
WU D, GUO Q Y.Prospects for Library and Information Science in the 14th Five-Year Plan Period: Analysis Based on the Global Strategic Blueprint[J]. Documentation, Information & Knowledge, 2021, 38(3): 14-26.
[2] NAZIR A, WANG Z.A Comprehensive Survey of ChatGPT: Advancements, Applications, Prospects, and Challenges[J]. Meta-Radiology, 2023, 1(2): 100022.
[3] 朱永新, 杨帆. ChatGPT/生成式人工智能与教育创新: 机遇、挑战以及未来[J]. 华东师范大学学报(教育科学版), 2023, 41(7): 1-14.
ZHU Y X, YANG F.ChatGPT/AIGC and Educational Innovation: Opportunities, Challenges, and the Future[J]. Journal of East China Normal University (Educational Sciences), 2023, 41(7): 1-14.
[4] 宁子昂, 于忠卉. 教育心理学视角下高校教学管理的应用[J]. 心理学进展, 2024, 14(8): 15-21.
NING Z A, YU Z H.Application of University Teaching Management from the Perspective of Educational Psychology[J]. Advances in Psychology, 2024, 14(8): 15-21.
[5] 李志河, 冯燕, 李瑞萱. 如何培养教育技术学专业本科生的设计思维?[J]. 现代教育技术, 2024, 34(3): 71-78.
LI Z H, FENG Y, LI R X.How to Cultivate the Design Thinking of Undergraduate Students Majoring in Educational Technology?[J]. Modern Educational Technology, 2024, 34(3): 71-78.
[6] YU H.Reflection on Whether Chat GPT should Be Banned by Academia from the Perspective of Education and Teaching[J]. Frontiers in Psychology, 2023, 14: 1181712.
[7] GUO Y, LEE D.Leveraging ChatGPT for Enhancing Critical Thinking Skills[J]. Journal of Chemical Education, 2023, 100(12): 4876-4883.
[8] RUKSAKULPIWAT S, KUMAR A, AJIBADE A.Using ChatGPT in Medical Research: Current Status and Future Directions[J]. Journal of Multidisciplinary Healthcare, 2025, 16: 1513-1520.
[9] BEDENLIER S, BOND M, BUNTINS K, et al.Facilitating Student Engagement through Educational Technology in Higher Education: A Systematic Review in the Field of Arts and Humanities[J]. Australasian Journal of Educational Technology, 2020: 126-150.
[10] 陈煌, 陈锦昌, 陈亮, 等. 基于用户参与度的移动学习游戏设计理论探讨[J]. 包装工程, 2013, 34(22): 73-76.
CHEN H, CHEN J C, CHEN L, et al.Discussion on Mobile Learning Game Design Theory Based on User Partici Pation[J]. Packaging Engineering, 2013, 34(22): 73-76.
[11] ADESHOLA I, ADEPOJU A P.The Opportunities and Challenges of ChatGPT in Education[J]. Interactive Learning Environments, 2024, 32(10): 6159-6172.
[12] SHI H W, ARYADOUST V.A Systematic Review of AI-Based Automated Written Feedback Research[J]. ReCALL, 2024, 36(2): 187-209.
[13] NG D T K, CHEN X Y, LEUNG J K L, et al. Fostering Students' AI Literacy Development through Educational Games: AI Knowledge, Affective and Cognitive Engagement[J]. Journal of Computer Assisted Learning, 2024, 40(5): 2049-2064.
[14] HUANG M.Student Engagement and Speaking Performance in AI-Assisted Learning Environments: A Mixed-Methods Study from Chinese Middle Schools[J]. Education and Information Technologies, 2025, 30(6): 7143-7165.
[15] GLIKSON E, WOOLLEY A W.Human Trust in Artificial Intelligence: Review of Empirical Research[J]. Academy of Management Annals, 2020, 14(2): 627-660.
[16] MAGNI F, PARK J, CHAO M M.Humans as Creativity Gatekeepers: Are we Biased Against AI Creativity?[J]. Journal of Business and Psychology, 2024, 39(3): 643-656.
[17] ALMEIDA F, FARIA D, QUEIRÓS A. Strengths and Limitations of Qualitative and Quantitative Research Methods[J]. European Journal of Education Studies, 2017, 3(9): 369-387.
[18] SUN Q W, XU D, XU P Y, et al.Neuroscience Meets Building: A Comprehensive Review of Electroencephalogram Applications in Building Life Cycle[J]. Journal of Building Engineering, 2024, 85: 108707.
[19] WU L, WANG S X.Development of a Virtual Reality Creative Enhancement System Utilizing Haptic Vibration Feedback via Electroencephalography[J]. Education and Information Technologies, 2025, 30(5): 5727-5753.
[20] HSIEH M C, ZHANG Y Q, DONG R, et al.Use of EEG Signals, Cortisol Secretion, and Task Performance to Evaluate the Effects of Different Lighting Environments on Concentration Level in a Sustained Attention Task[J]. International Journal of Industrial Ergonomics, 2022, 92: 103371.
[21] CLEMENTS G M, GYURKOVICS M, LOW K A, et al.Dynamics of Alpha Suppression Index both Modality Specific and General Attention Processes[J]. NeuroImage, 2023, 270: 119956.
[22] SABIO J, WILLIAMS N S, MCARTHUR G M, et al.A Scoping Review on the Use of Consumer-Grade EEG Devices for Research[J]. PLoS One, 2024, 19(3): e0291186.
[23] ELLIS R.Epilogue[J]. Studies in Second Language Acquisition, 2010, 32(2): 335-349.
[24] 陈春花, 廖琳, 李语嫣, 等. 有压力才有动力: 挑战性压力源对个体创新行为的影响[J]. 科技进步与对策, 2021, 38(11): 135-142.
CHEN C H, LIAO L, LI Y Y, et al.Motivation Comes from Pressure: Impact of Challenge Stressors on Individual Innovation Behavior[J]. Science & Technology Progress and Policy, 2021, 38(11): 135-142.
[25] WU L, CHAU K T, AHMAD JAAFAR WAN YAHAYA W, et al. The Effect of Electroencephalogram Feedback in Virtual Reality Interactive System on Creativity Performance, Attention Value, and Cognitive Load[J]. International Journal of Human-Computer Interaction, 2025, 41(10): 5955-5972.
[26] YAN D, ZHANG S X.L2 Writer Engagement with Automated Written Corrective Feedback Provided by ChatGPT: A Mixed-Method Multiple Case Study[J]. Humanities and Social Sciences Communications, 2024, 11(1): 1086.
[27] GILL A.A Narrative Study of the Experience of Feedback on a Professional Doctorate: 'a Kind of Flowing Conversation'[J]. Studies in Continuing Education, 2019, 41(2): 191-206.
[28] YAN D.Feedback Seeking Abilities of L2 Writers Using ChatGPT: A Mixed Method Multiple Case Study[J]. Kybernetes, 2025, 54(7): 3757-3781.
[29] HALKIOPOULOS C, GKINTONI E.Leveraging AI in E-Learning: Personalized Learning and Adaptive Assessment through Cognitive Neuropsychology—A Systematic Analysis[J]. Electronics, 2024, 13(18): 3762.
[30] LO C K, HEW K F, JONG M S.The Influence of ChatGPT on Student Engagement: A Systematic Review and Future Research Agenda[J]. Computers & Education, 2024, 219: 105100.