Interactive Interface Design of Multimodal Intangible Cultural Heritage Apps Based on AIGC

YOU Jiabin; ZHOU Yi

doi:10.19554/j.cnki.1001-3563.2026.08.034

PDF(18193 KB)

Packaging Engineering ›› 2026, Vol. 47 ›› Issue (8) : 404-417. DOI: 10.19554/j.cnki.1001-3563.2026.08.034

Design Discussion

Interactive Interface Design of Multimodal Intangible Cultural Heritage Apps Based on AIGC

YOU Jiabin, ZHOU Yi^*

Author information +

History +

Abstract

The work aims to explore an interactive interface design approach for ICH Apps that integrates artificial intelligence generated content (AIGC) with multimodal interaction, to deal with the common problems of intangible cultural heritage (ICH) Apps, such as single interaction modes, insufficient emotional experience, and low user engagement, to enhance immersion and user experience in digital heritage communication. User demands for ICH Apps were extracted through expert interviews and the KJ method, and then quantitatively analyzed using the A-KANO model and Likert scale, with Better-Worse coefficients and importance indices employed to determine the priority of each demand. Based on these results, Dejiang Nuo Opera, a national-level intangible cultural heritage, was selected as a case study to develop a multimodal interactive interface design incorporating AIGC-generated textual, visual, and auditory content. An App prototype was constructed and subjected to user testing and satisfaction evaluation. The results indicated that twelve core user demands were identified, among which content comprehensibility, visual simplicity, and ease of information access were ranked as high-priority factors. The AIGC-based multimodal interactive interface demonstrated favorable performance in cultural expression, emotional resonance of voice interaction, and clarity of interaction feedback, with user evaluations showing a high level of overall satisfaction. The study confirms that AIGC-driven multimodal interactive interface design can effectively improve user experience and communication effectiveness in ICH Apps, providing a practical design reference for the digital development of intangible cultural heritage.

Key words

artificial intelligence generated content (AIGC) / multimodal interaction / intangible cultural heritage App / KJ method / A-KANO model

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

YOU Jiabin, ZHOU Yi. Interactive Interface Design of Multimodal Intangible Cultural Heritage Apps Based on AIGC[J]. Packaging Engineering. 2026, 47(8): 404-417 https://doi.org/10.19554/j.cnki.1001-3563.2026.08.034

References

[1] 中共中央关于制定国民经济和社会发展第十五个五年规划的建议[EB/OL]. (2025-10-28)[2026-1-11]. https://www.gov.cn/zhengce/202510/content_7046050.htm.
Recommendations of the CPC Central Committee on Formulating the 15th Five-Year Plan for National Economic and Social Development[EB/OL]. (2025-10-28)[2026-1-11]. https://www.gov.cn/zhengce/202510/content_ 7046050.htm.
[2] 汪先敏, 张超, 尤良洁. 基于情感化设计与生成式AI的扎染APP界面交互设计研究[J]. 印刷与数字媒体技术研究, 2025, (S2): 103-109.
WANG X M, ZHANG C, YOU L J.Research on the Interactive Design of Tie-Dye APP Interface Based on Emotional Design and Generative AI[J]. Printing and Digital Media Technology Study, 2025, (Sup. 2): 103-109.
[3] MA L.Research on the Interactive Interface Design of Intangible Cultural Heritage APP[J]. Printing and Digital Media Technology Study, 2023, (2): 65-72.
[4] CHENG P P, CHEN D L.Cultural gene decoding: digital protection of intangible paper-cut and construction of gene bank[J]. Digital Scholarship in the Humanities, 2025, 40(1): 54-63.
[5] 陈艺, 郜红合, 许妍妍. 皮尔士符号学视域下非遗煤精IP形象设计研究[J]. 包装工程, 2025, 46(22): 573-582.
CHEN Y, GAO H H, XU Y Y, IP Image Design of Coal Essence as Intangible Cultural Heritage from the Perspective of Peirce's Semiotics[J]. Packaging Engineering, 2025, 46(22): 573-582.
[6] 梁可嘉, 童玲. AIGC视域下梅山非遗文化在食品包装设计中的创新表达[J]. 食品与机械, 2025, 41(10): 235-242.
LIANG K J, TONG L.Process optimization of Meishan Intangible cultural heritage food packaging design from the AIGC perspective[J]. Food&Machinery, 2025, 41(10): 235-242.
[7] 朱文霜, 王步乾, 钟斯黎, 等. 基于Kano-QFD的西南传统村落非遗类APP交互设计研究[J]. 包装工程, 2023, 44(S1): 320-325.
ZHU W S, WANG B Q, ZHONG S L, et al.Research on Interactive Design of Non-Legacy APP in Southwest Traditional Villages Based on Kano-QFD[J]. Packaging Engineering, 2023, 44(Sup. 1): 320-325.
[8] 汪先敏. 基于新媒体背景的傩戏APP界面交互设计研究[J]. 印刷与数字媒体技术研究, 2024, (S1): 1-6+17.
WANG X M. Research on the Interactive Design of Anhui Nuo Opera APP Interface Based on New Media Background[J]. Printing and Digital Media Technology Study, 2024, (Sup. 1): 1-6+17.
[9] 张煜, 徐喆朋. 非遗传承与创新视域下吴山庙会文化App设计与研究[J]. 装饰, 2024, (2): 136-138.
Design and Research of Wushan Temple Fair Cultural App from the Perspective of Intangible Cultural Heritage Inheritance and Innovation[J]. ZhuangShi, 2024, (2): 136-138.
[10] 李旭, 刘彦杰, 黄桂红. AIGC多模态叙事视角下的非遗数字创意产品人机共创设计研究[J]. 包装工程, 2025, 46(14): 313-327.
LI X, LIU Y J, HUANG G H.Man-machine Co-creation Design of Intangible Cultural Heritage Digital Creative Products from the Perspective of AIGC Multi-modal Narrative[J]. Packaging Engineering, 2025, 46(14): 313-327.
[11] MOLLET G A.Fundamentals of Human Neuropsychology[J]. Journal of Undergraduate Neuro science Education, 2008, 6(2): R3
[12] Dritsas E,Trigka M,Troussas C, et al.Multimodal Interaction, Interfaces, and Communication: A Survey[J]. Multimodal Technologies and Interaction, 2025, 9(1): 6-6.
[13] BOLT R A."Put-that-there": Voice and Gesture at the Graphics Interface[C]//ACM Siggraph, New York: 1980, 262-270.
[14] 黄梦君, 甄灵, 吴联凡, 等. 多模态交互视角下科普APP的用户感知偏好研究及应用[J]. 包装工程, 2025, 46(12): 484-494.
HUANG M J, ZHEN L, WU L F, et al.Research and Application of User Perception Preferences in Popular Science APPs from a Multi-modal Interaction Perspective[J]. Packaging Engineering, 2025, 46(12): 484-494.
[15] 张晓熙, 左配齐. 基于媒介化转译的仇英上林苑多模态交互设计[J]. 包装工程, 2025, 46(18): 460-469.
ZHANG X X, ZUO P Q.Multimodal Interaction Design of Qiu Ying's Shanglin Garden Based on the Theory of Mediated Translation[J]. Packaging Engineering, 2025, 46(18): 460-469.
[16] 马雪寒, 刘文良. 基于KJ-KANO模型的“一站式”水果APP设计[J]. 包装工程, 2024, 45(24): 192-203.
MA X H, LIU W L.Design of a "One-stop" Fruit APP Based on the KJ-KANO Model[J]. Packaging Engineering, 2024, 45(24): 192-203.
[17] 史明熙, 李贺, 郭绮涵, 等. 基于KJ法和A-Kano模型的健康管理系统界面情感设计研究[J]. 包装工程, 2025, 46(8): 403-413.
SHI M X, LI H, GUO Q H, et al.Emotional Interface Design of Health Management Systems Based on KJ Method and A-Kano Model[J]. Packaging Engineering, 2025, 46(8): 403-413.
[18] 岳涵, 周涛, 吴慧欣, 等. 基于Kano模型的中国非遗文创设计需求研究[J]. 包装工程, 2024, 45(2): 385-392.
YUE H, ZHOU T, WU H X, et al.Design Requirements of Cultural and Creative Products Derived from Chinese Intangible Cultural Heritage Based on the Kano Model[J]. Packaging Engineering, 2024, 45(2): 385-392.
[19] KANO N, SERAKU N, TAKAHASHI F, et al.Attractive Quality and Must-be Quality[J]. The Journal of Japanese Society for Quality Control, 1984, 14(2): 147-156.
[20] 王静思. 浅谈贵州德江傩戏文化保护问题[J]. 教育教学论坛, 2012, (S1): 201-202.
WANG J S.A Brief Discussion on the Protection of Nuo Opera Culture in Dejiang, Guizhou[J]. Education and Teaching Forum, 2012(Sup. 1): 201-202.
[21] 张安琪. 新媒体环境下德江傩文化的现状及保护研究[J]. 文物鉴定与鉴赏, 2019, (23): 86-87.
ZHANG A Q.Research on the Current Situation and Protection of Dejiang Nuo Culture under the New Media Environment[J]. Relics Identification and Appreciation, 2019(23): 86-87.
[22] 姚欢. 贵州德江傩戏推广意义与模式分析[J]. 艺术评鉴, 2024, (2): 153-158.
YAO H.Analysis of the Significance and Mode of Promoting Guizhou Dejiang Nuo Opera[J]. Artevaluation, 2024, (2): 153-158.
[23] 袁悦, 梁惠娥, 贾蕾蕾. 基于视觉叙事的傩堂戏面具文创产品设计研究[J]. 设计, 2024, 37(21): 18-21.
YUAN Y, LIANG H E, JIA L L.Research on Design of Nuo Opera Masks as Cultural and Creative Products Based on Visual Narrative[J]. Design, 2024, 37(21): 18-21.
[24] 宛志贤. 贵州古傩[M]. 贵阳: 贵州民族出版社, 2004: 22-23.
WAN Z X.Guizhou ancient Nuo[M]. Gui Yang: Guizhou Nationalities Publishing House, 2004: 22-23.
[25] 林义超, 王鹏, 郑洋. AI语音克隆技术在电影中的跨语言应用探索与研究——以GPT-SoVITS为例[J]. 现代电影技术, 2025, (6): 59-65.
LIN Y C, WANG P, ZHENG Y.Exploration and Research on Cross-Language Application of AI Voice Cloning Technology in Film: Taking GPT-SoVITS as an Example[J]. Advanced Motion Picture Technology, 2025, (6): 59-65.
[26] 陈苇婧, 杨佳熠. AI音效生成工具的技术测评与实践应用——以《开学第一课——长城的奇妙之旅》宣传片为例[C]//第33届中国数字广播电视与网络发展年会暨第28届国际广播电视技术讨论会论文集(CCNS&ISBT2025), 乌鲁木齐, 2025: 6.
CHEN W J, YANG J Y.Technical Evaluation and Practical Application of AI Sound Effect Generation Tools - Taking the Promotional Video of "The First Class - The Wonderful Journey of the Great Wall" as an Example[C]//Proceedings of the 33rd China Conference on Digital Radio and Television and Network Development and the 28th International Symposium on Broadcasting and Television Technology (CCNS&ISBT2025) , Wulumuqi, 2025: 6.
[27] 王兰英, 王娟, 吴小静. 贵州傩面具的色彩运用研究[J]. 大舞台, 2011(8): 183-184.
WANG L Y, WANG J, WU X J.Research on the Use of Colors in Guizhou Nuo Masks[J]. Great Stage, 2011(8): 183-184.