Dynamic Narrative Design of Cultural Relics Based on Generative AI and Multimodal Interaction

ZHANG Li; WANG Yilin; LIU Ying

doi:10.19554/j.cnki.1001-3563.2025.24.018

PDF(19499 KB)

Packaging Engineering ›› 2025, Vol. 46 ›› Issue (24) : 220-233. DOI: 10.19554/j.cnki.1001-3563.2025.24.018

Industrial Design

Dynamic Narrative Design of Cultural Relics Based on Generative AI and Multimodal Interaction

ZHANG Li^*, WANG Yilin, LIU Ying

Author information +

History +

Abstract

With the rapid development of the culture, museum, and tourism industry and the upgrading of digital technology, the contradiction between the audience's demand for immersive cultural experiences and the single visual presentation of museum artifacts has become increasingly prominent. The work aims to adopt generative AI and multimodal interaction technology as methods to explore how to innovate in the visual experience of museum artifacts through narrative design paths, making artifacts "sensory" and "alive" to enhance the immersive experience and emotional resonance of the audience. Firstly, starting with the narrative context, material structure, and symbolic characteristics of the images of cultural relics in established museum collections, the generative AI technology was combined to extract and summarize visual elements to obtain iconic elements from representative cultural relics. Next, the abstract images were translated with dynamic narrative techniques, and the core content was presented through multimodal interaction technology to reshape the visual presentation of cultural relics. As a result of the above research steps, the practical application project of "Light and Shadow Chang'an - Lantern Interaction Design" was completed as a design case for method validation. Generative AI technology has reshaped the visual expression of cultural relics, multimodal interaction technology has strengthened the intrinsic connections between cultural relics, and dynamic narrative design methods have innovated in the display methods of museums.

Key words

generative artificial intelligence (AI) / multimodal interaction / artifact / dynamic narrative

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

ZHANG Li, WANG Yilin, LIU Ying. Dynamic Narrative Design of Cultural Relics Based on Generative AI and Multimodal Interaction[J]. Packaging Engineering. 2025, 46(24): 220-233 https://doi.org/10.19554/j.cnki.1001-3563.2025.24.018

References

[1] 中华人民共和国全国人民代表大会常务委员会. 中华人民共和国文物保护法(2024年修订)[Z]. 北京:全国人大常委会公报, 2024-11-08.
Standing Committee of the National People's Congress of the People's Republic of China. Cultural Relic Protection Law of the People's Republic of China (Revised2024)[Z]. Beijing: Gazette of the Standing Committee of the National People's Congress, 2024-11-08.
[2] 何晓芳, 张立夫. 中华民族共享符号研究: “龙”传承的历史叙事——中国历史上北族政权对“龙”的传承[J]. 民族论坛, 2025(1): 86-97.
HE X F, ZHANG L F.Research on Shared Symbols of the Chinese Nation: Historical Narrative of the Inheritance of "Dragon"-The Inheritance of "Dragon" by Northern Ethnic Governments in Chinese History[J]. Ethnic Forum, 2025(1): 86-97.
[3] 潘祥辉, 杜颖卉. 飞龙在身:华夏龙纹与服饰媒介的结合演进史——一项基于“龙袍”的传播考古学研究[J]. 东岳论丛, 2025, 46(6): 147-155.
PAN X H, DU Y H.Flying Dragon in the Body: The Evolutionary History of the Combination of Chinese Dragon Patterns and Clothing Media-A Study of Transmission Archaeology Based on "Dragon Robes"[J]. Dongyue Lun Cong, 2025, 46(6): 147-155.
[4] 康予虎, 李嘉鑫, 李刚, 等. 湖北武当山五龙宫遗址出土明代投龙简研究[J]. 考古与文物, 2025(5): 109-116.
KANG Y H, LI J X, LI G, et al.Research on the Ming Dynasty Dragon Slips Excavated from the Wulong Palace Site in Wudang Mountain, Hubei Province[J]. Archaeology and Cultural Relics, 2025(5): 109-116.
[5] 王娜. 汉风的理想空间——汉画像石空间布局的美学意味[J]. 艺术百家, 2017, 33(1): 205-208.
WANG N.The Ideal Space of Han Style-The Aesthetic Meaning of Han Painting Stone Space Layout[J]. Art Bai Jia, 2017, 33(1): 205-208.
[6] 中华人民共和国文化和旅游部. 文物藏品定级标准[EB/OL]. (2001-04-09)[2025-12-10]. https://zwgk.mct.gov.cn/zfxxgkml/zcfg/bmgz/202012/t20201204_905269.html.
Ministry of Culture and Tourism of the People's Republic of China. Standards for Grading Cultural Relic Collections[EB/OL]. (2001-04-09)[2025-12-10]. https://zwgk.mct.gov.cn/zfxxgkml/zcfg/bmgz/202012/t20201204_905269.html.
[7] 霍巍. 从中国西南青铜时代看中华文明的发展轨迹[J]. 社会科学, 2024(10): 64-74.
HUO W.The Development Trajectory of Chinese Civilization from the Bronze Age in Southwest China[J]. Social Sciences, 2024(10): 64-74.
[8] 刘延久,刘梦.“与天久长——周秦汉唐文化与艺术特展”精品文物赏鉴[J]. 艺术品鉴, 2019(28): 26-31.
LI Y J, LIU M.Appreciation of Fine Cultural Relics in the Exhibition of Zhou, Qin, Han, and Tang Culture and Art under the theme of "Longing with the Sky"[J]. Art Review, 2019(28): 26-31.
[9] 卢煊. 东方纹样艺术在品牌设计中的应用研究[D]. 无锡: 江南大学, 2023.
LU X.Research on the Application of Oriental Pattern Art in Brand Design[D]. Wuxi: Jiangnan University, 2023.
[10] 田自秉, 吴淑生, 田青. 中国纹样史[M]. 北京: 高等教育出版社, 2003.
TIAN Z B, WU S S, TIAN Q.History of Chinese Patterns[M]. Beijing: Higher Education Press, 2003.
[11] 郭晓芳, 张晓娟. 科尔沁蒙古族刺绣艺术显性与隐性文化基因特征分析[J]. 丝绸, 2025, 62(4): 88-96.
GUO X F, ZHANG X J.Analysis of the Characteristics of Explicit and Implicit Cultural Genes in Horqin Mongolian Embroidery Art[J]. Silk, 2025, 62(4): 88-96.
[12] 朱诣, 李光蕾. 清代陶瓷寿桃纹样的装饰解析[J]. 中国陶瓷, 2025, 61(3): 100-111.
ZHU Y, LI G L.Decorative Analysis of Longevity Peach Patterns on Qing Dynasty Ceramics[J]. Chinese Ceramics, 2025, 61(3): 100-111.
[13] YAN H, ZHANG H, LIU L, et al.Toward Intelligent Design: An AI-based Fashion Designer Using Generative Adversarial Networks Aided by Sketch and Rendering Generators[J]. IEEE Transactions on Multimedia, 2022(25): 2323-2338.
[14] 刘宗明, 陈旭辉, 梁熙楠. 基于Style-GAN瑶族景观导识系统设计研究[J]. 包装工程,2024, 45(14): 36-50.
LIU Z M, CHEN X H, LIANG X A.Research on the Design of Style GAN Yao Landscape Identification System[J]. Packaging Engineering, 2024, 45(14): 36-50.
[15] MEIRA N F C, SILVA M C, BIANCHI A G C, et al. Generating Synthetic Faces for Data Augmentation with StyleGAN2-ADA[C]//FILIPE J, ŚMIAŁEK M, BRODSKY A, et al. Enterprise Information Systems: 25th International Conference, ICEIS 2023, Revised Selected Papers, Part I[C]. Cham: Springer International Publishing AG, 2024: 649-655.
[16] 尉艺, 陈美桦, 孟虎. 莫高窟唐代壁画服饰色彩的演变特征与审美感知[J]. 丝绸, 2022, 59(9): 137-144.
WEI Y, CHEN M H, MENG H.The Evolution Characteristics and Aesthetic Perception of Clothing Colors in Tang Dynasty Murals in Mogao Grottoes[J]. Silk, 2022, 59(9): 137-144.
[17] 许丽鹏, 吴健, 俞天秀, 等. 莫高窟第172窟北壁建筑图像的三维数字化呈现[J]. 文物保护与考古科学, 2022, 34(1): 79-86.
XU L P, WU J, YU T X, et al.Three Dimensional Digital Presentation of Architectural Images on the North Wall of Cave 172 of Mogao Grottoes[J]. Cultural Relics Protection and Archaeological Science, 2022, 34(1): 79-86.
[18] 杜星星. 唐代敦煌壁画色彩的观念体现、视觉呈现与情感表达[J]. 敦煌学辑刊, 2021(1): 115-128.
DU X X. Conceptual Embodiment, Visual Presentation and Emotional Expression of Color in Tang Dynasty Dunhuang Murals[J]. Dunhuang Studies, 2021(1): 115-128.
[19] SCHAERF L, ALFARANO A, POSTMA E.ColorwAI: Generative Colorways of Textiles through GAN and Diffusion Disentanglement[C]//European Conference on Csomputer Vision. Cham: Springer, 2025: 137-160.
[20] 傅雷, 王南轶, 朱凯凯, 等. 形状文法视角下的明式杌凳创新设计研究[J]. 机械设计, 2022, 39(增刊2): 227-234.
FU L, WANG N Y, ZHU K K, et al.Research on Innovative Design of Ming style Stools from the Perspective of Shape Grammar[J]. Mechanical Design, 2022, 39(Sup.2): 227-234.
[21] 刘彦超, 刘键, 席上琳, 等. 基于Neo4j的中轴线艺术价值数字化知识图谱研究[J]. 包装工程, 2024, 45(8): 211-223.
LIU Y C, LIU J, XI S L, et al.Research on the Digital Knowledge Graph of Central Axis Art Value Based on Neo4j[J]. Packaging Engineering, 2024, 45(8): 211-223.
[22] 李旭, 刘彦杰, 黄桂红. AIGC多模态叙事视角下的非遗数字创意产品人机共创设计研究[J]. 包装工程, 2025, 46(14): 313-327.
LI X, LIU Y J, HUANG G H.Research on Human Computer Co Creation Design of Intangible Cultural Heritage Digital Creative Products from the Perspective of AIGC Multimodal Narrative[J]. Packaging Engineering, 2025, 46(14): 313-327.
[23] 邵知宇. 基于感知机制的力触觉再现真实感客观评估方法研究[D]. 南京: 东南大学, 2021.
SHAO Z Y.Research on Objective Evaluation Method of Force tactile Reproduction Realism Based on Perception Mechanism[D]. Nanjing: Southeast University, 2021.
[24] CHEN L, CAO C, DE LA TORRE F, et al. High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, WA, USA: IEEE Computer Society, 2021: 13059-13069.
[25] DE PAOLIS L T, GATTO C, CORCHIA L, et al. Usability, User Experience and Mental Workload in a Mobile Augmented Reality Application for Digital Storytelling in Cultural Heritage[J]. Virtual Reality, 2023, 27(2): 1117-1143.
[26] LI Y, YANG R, ZOU J, et al.Human-centric Virtual Museum: Redefining the Museum Experience through Immersive and Interactive Environments[J]. International Journal of Human-Computer Interaction, 2025, 41(13): 8426-8437.