Design of Multimodal Interaction Devices for Chu Music Culture

TONG Yanting; ZHAO Qinqin; WU Yiheng; WANG Ruonan

doi:10.19554/j.cnki.1001-3563.2025.24.021

PDF(3688 KB)

Packaging Engineering ›› 2025, Vol. 46 ›› Issue (24) : 256-268. DOI: 10.19554/j.cnki.1001-3563.2025.24.021

Industrial Design

Design of Multimodal Interaction Devices for Chu Music Culture

TONG Yanting, ZHAO Qinqin^*, WU Yiheng, WANG Ruonan

Author information +

History +

Abstract

The work aims to explore the integration of Chu music culture with multimodal interactive technology to identify effective new models for cultural dissemination and inheritance, so as to enhance user engagement and deepen the immersive experience. By constructing a framework based on the embodied cognition theory, a multimodal immersive Chu music experience system was designed and implemented, incorporating feature extraction techniques, generative models, multimodal interaction technology, and sensor control to enable real-time interactive feedback in music and dance. The results demonstrated a significant increase in user interest in Chu music culture, with 78% of users expressing a willingness to further explore its connotations. These findings validated the effectiveness and potential of multimodal interactive technology in cultural dissemination. This study not only presents an innovative approach to merging multimodal technology with traditional culture but also provides practical insights for the modernization and inheritance of Chu music culture. It emphasizes the multisensory experience in the interaction between technology and culture, offering new perspectives for research on the dissemination of intangible cultural heritage in the field of music.

Key words

Chu music culture (CMC) / multimodal interaction / embodied cognition / immersive experience (IE) / cultural transmission (CT)

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

TONG Yanting, ZHAO Qinqin, WU Yiheng, WANG Ruonan. Design of Multimodal Interaction Devices for Chu Music Culture[J]. Packaging Engineering. 2025, 46(24): 256-268 https://doi.org/10.19554/j.cnki.1001-3563.2025.24.021

References

[1] 张逸, 张梦妮. 楚文化符号在当代舞蹈作品中的呈现与分析[J]. 北京舞蹈学院学报, 2020(1): 96-102.
ZHANG Y, ZHANG M N.The Presentaion and Analysis of Cultural Symbol “Chu” in Comtemporary Dance Works[J]. Journal of Beijing Dance Academy, 2020(1): 96-102.
[2] 张玉玲. 论先秦楚舞的美学特征[J]. 北京舞蹈学院学报, 2021(5): 83-88.
ZHANG Y L.On the Aesthetic Characteristics of Chu Dance in the Pre-Qin Period[J]. Journal of Beijing Dance Academy, 2021(5): 83-88.
[3] 何新. 楚国音乐交流考[J]. 郑州大学学报(哲学社会科学版), 2011, 44(5): 137-140.
HE X.Musical Exchange in the State of Chu[J]. Journal of Zhengzhou University (Philosophy and Social Sciences Edition), 2011, 44(5): 137-140.
[4] 肖向娟. 祭祀仪式及其与音乐舞蹈的关系——以楚国祭祀为例[J]. 今古文创, 2021(25): 91-92.
XIAO X J.Sacrificial Ceremony and Its Relationship with Music and Dance—Taking the Sacrifice in Chu as an Example[J]. JinGu Creative Literature, 2021(25): 91-92.
[5] 杜鹏. 论楚舞历史文化成因及其艺术特征[J]. 北京舞蹈学院学报, 2015(1): 100-104.
DU P.The Historical Origins and the Artistic Characteristics of Chu Dance[J]. Journal of Beijing Dance Academy, 2015(1): 100-104.
[6] 孙金霞. 楚乐初探[D]. 福州: 福建师范大学, 2005.
SUN J X.A Preliminary Study of Chu Music[D]. Fuzhou: Fujian Normal University, 2005.
[7] 李倩. 从娱神到娱人从乐身到乐心——楚乐舞的艺术特征及其历史嬗变[J]. 江汉论坛, 2002(12): 49-52.
LI Q.From Entertaining God to Entertaining People, from Musical Body to Musical Heart—The Artistic Features and Historical Evolution of Chu Music and Dance[J]. Jianghan Tribune, 2002(12): 49-52.
[8] 徐冬雨. 电视文化类节目的符号呈现与意义表达——以《国家宝藏》为例[D]. 合肥: 安徽大学, 2018.
XU D Y.Symbol Presentation and Meaning Expression of TV Cultural Programs—Taking National Treasure as an Example[D]. Hefei: Anhui University, 2018.
[9] 陈叙良. 人文艺术“联姻” 数字科技: 让音乐文物“活起来” ——“听·见湖湘——湖南音乐文物与故事” 的策展实验[J]. 黄钟(武汉音乐学院学报), 2022(4): 4-15.
CHEN X L.When the Liberal Arts "Forming an Alliance with" Digital Technology, Musical Heritage "Comes Alive"[J]. Huangzhong (Journal of Wuhan Conservatory of Music), 2022(4): 4-15.
[10] 李溪喧, 张霞, 鲁巍. 数字虚拟技术在楚文化博物馆设计中的应用[J]. 武汉大学学报(工学版), 2002, 35(5): 96-99.
LI X X, ZHANG X, LU W.Application of Digital Virtual Reality Technique to Chu_culture Museum[J]. Engineering Journal of Wuhan University, 2002, 35(5): 96-99.
[11] 李佳耕, 付晓东. 中国传统打击乐器演奏虚拟现实交互系统的研究——以编钟为例[J]. 演艺科技, 2022(2): 62-69.
LI J G, FU X D.Research on the Virtual Reality Interactive System of Traditional Chinese Percussion Instruments—Take the Set of Bells as an Example[J]. Entertainment Technology, 2022(2): 62-69.
[12] 肖亦奇, 何人可. 基于意象图式编码的交互隐喻设计方法研究[J]. 包装工程, 2018, 39(16): 162-166.
XIAO Y Q, HE R K.Approach to Interactive Metaphor Design Based on Image Schema Coding[J]. Packaging Engineering, 2018, 39(16): 162-166.
[13] 叶浩生. 具身认知:认知心理学的新取向[J]. 心理科学进展, 2010, 18(5): 705-710.
YE H S.Embodied Cognition: A New Approach in Cognitive Psychology[J]. Advances in Psychological Science, 2010, 18(5): 705-710.
[14] JOHNSON M. Embodied Mind, Meaning, And Reason: How Our Bodies Give Rise To Understanding[M]. Chicago: University of Chicago Press, 2017.
[15] 汤晓颖, 蔡奕辉, 肖映河, 等. 游春图意境空间的虚拟现实具身交互设计研究[J]. 包装工程, 2023, 44(24): 297-307.
TANG X Y, CAI Y H, XIAO Y H, et al.Embodied Interaction Design of Virtual Reality in the Artistic Conception Space of Spring Outing[J]. Packaging Engineering, 2023, 44(24): 297-307.
[16] HOLSANOVA J.Olika Perspektiv Pa Språk, Bild Och Deras Samspel. Metodologiska Reflexioner[J]. 1999, (Lundastudier I Nordisk Sprakvetenskap A 44): 117-126.
[17] 吴茜. 楚宫廷宴乐舞蹈研究——以《编钟乐舞》宴乐舞蹈为例[D]. 武汉: 武汉音乐学院, 2019.
WU (Q/X). Research on Chu Court Banquet Music and Dance[D]. Wuhan: Wuhan Conservatory of Music, 2019.
[18] 李其维. “认知革命” 与“第二代认知科学” 刍议[J]. 心理学报, 2008, 40(12): 1306-1327.
LI Q W.Cognitive Revolution and Second-Generation Cognitive Science[J]. Acta Psychologica Sinica, 2008, 40(12): 1306-1327.
[19] 高宇飞. 音乐驱动的舞蹈动作生成算法研究[D]. 绵阳: 西南科技大学, 2023.
GAO Y F.Research on Music-Driven Dance Motion Generation Algorithms[D]. Mianyang: Southwest University of Science and Technology, 2023.
[20] 李博宇. 基于OpenPose的人体关键点提取及参数测量[J]. 数字技术与应用, 2023, 41(6): 13-16.
LI B Y.Human Keypoint Extraction and Parameter Measurement Based on OpenPose[J]. Digital Technology & Application, 2023, 41(6): 13-16.
[21] 宋珣, 刘一廷. 基于卷积特征提取和DTW的图像相似度评估算法[J]. 现代计算机, 2020, 26(33): 64-69.
SONG X, LIU Y T.Image Similarity Evaluation Algorithm Based on Convolution Feature Extraction and DTW[J]. Modern Computer, 2020, 26(33): 64-69.
[22] 苏波, 柴自强, 王莉. 基于改进OpenPose的视频动作评分方法研究[J]. 软件工程, 2022, 25(9): 22-26.
SU B, CHAI Z Q, WANG L.Research on Video Action Scoring Method Based on Improved OpenPose[J]. Software Engineering, 2022, 25(9): 22-26.
[23] 严毅, 王国宏, 刘胜林, 等. 基于系统可用性量表的输液泵可用性评估[J]. 中国医疗设备, 2012, 27(10): 25-27.
YAN Y, WANG G H, LIU S L, et al.Usability Evaluation of Infusion Pump Based on System Usability Scale[J]. China Medical Devices, 2012, 27(10): 25-27.
[24] 魏温远. 基于用户感知体验的在线培训系统可用性与使用意愿影响研究[D]. 杭州: 浙江大学, 2013.
WEI W Y.Research on the Impact of Usability and Usage Intention of Online Training Systems Based on User Perceived Experience[D]. Hangzhou: Zhejiang University, 2013.