目的 探索虚拟现实技术在非遗文化传播过程中的设计与应用,为目前昆曲的数字化传播和交互研究提供新思路和实践参考。方法 首先对昆曲的构成系统和艺术风格相关知识进行梳理;其次,基于“交互叙事”和“情境认知”理论,提出用户在昆曲知识学习过程中的认知层次模型和交互叙事情境体验模型;最后,基于虚拟现实和生成式人工智能开发昆曲沉浸式体验空间,完成用户在三维虚拟科普空间中聆听昆曲经典唱段,了解服饰的文化知识,人机共创昆曲音乐的分层学习,从而实现昆曲文化知识的有效迁徙。结论 创新性地将交互叙事理论、情境学习理论进行了理论模型重构,基于虚拟现实和生成式人工智技术,对昆曲进行了更深层次的结合和探索,实现强写意风格昆曲的三维交互式呈现,为昆曲的情境化学习提供可行路径,并就虚拟现实、人工智能等数字技术如何助力昆曲等文化遗产的数字创作与传承展开了积极尝试。
Abstract
The work aims to investigate the design and implementation of the virtual reality technology in disseminating intangible cultural assets, providing innovative theoretical frameworks and practical solutions for Kunqu Opera's digital communication and interaction. Firstly, the knowledge related to Kunqu Opera's compositional systems and artistic styles was sorted out. Secondly, by integrating theories of "interactive narrative" and "situated cognition", a cognitive hierarchy model and an interactive narrative experience model were proposed for knowledge acquisition during user engagement. Finally, an immersive Kunqu learning environment was developed via virtual reality (VR) and artificial intelligence generated content (AIGC), facilitating layered learning through three-dimensional virtual experiences, including listening to classical arias, exploring cultural knowledge of costumes, and co-creating Kunqu Opera melodies, to promote effective migration of Kunqu Opera's cultural knowledge. This study innovatively reconstructs a theoretical model by integrating interactive narrative theory and situated learning theory. Leveraging virtual reality and artificial intelligence generated content, an in-depth integration and exploration is conducted to Kunqu Opera, realizing the three-dimensional interactive presentation of highly freehand-style Kunqu Opera and providing a feasible path for situated learning of Kunqu Opera. Furthermore, the study actively explores how digital technologies such as virtual reality and artificial intelligence can facilitate the digital creation and inheritance of cultural heritage including Kunqu Opera.
关键词
昆曲 /
交互叙事 /
情境学习 /
生成式人工智能（AIGC） /
虚拟现实 /
交互设计
Key words
Kunqu Opera /
interactive narrative /
situated learning /
artificial intelligence generated content (AIGC) /
virtual reality /
interaction design
{{custom_sec.title}}
{{custom_sec.title}}
{{custom_sec.content}}
参考文献
[1] 王文欣. 基于非遗夏布活态传承的VR严肃游戏设计实践研究[J]. 中国民族博览, 2024(2):60-62.
WANG W X.Practical Research on VR Serious Game Design Based on Live Transmission, a Legacy Xiabu[J]. China National Exhibition, 2024(2):60-62.
[2] 柯凡. 努力建设民族特色戏曲理论体系——中国戏曲理论国际学术研讨会综述[J]. 戏曲研究, 2010(1):413-425.
KE F.Strive to Build a Theoretical System of Traditional Chinese Opera with National Characteristics—A Summary of the International Symposium on Traditional Chinese Opera Theory in China[J]. Traditional Chinese Drama Research, 2010(1):413-425.
[3] 陶蕾伃. 现代戏曲传播形式的虚拟化以新视觉昆曲音乐会为例[J]. 中国戏剧, 2018(7):50-52.
TAO L Y.Virtualization of Modern Opera Communication Forms:A Case Study of New Vision Kunqu Opera Concert[J]. Chinese Theatre, 2018(7):50-52.
[4] 钱文君, 王淑敏. 交互体验视角下的昆曲数字化设计[J]. 明日风尚, 2024(5):131-133.
QIAN W J, WANG S M.Digital Design of Kunqu Opera from the Perspective of Interactive Experience[J]. Ming Ri Feng Shang, 2024(5):131-133.
[5] 姚菲. 浅析新编昆曲中抒情性与叙事性的差异化探索——以《春江花月夜》和《流光歌阕》为例[J]. 戏剧之家, 2018(36):37.
YAO F.A Brief Analysis of the Differentiated Exploration of Lyricism and Narration in the Newly Composed Kunqu Opera—Taking "Moonlit Night on a Spring River" and "Song of Streamers" as Examples[J]. Home Drama, 2018(36):37.
[6] 倪庆秋. 多维交互促进审美体验的昆曲教学实践研究[J]. 中国音乐教育, 2021(2):57-61.
NI Q Q.Practical Research into Multi-Dimensional Interaction Promoting Aesthetic Experience of Kunqu Opera Teaching[J]. China Music Education, 2021(2):57-61.
[7] 韩勤. 论昆曲写意性的唯美化特征[D]. 桂林:广西师范大学, 2007.
HAN Q.On the Aesthetical Characteristics of Chinese Kunqu Opera’s Free Representation[D]. Guilin:Guangxi Normal University, 2007.
[8] 任婷婷. 昆剧《林徽因》:古典意蕴阐释现代精神[J]. 戏剧文学, 2022(2):50-54.
REN T T.Lin Huiyin, a Kunqu Opera:Classical Implication and Modern Spirit[J]. Drama Literature, 2022(2):50-54.
[9] 赵司原. 中国电影的戏曲艺术特征研究[J]. 唐山师范学院学报, 2014, 36(1):77-81.
ZHAO S Y.The Features of Opera Art in Chinese Movies[J]. Journal of Tangshan Teachers College, 2014, 36(1):77-81.
[10] 李芬. 当代昆曲创作样态与传播新形态研究[J]. 戏剧文学, 2024(4):110-115.
LI F.A Study on the Creation Patterns and New Spreading Patterns of Contemporary Kunqu Opera[J]. Drama Literature, 2024(4):110-115.
[11] 许丛瑶, 徐习文. 交互叙事视域下文化遗产的数字展示设计[J]. 包装工程, 2022, 43(12):241-249.
XU C Y, XU X W.Digital Display Design of Cultural Heritage from the Perspective of Interactive Narrative[J]. Packaging Engineering, 2022, 43(12):241-249.
[12] 唐琳, 贾倩文, 李颖, 等. 博物馆教育视角下的交互叙事设计研究[J]. 家具与室内装饰, 2024, 31(10):124-131.
TANG L, JIA Q W, LI Y, et al.Research on Interactive Narrative Design from the Perspective of Museum Education[J]. Furniture & Interior Design, 2024, 31(10):124-131.
[13] 李宣, 舒安琦. 交互叙事视角下智慧博物馆沉浸式体验设计研究[J]. 包装工程, 2024, 45(6):461-470.
LI X, SHU A Q.Immersive Experience Design of Intelligent Museum from the Perspective of Interactive Narrative[J]. Packaging Engineering, 2024, 45(6):461-470.
[14] 涂先智, 王昆. 数字博物馆的角色代入类叙事设计研究[J]. 包装工程, 2023, 44(2):365-371.
TU X Z, WANG K.Narrative Design of Role Substitution in Digital Museums[J]. Packaging Engineering, 2023, 44(2):365-371.
[15] ZÖLLNER M, GEMEINHARDT J, KRAUSE M, et al. Interactive WebXR Hypertext Storytelling for Cultural Heritage[C]//Proceedings of the 7th Workshop on Human Factors in Hypertext. Poznan:ACM, 2024:1-4.
[16] BROWN J S, COLLINS A, DUGUID P.Situated Cognition and the Culture of Learning[J]. Educational Researcher, 1989, 18(1):32-42.
[17] 贾义敏, 詹春青. 情境学习:一种新的学习范式[J]. 开放教育研究, 2011, 17(5):29-39.
JIA Y M, ZHAN C Q.Situated Learning:A New Research Paradigm on Learning[J]. Open Education Research, 2011, 17(5):29-39.
[18] 赵艳. 基于案例教学的网络交互学习环境研究[D]. 长春:东北师范大学, 2007.
ZHAO Y.The Research of Web-Based Interactive Learning Environment Based on Case Teaching Methods[D]. Changchun:Northeast Normal University, 2007.
[19] 万雪兵. 情境认知理论下的写作学习情境:内涵、特征与构建策略[J]. 教育科学论坛, 2023(5):24-27.
WAN X B.Writing Learning Situation under the Theory of Situational Cognition:Connotation, Characteristics and Construction Strategies[J]. Education Science Forum, 2023(5):24-27.
[20] 刘钰林. 情境认知理念下的农业科普类游戏设计研究[D]. 南京:南京信息工程大学, 2024.
LIU Y L.Research on the Design of Agricultural Popular Science Games under the Concept of Situational Cognition[D]. Nanjing:Nanjing University of Information Science & Technology, 2024.
[21] 代幸洋, 纪毅, 蔡奕辉. 基于情境认知的广彩烧制技艺数字化传播研究[J]. 包装工程, 2022, 43(S1):242-249.
DAI X Y, JI Y, CAI Y H.Research on Digital Communication of Guangcai Burning Technology Based on Situational Cognition[J]. Packaging Engineering, 2022, 43(S1):242-249.
[22] 房慧. 基于情境认知理论的智能茶艺机体验设计研究[D]. 上海:华东理工大学, 2021.
FANG H.Research on Experience Design of Intelligent Tea Machine Based on Situational Cognition Theory[D]. Shanghai:East China University of Science and Technology, 2021.
[23] 李丹丹. 基于情境认知和初老体验的移动医疗APP的设计方法研究[D]. 上海:华东理工大学, 2023.
LI D D.Research on the Design Method of Mobile Medical APP Based on Situational Cognition and Experience of Aging[D]. Shanghai:East China University of Science and Technology, 2023.
[24] 刘勉, 张际平. 虚拟现实视域下的未来课堂教学模式研究[J]. 中国电化教育, 2018(5):30-37.
LIU M, ZHANG J P.The Research on Future Classroom Teaching Mode in the View of Virtual Reality[J]. China Educational Technology, 2018(5):30-37.
[25] BURDEA G, COIFFET P.Virtual Reality Technology[J]. Presence:Teleoperators and Virtual Environments, 2003, 12(6):663-664.
[26] 石书乐. 戏曲的社会在场性和传播困境[J]. 南方论刊, 2022(6):69-71.
SHI S L.Social Presence of Traditional Chinese Opera and Its Difficulty in Communication[J]. Nan Fang Lun Kan, 2022(6):69-71.
[27] 丁金虎. 基于情境认知的自然用户界面体验设计研究[D]. 无锡:江南大学, 2019.
DING J H.Research on Natural User Interface Experience Design Based on Situational Cognition[D]. Wuxi:Jiangnan University, 2019.
[28] ENDSLEY M R.Toward a Theory of Situation Awareness in Dynamic Systems[J]. Human Factors, 1995, 37(1):32-64.
[29] 王千. 新媒体视野下设计博物馆的叙事探讨[J]. 工业设计, 2019(7):139-140.
WANG Q.Discussion on Design Museum from the Perspective of New Media[J]. Industrial Design, 2019(7):139-140.
[30] 雷倩. 探究园林与昆曲的审美意境[J]. 中国民族博览, 2022(6):62-63.
LEI Q.Exploring the Aesthetic Artistic Conception of Gardens and Kunqu Opera[J]. China National Exhibition, 2022(6):62-63.
[31] 杨瑾. AI语境下民族民间音乐创新探析[J]. 当代音乐, 2024(8):13-15.
YANG J.On the Innovation of National Folk Music in AI Context[J]. Modern Music, 2024(8):13-15.
[32] 姚琦. 昆曲曲牌与昆笛演奏[J]. 剧影月报, 2018(2):42.
YAO Q.Kunqu Qupai and Kundi Performance[J]. Drama and Film Journal, 2018(2):42.
[33] 顾兆琳. 昆曲曲牌及套数的艺术特点和应用规律[J]. 曲学, 2015(1):21-52.
GU Z L. Artistic Characteristics and Application Rules of Kunqu Opera Cards and Sets[J]. Qu Xue2015(1):21-52.
[34] BROOKE J.SUS:A Retrospective[J]. Journal of Usability Studies Archive, 2013, 8:29-40.
[35] LEWIS J R.The System Usability Scale:Past, Present, and Future[J]. International Journal of Human-Computer Interaction, 2018, 34(7):577-590.
基金
深圳市高端人才科研启动经费（ZX20250472）
PDF(22494 KB)
渝公网安备 50010702501717号