基于多模态话语分析的数据可视化设计框架研究

周雅婷; 张融; 吴方波; 陈旭; 牟晖

doi:10.19554/j.cnki.1001-3563.2025.18.007

PDF(3321 KB)

包装工程（设计栏目） ›› 2025, Vol. 46 ›› Issue (18) : 75-83. DOI: 10.19554/j.cnki.1001-3563.2025.18.007

工业设计

基于多模态话语分析的数据可视化设计框架研究

周雅婷^1a, 张融^1a, 牟晖^1b,*

作者信息 +

Data Visualization Design Framework Based on Multimodal Discourse Analysis

ZHOU Yating^1a, ZHANG Rong^1a, MOU Hui^1b,*

Author information +

文章历史 +

摘要

目的提出一个数据可视化设计框架,减少数据可视化的语义距离。方法基于多模态话语分析理论的5个层次,与数据可视化设计的语义距离特性——人文、用户、任务、设计和数据因素相对应,提出包含文化层、语境层、意义层、形式层和表达层的设计框架。结果及结论 通过案例分析,验证了该框架在多种数据可视化项目中能有效验证减少语义距离,提高可视化的有效性。

Abstract

The work aims to propose a data visualization design framework to reduce semantic distance. The five levels based on the multimodal discourse analysis theory corresponded to the semantic distance characteristics of data visualization design-humanistic, user, task, design, and data factors. A design framework including five layers of culture, context, meaning, form, and expression was proposed. Through case studies, this framework has been proven effective in reducing semantic distance and enhancing the efficacy of various data visualization projects.

导出引用1

周雅婷, 张融, 牟晖. 基于多模态话语分析的数据可视化设计框架研究[J]. 包装工程. 2025, 46(18): 75-83 https://doi.org/10.19554/j.cnki.1001-3563.2025.18.007

ZHOU Yating, ZHANG Rong, MOU Hui. Data Visualization Design Framework Based on Multimodal Discourse Analysis[J]. Packaging Engineering. 2025, 46(18): 75-83 https://doi.org/10.19554/j.cnki.1001-3563.2025.18.007

中图分类号： TB472

参考文献

[1] 吕月米, 周雨. 基于多模态理论的大数据可视化的优化与拓展[J]. 包装工程, 2019, 40(24): 251-259.
LYU Y M, ZHOU Y.Optimization and Expansion of Big Data Visualization Based on Multimodal Theory[J]. Packaging Engineering, 2019, 40(24): 251-259.
[2] 蒙克, 路畅. 死亡地图与贫困地图: 早期工业化伦敦的数据可视化[J]. 装饰, 2021(4): 32-36.
MENG K, LU C.A Tale of Two Maps: Data Visualization in Early Industrial Britain[J]. Zhuangshi, 2021(4): 32-36.
[3] TUFTE E R, GRAVES-MORRIS P R. The Visual Display of Quantitative Information[M]. Cheshire: Graphics Press, 1983: 1-5.
[4] CARD S K, MACKINLAY J, SHNEIDERMAN B.Readings in Information Visualization: Using Vision to Think[M]. Burlington: Academic Press, 1999.
[5] SHNEIDERMAN B.The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations[C]//Proceedings 1996 IEEE Symposium on Visual Languages. Burlington: IEEE, 1996.
[6] 陆菁, 刘渊, 张晓婷, 等. 基于用户体验的数据可视化模型研究[J]. 包装工程, 2016, 37(2): 52-56.
LU J, LIU Y, ZHANG X T, et al.Data Visualization Model Based on the User Experience[J]. Packaging Engineering, 2016, 37(2): 52-56.
[7] MUNZNER T.A Nested Model for Visualization Design and Validation[J]. IEEE Transactions on Visualization and Computer Graphics, 2009, 15(6): 921-928.
[8] MCKENNA S, MAZUR D, AGUTTER J, et al.Design Activity Framework for Visualization Design[J]. IEEE Transactions on Visualization and Computer Graphics, 2014, 20(12): 2191-2200.
[9] HUANG W D, LUO J, BEDNARZ T, et al.Making Graph Visualization a User-Centered Process[J]. Journal of Visual Languages & Computing, 2018, 48: 1-8.
[10] MEYER M, SEDLMAIR M, QUINAN P S, et al.The Nested Blocks and Guidelines Model[J]. Information Visualization, 2015, 14(3): 234-249.
[11] PRETORIUS A J, VAN WIJK J J. What Does the User Want to See? : What Do the Data Want to Be?[J]. Information Visualization, 2009, 8(3): 153-166.
[12] BORKIN M A, VO A A, BYLINSKII Z, et al.What Makes a Visualization Memorable?[J]. IEEE Transactions on Visualization and Computer Graphics, 2013, 19(12): 2306-2315.
[13] LAN X Y, WU Y Q, CAO N.Affective Visualization Design: Leveraging the Emotional Impact of Data[J]. IEEE Transactions on Visualization and Computer Graphics, 2024, 30(1): 1-11.
[14] KOSTELNICK C.The Re-Emergence of Emotional Appeals in Interactive Data Visualization[J]. Technical Communication, 2016, 63(2): 116-135.
[15] 贾倩文, 柴春雷, 蔡蕊屹. 数据可视化中的设计美学研究综述[J]. 包装工程, 2022, 43(20): 13-25.
JIA Q W, CHAI C L, CAI R Y.Design Aesthetics Studies in Data Visualization[J]. Packaging Engineering, 2022, 43(20): 13-25.
[16] 孙海旻. 从Data到Capta——信息可视化设计的人文性技术美学策略探究[J]. 美术大观, 2021(3): 128-131.
SUN H M.From Data to Capta—Research on the Humanistic Technical Aesthetic Strategy of Information Visualization Design[J]. Art Panorama, 2021(3): 128-131.
[17] DRUCKER J.Humanities Approaches to Graphical Display[J]. Digital Humanities Quarterly, 2011, 5(1): 1-21.
[18] FRIEDMAN B, KAHN P H Jr, BORNING A, et al. Value Sensitive Design and Information Systems[M]//Early Engagement and New Technologies: Opening up the Laboratory. Dordrecht: Springer Netherlands, 2013: 55-95.
[19] LAMQADDAM H, VANDE MOERE A, VANDEN ABEELE V, et al.Introducing Layers of Meaning (LoM): A Framework to Reduce Semantic Distance of Visualization in Humanistic Research[J]. IEEE Transactions on Visualization and Computer Graphics, 2021, 27(2): 1084-1094.
[20] 罗保权, 邢亚龙. 多模态理论在数据可视化交互装置设计中的应用研究[J]. 设计, 2022, 35(1): 48-51.
LUO B Q, XING Y L.Application of Multimodal Theory in Data Visualization Art Installation[J]. Design, 2022, 35(1): 48-51.
[21] 杨帆, 温晓婷. 多模态话语分析理论在产品设计中应用的可行性研究[J]. 设计, 2019, 32(10): 99-101.
YANG F, WEN X T.Feasibility Study of Multimodal Discourse Analysis in Product Design[J]. Design, 2019, 32(10): 99-101.
[22] 朱永生. 多模态话语分析的理论基础与研究方法[J]. 外语学刊, 2007(5): 82-86.
ZHU Y S.Theory and Methodology of Multimodal Discourse Analysis[J]. Foreign Language Research, 2007(5): 82-86.
[23] 胡壮麟. 社会符号学研究中的多模态化[J]. 语言教学与研究, 2007(1): 1-10.
HU Z L.Multimodalization in Social Semiotics[J]. Language Teaching and Linguistic Studies, 2007(1): 1-10.
[24] BUDANITSKY A, HIRST G.Semantic Distance in WordNet: An Experimental, Application-Oriented Evaluation of Five Measures[J]. Workshop on WordNet and Other Lexical Resources. 2001, 2: 2.
[25] KRESS G, LEEUWEN T VAN.Reading Images: The Grammar of Visual Design[M]. Abingdon: Routledge, 2020: 10-20.
[26] 田海龙, 潘艳艳. 从意义到意图——多模态话语分析到多模态批评话语分析的新发展[J]. 山东外语教学, 2018, 39(1): 23-33.
TIAN H L, PAN Y Y.From Meaning to Intention: New Development of Multimodal Discourse Analysis to Multimodal Critical Discourse Analysis[J]. Shandong Foreign Language Teaching, 2018, 39(1): 23-33.
[27] 李战子, 陆丹云. 多模态符号学: 理论基础, 研究途径与发展前景[J]. 外语研究, 2012, 29(2): 1-8.
LI Z Z, LU D Y.Multimodal Semiotics: Theoretical Basis, Research Approach and Development Prospect[J]. Foreign Languages Research, 2012, 29(2): 1-8.
[28] 张德禄. 多模态话语分析综合理论框架探索[J]. 中国外语, 2009, 6(1): 24-30.
ZHANG D L.On a Synthetic Theoretical Framework for Multimodal Discourse Analysis[J]. Foreign Languages in China, 2009, 6(1): 24-30.
[29] KRIPPENDORFF K.The Semantic Turn: A New Foundation for Design[M]. Cleveland: CRC Press, 2005: 18-19.