Data Visualization Design Framework Based on Multimodal Discourse Analysis

ZHOU Yating; ZHANG Rong; WU Fangbo; CHEN Xu; MOU Hui

doi:10.19554/j.cnki.1001-3563.2025.18.007

PDF(3321 KB)

Packaging Engineering ›› 2025, Vol. 46 ›› Issue (18) : 75-83. DOI: 10.19554/j.cnki.1001-3563.2025.18.007

Industrial Design

Data Visualization Design Framework Based on Multimodal Discourse Analysis

ZHOU Yating^1a, ZHANG Rong^1a, MOU Hui^1b,*

Author information +

History +

Abstract

The work aims to propose a data visualization design framework to reduce semantic distance. The five levels based on the multimodal discourse analysis theory corresponded to the semantic distance characteristics of data visualization design-humanistic, user, task, design, and data factors. A design framework including five layers of culture, context, meaning, form, and expression was proposed. Through case studies, this framework has been proven effective in reducing semantic distance and enhancing the efficacy of various data visualization projects.

Key words

data visualization / semantic distance / multimodal discourse analysis / design framework

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

ZHOU Yating, ZHANG Rong, MOU Hui. Data Visualization Design Framework Based on Multimodal Discourse Analysis[J]. Packaging Engineering. 2025, 46(18): 75-83 https://doi.org/10.19554/j.cnki.1001-3563.2025.18.007

References

[1] 吕月米, 周雨. 基于多模态理论的大数据可视化的优化与拓展[J]. 包装工程, 2019, 40(24): 251-259.
LYU Y M, ZHOU Y.Optimization and Expansion of Big Data Visualization Based on Multimodal Theory[J]. Packaging Engineering, 2019, 40(24): 251-259.
[2] 蒙克, 路畅. 死亡地图与贫困地图: 早期工业化伦敦的数据可视化[J]. 装饰, 2021(4): 32-36.
MENG K, LU C.A Tale of Two Maps: Data Visualization in Early Industrial Britain[J]. Zhuangshi, 2021(4): 32-36.
[3] TUFTE E R, GRAVES-MORRIS P R. The Visual Display of Quantitative Information[M]. Cheshire: Graphics Press, 1983: 1-5.
[4] CARD S K, MACKINLAY J, SHNEIDERMAN B.Readings in Information Visualization: Using Vision to Think[M]. Burlington: Academic Press, 1999.
[5] SHNEIDERMAN B.The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations[C]//Proceedings 1996 IEEE Symposium on Visual Languages. Burlington: IEEE, 1996.
[6] 陆菁, 刘渊, 张晓婷, 等. 基于用户体验的数据可视化模型研究[J]. 包装工程, 2016, 37(2): 52-56.
LU J, LIU Y, ZHANG X T, et al.Data Visualization Model Based on the User Experience[J]. Packaging Engineering, 2016, 37(2): 52-56.
[7] MUNZNER T.A Nested Model for Visualization Design and Validation[J]. IEEE Transactions on Visualization and Computer Graphics, 2009, 15(6): 921-928.
[8] MCKENNA S, MAZUR D, AGUTTER J, et al.Design Activity Framework for Visualization Design[J]. IEEE Transactions on Visualization and Computer Graphics, 2014, 20(12): 2191-2200.
[9] HUANG W D, LUO J, BEDNARZ T, et al.Making Graph Visualization a User-Centered Process[J]. Journal of Visual Languages & Computing, 2018, 48: 1-8.
[10] MEYER M, SEDLMAIR M, QUINAN P S, et al.The Nested Blocks and Guidelines Model[J]. Information Visualization, 2015, 14(3): 234-249.
[11] PRETORIUS A J, VAN WIJK J J. What Does the User Want to See? : What Do the Data Want to Be?[J]. Information Visualization, 2009, 8(3): 153-166.
[12] BORKIN M A, VO A A, BYLINSKII Z, et al.What Makes a Visualization Memorable?[J]. IEEE Transactions on Visualization and Computer Graphics, 2013, 19(12): 2306-2315.
[13] LAN X Y, WU Y Q, CAO N.Affective Visualization Design: Leveraging the Emotional Impact of Data[J]. IEEE Transactions on Visualization and Computer Graphics, 2024, 30(1): 1-11.
[14] KOSTELNICK C.The Re-Emergence of Emotional Appeals in Interactive Data Visualization[J]. Technical Communication, 2016, 63(2): 116-135.
[15] 贾倩文, 柴春雷, 蔡蕊屹. 数据可视化中的设计美学研究综述[J]. 包装工程, 2022, 43(20): 13-25.
JIA Q W, CHAI C L, CAI R Y.Design Aesthetics Studies in Data Visualization[J]. Packaging Engineering, 2022, 43(20): 13-25.
[16] 孙海旻. 从Data到Capta——信息可视化设计的人文性技术美学策略探究[J]. 美术大观, 2021(3): 128-131.
SUN H M.From Data to Capta—Research on the Humanistic Technical Aesthetic Strategy of Information Visualization Design[J]. Art Panorama, 2021(3): 128-131.
[17] DRUCKER J.Humanities Approaches to Graphical Display[J]. Digital Humanities Quarterly, 2011, 5(1): 1-21.
[18] FRIEDMAN B, KAHN P H Jr, BORNING A, et al. Value Sensitive Design and Information Systems[M]//Early Engagement and New Technologies: Opening up the Laboratory. Dordrecht: Springer Netherlands, 2013: 55-95.
[19] LAMQADDAM H, VANDE MOERE A, VANDEN ABEELE V, et al.Introducing Layers of Meaning (LoM): A Framework to Reduce Semantic Distance of Visualization in Humanistic Research[J]. IEEE Transactions on Visualization and Computer Graphics, 2021, 27(2): 1084-1094.
[20] 罗保权, 邢亚龙. 多模态理论在数据可视化交互装置设计中的应用研究[J]. 设计, 2022, 35(1): 48-51.
LUO B Q, XING Y L.Application of Multimodal Theory in Data Visualization Art Installation[J]. Design, 2022, 35(1): 48-51.
[21] 杨帆, 温晓婷. 多模态话语分析理论在产品设计中应用的可行性研究[J]. 设计, 2019, 32(10): 99-101.
YANG F, WEN X T.Feasibility Study of Multimodal Discourse Analysis in Product Design[J]. Design, 2019, 32(10): 99-101.
[22] 朱永生. 多模态话语分析的理论基础与研究方法[J]. 外语学刊, 2007(5): 82-86.
ZHU Y S.Theory and Methodology of Multimodal Discourse Analysis[J]. Foreign Language Research, 2007(5): 82-86.
[23] 胡壮麟. 社会符号学研究中的多模态化[J]. 语言教学与研究, 2007(1): 1-10.
HU Z L.Multimodalization in Social Semiotics[J]. Language Teaching and Linguistic Studies, 2007(1): 1-10.
[24] BUDANITSKY A, HIRST G.Semantic Distance in WordNet: An Experimental, Application-Oriented Evaluation of Five Measures[J]. Workshop on WordNet and Other Lexical Resources. 2001, 2: 2.
[25] KRESS G, LEEUWEN T VAN.Reading Images: The Grammar of Visual Design[M]. Abingdon: Routledge, 2020: 10-20.
[26] 田海龙, 潘艳艳. 从意义到意图——多模态话语分析到多模态批评话语分析的新发展[J]. 山东外语教学, 2018, 39(1): 23-33.
TIAN H L, PAN Y Y.From Meaning to Intention: New Development of Multimodal Discourse Analysis to Multimodal Critical Discourse Analysis[J]. Shandong Foreign Language Teaching, 2018, 39(1): 23-33.
[27] 李战子, 陆丹云. 多模态符号学: 理论基础, 研究途径与发展前景[J]. 外语研究, 2012, 29(2): 1-8.
LI Z Z, LU D Y.Multimodal Semiotics: Theoretical Basis, Research Approach and Development Prospect[J]. Foreign Languages Research, 2012, 29(2): 1-8.
[28] 张德禄. 多模态话语分析综合理论框架探索[J]. 中国外语, 2009, 6(1): 24-30.
ZHANG D L.On a Synthetic Theoretical Framework for Multimodal Discourse Analysis[J]. Foreign Languages in China, 2009, 6(1): 24-30.
[29] KRIPPENDORFF K.The Semantic Turn: A New Foundation for Design[M]. Cleveland: CRC Press, 2005: 18-19.