Research and Application of User Perception Preferences in Popular  Science APPs from a Multi-modal Interaction Perspective

HUANG Mengjun; ZHEN Ling; WU Lianfan; WU Yao; ZHANG Yang

doi:10.19554/j.cnki.1001-3563.2025.12.048

PDF(1664 KB)

Packaging Engineering ›› 2025, Vol. 46 ›› Issue (12) : 484-494. DOI: 10.19554/j.cnki.1001-3563.2025.12.048

Research and Application of User Perception Preferences in Popular Science APPs from a Multi-modal Interaction Perspective

HUANG Mengjun¹, ZHEN Ling², WU Lianfan¹, WU Yao³, ZHANG Yang^2*

Author information +

History +

Abstract

The work aims to delve into the elements and design strategies that influence user perception preferences in science popularization (sci-pop) APPs from the perspective of multi-modal interaction, to enhance user experience and the effectiveness of science popularization. Initially, 10 factors and their levels influencing multi-modal perception preferences in sci-pop APPs were comprehensively identified through focus group interviews. Subsequently, an orthogonal experiment was conducted to construct 27 interface combination schemes. User evaluations were then used to quantify the importance and utility values of these multi-modal elements, ultimately proposing multi-modal design strategies and interface solutions for sci-pop APPs. Visual and tactile modalities significantly impacted perception preferences in sci-pop APPs, with interface color tone, visual dynamics, and feedback degree being key elements. Based on these findings, the interface design for the sci-pop APP "T'ien-kung k'ai-wu" was developed, validating the proposed strategies' effectiveness. The study reveals the combination of multi-modal perception preference elements and design strategies for sci-pop APPs, providing a theoretical basis and practical guidance for optimizing sci-pop APP design. This will also promote public scientific literacy and the digital development of science popularization.

Key words

multi-modal / user perception preferences / joint analysis / interface design / orthogonal experiment / science popularization dissemination / T'ien-kung K'ai-wu APP

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

HUANG Mengjun, ZHEN Ling, WU Lianfan, WU Yao, ZHANG Yang. Research and Application of User Perception Preferences in Popular Science APPs from a Multi-modal Interaction Perspective[J]. Packaging Engineering. 2025, 46(12): 484-494 https://doi.org/10.19554/j.cnki.1001-3563.2025.12.048

References

[1] 郑念. 科普如何为中国式现代化固基赋能[J]. 人民论坛·学术前沿, 2023(3): 93-99.
ZHENG N.How Science Popularization Empowers the Foundation of Chinese Modernization[J]. Frontiers, 2023(3): 93-99.
[2] OAKLEY B.From Laboratory to Laptop: How Science Communication Can Bridge the Gap between Plant Pathology and the Public[J]. Physiological and Molecular Plant Pathology, 2023, 125: 102032.
[3] 韩玉婷, 陈琪雯. 云端气象科普App展示设计研究[J]. 美术教育研究, 2021(11): 108-109.
HAN Y T, CHEN Q W.Research on Display Design of Cloud Meteorological Popular Science App[J]. Art Education Research, 2021(11): 108-109.
[4] 傅婕, 赵江洪, 谭浩. 基于潜意识和行为习惯的交互设计启示性[J]. 包装工程, 2013, 34(2): 50-52.
FU J, ZHAO J H, TAN H.Affordance in Interaction Design Based on Unconscious and Behavior[J]. Packaging Engineering, 2013, 34(2): 50-52.
[5] 陶海峰, 袁乐曦. 基于多维视角的出版物设计研究[J]. 编辑学刊, 2024(2): 89-95.
TAO H F, YUAN L X.Research on Publication Design Based on Multidimensional Perspective[J]. Journal of Editorial Science, 2024(2): 89-95.
[6] 马方楠, 方睿. 扩展现实科普童书的互动数字叙事策略[J]. 出版科学, 2023, 31(6): 18-25.
MA F N, FANG R.Interactive Digital Narrative Strategies for Extended Reality Science Popularization Popularization Children's Books[J]. Publishing Journal, 2023, 31(6): 18-25.
[7] TANG X.Application and Design of Drama Popular Science Education Using Augmented Reality[J]. Scientific Programming, 2022, 2022(1): 2097909.
[8] 李洺葭, 韩静华. 传统科普读物数字化衍生产品开发的探索与思考——以植物类科普读物为例[J]. 科技与出版, 2015(12): 107-112.
LI M J, HAN J H.Exploration and Thinking on the Development of Digital Derivative Products of Traditional Popular Science Books—Taking Plant Popular Science Books as an Example[J]. Science-Technology & Publication, 2015(12): 107-112.
[9] 许遥峰, 王峰. 美术科普App信息表达设计研究[J]. 艺术科技, 2016, 29(12): 80.
XU Y F, WANG F.Research on Information Expression Design of Art Popular Science App[J]. Art Science and Technology, 2016, 29(12): 80.
[10] 邵琪雪, 丁肇辰. 睡眠科普类育儿小程序设计研究[J]. 设计, 2022, 35(10): 114-117.
SHAO Q X, DING Z C.Research on the Design of Sleep Science Popular Parenting Mini Program[J]. Design, 2022, 35(10): 114-117.
[11] 朱文霜, 王步乾, 钟斯黎, 等. 基于Kano-QFD的西南传统村落非遗类APP交互设计研究[J]. 包装工程, 2023, 44(S1): 320-325.
ZHU W S, WANG B Q, ZHONG S L, et al.Research on Interactive Design of Non-Legacy APP in Southwest Traditional Villages Based on Kano-QFD[J]. Packaging Engineering, 2023, 44(S1): 320-325.
[12] LEE J S, LEE M A.Validation and Usability Study of the Framework for a User Needs-Centered mHealth App Selection[J]. International Journal of Medical Informatics, 2022, 167: 104877.
[13] 杨玥, 纪力文. 儿童科普严肃游戏的交互体验研究——蛇岛老铁山自然保护区鸟类图鉴App设计实践[J]. 装饰, 2022(10): 133-135.
YANG Y, JI L W.Research on Interactive Experience of Children's Science Popularization Serious Games: Design Practice of Bird Atlas App in Shedao Laotieshan Nature Reserve[J]. Art & Design, 2022(10): 133-135.
[14] 于浩淼. 学龄前儿童物理科普游戏APP设计研究与实践[J]. 设计, 2023, 36(11): 58-62.
YU H M.Practice and Research on App Design of Physics Popular Science Game for Preschool Children[J]. Design, 2023, 36(11): 58-62.
[15] MOLLET G A.Fundamentals of Human Neuropsychology[J]. Journal of Undergraduate Neuroscience Education, 2008, 6(2): R3
[16] 牟智佳. 多模态学习分析: 学习分析研究新生长点[J]. 电化教育研究, 2020, 41(5): 27-32.
MOU Z J.Multimodal Learning Analytics: New Growth Points of Learning Analytics Studies[J]. e-Education research, 2020, 41(5): 27-32.
[17] 吴联凡, 吴耀, 卓芊吟, 等. 学前玩具中五感体验的建构策略与实践研究[J]. 包装工程, 2021, 42(4): 159-165.
WU L F, WU Y, ZHUO Q Y, et al.Practical Study and Strategy of Applying Five-Sense Experience in Preschool Children's Toys[J]. Packaging Engineering, 2021, 42(4): 159-165.
[18] FLAVIÁN C, IBÁÑEZ-SÁNCHEZ S, ORÚS C. The Impact of Virtual, Augmented and Mixed Reality Technologies on the Customer Experience[J]. Journal of Business Research, 2019, 100: 547-560.
[19] STEUER J.Defining Virtual Reality: Dimensions Determining Telepresence[J]. Journal of Communication, 1992, 42(4): 73-93.
[20] ZHANG M, HOU G, CHEN Y C.Effects of Interface Layout Design on Mobile Learning Efficiency: A Comparison of Interface Layouts for Mobile Learning Platform[J]. Library Hi Tech, 2023, 41(5): 1420-1435.
[21] Zhang L, Xuan Y, Li Z, et al.How to Obtain Customer Requirements for Each Stage of the Product Life Cycle from Online Reviews: Using Mobile Phones as an Example[J]. Journal of Retailing and Consumer Services, 2024, 80: 103928.
[22] HINTERECKER T, LEROY C, ZHAO M T, et al.No Advantage for Remembering Horizontal over Vertical Spatial Locations Learned from a Single Viewpoint[J]. Memory & Cognition, 2018, 46(1): 158-171.
[23] CHEN K J, LI Z Z, JAMIESON G A.Influence of Information Layout on Diagnosis Performance[J]. IEEE Transactions on Human-Machine Systems, 2018, 48(3): 316-323.
[24] HAM D H, YOON W C.The Effects of Presenting Functionally Abstracted Information in Fault Diagnosis Tasks[J]. Reliability Engineering & System Safety, 2001, 73(2): 103-119.
[25] VICENTE K J, RASMUSSEN J.Ecological Interface Design: Theoretical Foundations[J]. IEEE Transactions on Systems, Man, and Cybernetics, 1992, 22(4): 589-606.
[26] ZHOU J L, MIAO X L, HE F J, et al.Effects of Font Style and Font Color in News Text on User Cognitive Load in Intelligent User Interfaces[J]. IEEE Access, 2022, 10: 10719-10730.
[27] LAI C J.An Ergonomic Study of Chinese Font and Color Display on Variable Message Signs[J]. Journal of the Chinese Institute of Industrial Engineers, 2008, 25(4): 306-313.
[28] Guohua Z.Analysis of graphic design and color application in tourism advertising[C]//2015 International Conference on Social Science and Technology Education. Atlantis Press, 2015: 259-263.
[29] GOONETILLEKE R S, KARWOWSKI W.Advances in Physical Ergonomics and Human Factors: Proceedings of the AHFE 2017 International Conference on Physical Ergonomics and Human Factors, July 17-21, 2017, the Westin Bonaventure Hotel, Los Angeles, California, USA[M]. Cham: Springer International Publishing, 2018
[30] YU N, OUYANG Z W, WANG H H, et al.The Effects of Smart Home Interface Touch Button Design Features on Performance among Young and Senior Users[J]. International Journal of Environmental Research and Public Health, 2022, 19(4): 2391.
[31] ALEMERIEN K, MAGEL K I.GUIEvaluator: A Metric-Tool for Evaluating the Complexity of Graphical User Interfaces[C]//International Conference on Software Engineering and Knowledge Engineering, [s. l.]: SEKE, 2014.
[32] HO C H, HOU K C.Exploring the Attractive Factors of App Icons[J]. KSII Transactions on Internet and Information Systems (TIIS), 2015, 9(6): 2251-2270.
[33] LI Y, GUO Y L, WEI W.Effects of Dynamic Icons on the Perceived Usability in the Travel App[J]. Tehnicki Vjesnik - Technical Gazette, 2023, 30(4): 1225-1233.
[34] BENNETT D J.Effects of Navigation and Position on Task when Presenting Diagrams to Blind People uUsing Sound[M]//Diagrammatic Representation and Inference. Berlin, Heidelberg: Springer Berlin Heidelberg, 2002: 161-175.
[35] GOVERNOR D, HALL J, JACKSON D.Teaching and Learning Science through Song: Exploring the Experiences of Students and Teachers[J]. International Journal of Science Education, 2013, 35(18): 3117-3140.
[36] WEAVER A, FIRMER G, MOTION A, et al.Sounding out Science: The Sonaphor and Electronic Sound Design as a Learning Tool in Secondary Science[J]. Postdigital Science and Education, 2023, 5(2): 408-439.
[37] YU W, BREWSTER S.Multimodal Virtual Reality Versus Printed Medium in Visualization for Blind People[C]//Proceedings of the Fifth International ACM Conference on Assistive Technologies. [s. l.]: ACM, 2002.
[38] SAKET B, PRASOJO C, HUANG Y F, et al.Designing an Effective Vibration-Based Notification Interface for Mobile Phones[C]//Proceedings of the 2013 Conference on Computer Supported Cooperative Work. San Antonio Texas USA. ACM, 2013: 149-1504.
[39] ZHAO R Q, ERLEKE E, WANG L B, et al.The Effects of Timbre on Voice Interaction[M]//Cross-Cultural Design. Cham: Springer Nature Switzerland, 2023: 155-166.
[40] 吴联凡, 陆定邦, 吴耀, 等. 多感官设计的可视化分析: 研究进展、热点与趋势[J]. 包装工程, 2022, 43(22): 205-220.
WU L F, LU D B, WU Y, et al.Visualization Analysis of Multi-Sensory Design: Research Progress, Hotspot and Development Trend[J]. Packaging Engineering, 2022, 43(22): 205-220.
[41] Green, Rao.Conjoint Measurement for Quantifying for Judgmental Data[J]. Journal of Marketing Research, 1971, 8(3): 350-362.
[42] LUCE R D, TUKEY J W.Simultaneous Conjoint Measurement: A New Type of Fundamental Measurement[J]. Journal of Mathematical Psychology, 1964, 1(1): 1-27.
[43] 沈浩, 柯惠新. 结合分析的原理和应用[J]. 数理统计与管理, 1998, 17(4): 39-45.
SHEN H, KE H X.Principle and Application of Conjoint Analysis[J]. Journal of Applied Statistics and Management, 1998, 17(4): 39-45.
[44] PENTUS K, MEHINE T, KUUSIK A.Considering Emotions in Product Package Design through Combining Conjoint Analysis with Psycho Physiological Measurements[J]. Procedia - Social and Behavioral Sciences, 2014, 148: 280-290.
[45] WANG F, WANG H F, CHO J.Consumer Preference for Yogurt Packaging Design Using Conjoint Analysis[J]. Sustainability, 2022, 14(6): 3463.
[46] 刘焕焕, 李永锋, 朱丽萍. 基于结合分析的老年人APP用户体验优化设计研究[J]. 包装工程, 2018, 39(24): 264-270.
LIU H H, LI Y F, ZHU L P.Optimal Design of APP User Experience for the Elderly Based on Conjoint Analysis[J]. Packaging Engineering, 2018, 39(24): 264-270.
[47] TOP10应用监控[EB/OL]. (2023-12-15). https://app.diandian.com/rank/monitor-1-0-75-%E7%A7%91%E6%99%AE.
TOP10 Application Monitoring[EB/OL]. (2023-12-15). https://app.diandian.com/rank/monitor-1-0-75-%E7%A7%91%E6%99%AE.
[48] VANCE A, ELIE-DIT-COSAQUE C, STRAUB D W. Examining Trust in Information Technology Artifacts: The Effects of System Quality and Culture[J]. Journal of Management Information Systems, 2008, 24(4): 73-100.
[49] WELLS, VALACICH, HESS. What Signal Are You Sending? how Website Quality Influences Perceptions of Product Quality and Purchase Intentions[J]. MIS Quarterly, 2011, 35(2): 373-396.
[50] 马敏. “格物穷理” 巧循自然——《天工开物》造物思想的生态意蕴与价值[J]. 南京艺术学院学报(美术与设计版), 2020(1): 105-109.
MA M.“Making a Thorough Inquiry”, Following the Nature Ingeniously—The Ecological Meaning and Value of the Creation Thought in Tiangong Kaiwu[J]. Journal of Nanjing Arts Institute (Fine Arts & Design), 2020(1): 105-109.