Review of Sensory Feedback Simulation Methods in Multi-modal Human-computer Interaction

SUN Ling-yun, WANG Ke-xing, CHEN Pei, ZHOU Zi-hong, YANG Chang-yuan, YANG Guang

Packaging Engineering ›› 2023, Vol. 44 ›› Issue (8) : 81-94, 106.

PDF(1378 KB)
PDF(1378 KB)
Packaging Engineering ›› 2023, Vol. 44 ›› Issue (8) : 81-94, 106. DOI: 10.19554/j.cnki.1001-3563.2023.08.008

Review of Sensory Feedback Simulation Methods in Multi-modal Human-computer Interaction

  • SUN Ling-yun1, WANG Ke-xing1, CHEN Pei1, ZHOU Zi-hong1, YANG Chang-yuan2, YANG Guang2
Author information +
History +

Abstract

The work aims to sort out the research status of sensory feedback simulation methods in multi-modal human-computer interaction and summarize the principles and implementation methods of related techniques in existing research, so as to provide references for the subsequent research and practice. Firstly, the techniques used to simulate haptic, olfactory, and gustatory feedback were summarized respectively by reviewing literature and studying typical cases. Then, the cognitive theories about multi-modal sensory integration were outlined and the specific implementation methods were introduced by taking visual-aural-haptic and visual-aural-olfactory feedback integration as examples. Finally, the application of multi-modal sensory feedback in typical scenarios such as medical rehabilitation, virtual shopping, and intelligent education was expounded. The research of sensory feedback simulation methods in multi-modal human-computer interaction is expected to support a new type of human-computer interaction with low load and high efficiency. It can even deliver an interactive experience that goes beyond reality, representing a wide range of application potential.

Key words

s. Portland, Oregon, USA, 2005.

Cite this article

Download Citations
SUN Ling-yun, WANG Ke-xing, CHEN Pei, ZHOU Zi-hong, YANG Chang-yuan, YANG Guang. Review of Sensory Feedback Simulation Methods in Multi-modal Human-computer Interaction[J]. Packaging Engineering. 2023, 44(8): 81-94, 106 https://doi.org/10.19554/j.cnki.1001-3563.2023.08.008
PDF(1378 KB)

Accesses

Citation

Detail

Sections
Recommended

/