Emotional Interaction Design in Aerospace Virtual Assembly Training

WANG Xiao-hui, WANG Jia-yu, ZHAO Kai, QIN Jing-yan

Packaging Engineering ›› 2022, Vol. 43 ›› Issue (2) : 10-16.

PDF(3769 KB)
PDF(3769 KB)
Packaging Engineering ›› 2022, Vol. 43 ›› Issue (2) : 10-16. DOI: 10.19554/j.cnki.1001-3563.2022.02.002

Emotional Interaction Design in Aerospace Virtual Assembly Training

  • WANG Xiao-hui1, WANG Jia-yu1, ZHAO Kai2, QIN Jing-yan3
Author information +
History +

Abstract

This work combines virtual reality with emotional interaction design to explore the applications on aerospace assembly training and to improve training efficiency and improve training experience. By investigating the research on multimodal emotional interaction, the emotional interaction model in aerospace virtual assembly training is built by using emotion recognition based on physiological signals, speech interaction, highlights and videos. Taking the virtual assembly training of aerospace ball valve as an example, an aerospace virtual assembly training system with emotional interaction is constructed. Real-time emotional monitoring is performed by using physiological data collected from GSR sensors worn on the user’s finger. Three interactive schemes are provided according to different emotions:speech interaction, highlights and video. The effectiveness of emotional interaction in virtual assembly training system is verified by the efficiency of completing assembly tasks in the virtual environment. The experimental results show that the emotional interaction design can effectively shorten the training time and greatly improve the training experience of users. This work can promote the research on the multimodal emotional interaction paradigm by combining physiological signals, speech interaction, visual interaction, etc. This work verifies the effectiveness of the emotional interaction in the application of aerospace virtual assembly training, which has wide academic meaning and application prospects.

Key words

s on Human Factors in Computing Systems, 2014.

Cite this article

Download Citations
WANG Xiao-hui, WANG Jia-yu, ZHAO Kai, QIN Jing-yan. Emotional Interaction Design in Aerospace Virtual Assembly Training[J]. Packaging Engineering. 2022, 43(2): 10-16 https://doi.org/10.19554/j.cnki.1001-3563.2022.02.002
PDF(3769 KB)

Accesses

Citation

Detail

Sections
Recommended

/