Application of Mid-air Gesture Interactive Experience Design for Mixed Reality Teaching

LU Yi, WANG Xiaoye, WANG Yulin, GE Sen, ZHOU Lejia

Packaging Engineering ›› 2024, Vol. 45 ›› Issue (4) : 181-190.

PDF(14897 KB)
PDF(14897 KB)
Packaging Engineering ›› 2024, Vol. 45 ›› Issue (4) : 181-190. DOI: 10.19554/j.cnki.1001-3563.2024.04.019

Application of Mid-air Gesture Interactive Experience Design for Mixed Reality Teaching

  • LU Yi, WANG Xiaoye, WANG Yulin, GE Sen, ZHOU Lejia
Author information +
History +

Abstract

The work aims to conduct in-depth research on the interactive experience of mid-air gestures in mixed reality teaching, design innovative teaching experience modes, and enhance teaching experience through the design of mid-air gesture interactive experience. The methods of literature research, field observation, in-depth interviews, and experimental research methods were adopted. Based on theoretical research and combined with teaching experience needs, design methods were constructed around scenes, users, and products to define the types of mid-air gestures that met teaching needs. Finally, effective technical means were combined to build mixed reality teaching scenes, design personalized teaching experience links, and complete the design of mid-air gesture interaction interfaces. As a result, a design method for interactive experience of mid-air gestures for mixed reality teaching was constructed, and eight types of mid-air gestures were defined to meet teaching needs. A gesture interaction method for mid-air gestures was proposed. Interactive experience links with teaching guidance significance such as "teaching guidance" and "freehand painting" were designed, which were suitable for remote and offline mixed reality STEM teaching scenes, forming rich mixed reality STEM teaching resources. The conclusion demonstrates the overall usability of eight types of default mid-air gesture types and user-defined gestures through user experiments, opening up a new path for interactive experience design research in the field of mixed reality teaching.

Key words

mid-air gestures; mixed reality teaching; interactive experience design; smart education

Cite this article

Download Citations
LU Yi, WANG Xiaoye, WANG Yulin, GE Sen, ZHOU Lejia. Application of Mid-air Gesture Interactive Experience Design for Mixed Reality Teaching[J]. Packaging Engineering. 2024, 45(4): 181-190 https://doi.org/10.19554/j.cnki.1001-3563.2024.04.019
PDF(14897 KB)

Accesses

Citation

Detail

Sections
Recommended

/