Virtual Reality Controller Interaction Design for Forearm Amputees Based on Natural Interaction

HE Ziqiang; JIANG Ke; MING Shijie; ZHANG Jingyu; YAN Yupeng

doi:10.19554/j.cnki.1001-3563.2025.22.005

PDF(4405 KB)

Packaging Engineering ›› 2025, Vol. 46 ›› Issue (22) : 36-50. DOI: 10.19554/j.cnki.1001-3563.2025.22.005

Special Subject: Product Design, Manufacturing and Service Coor曲nation Optimization Driven by Data and Model Int，电ra世on

Virtual Reality Controller Interaction Design for Forearm Amputees Based on Natural Interaction

HE Ziqiang, JIANG Ke^*, MING Shijie, ZHANG Jingyu, YAN Yupeng

Author information +

History +

Abstract

The work aims to develop a natural, comfortable, and cost-effective virtual reality controller interaction design tailored for forearm amputees, so as to deliver seamless and immersive virtual reality experience. Grounded in natural interaction principles and accessibility design theory, a three-layer interaction design model was constructed. Based on the design model, the Analytic Hierarchy Process was employed to identify core functional buttons for virtual reality controllers, while the Wizard of Oz method was utilized to investigate users' natural interaction behaviors, establishing mappings between residual limb movements and controller functions. Leveraging these insights, an interaction prototype was developed and evaluated through usability testing and subjective user feedback scales. Based on the constructed design model, a virtual reality interaction design scheme utilizing existing controllers was proposed, which successfully translated forearm amputees' residual limb motions into functional operations, enabling effective interaction in virtual environments. The test results indicated that this interaction design enabled forearm amputees to interact with virtual reality with considerable fluency, essentially equipping them with the capability to experience mainstream VR applications. The work presents a practical interaction solution that empowers forearm amputees to engage with virtual reality technology, while also contributing to broader discussions on integrating natural interaction paradigms into accessibility- focused design practices.

Key words

natural interaction / forearm amputees / virtual reality controller / accessibility design / Analytic Hierarchy Process / Wizard of Oz method

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

HE Ziqiang, JIANG Ke, MING Shijie, ZHANG Jingyu, YAN Yupeng. Virtual Reality Controller Interaction Design for Forearm Amputees Based on Natural Interaction[J]. Packaging Engineering. 2025, 46(22): 36-50 https://doi.org/10.19554/j.cnki.1001-3563.2025.22.005

References

[1] 周玉, 汪一, 李雷达, 等. 虚拟现实图像客观质量评价研究进展[J]. 中国图象图形学报, 2022, 27(8): 2313-2328.
ZHOU Y, WANG Y, LI L D, et al.Research Progress in Objective Quality Evaluation of Virtual Reality Images[J]. Journal of Image and Graphics, 2022, 27(8): 2313-2328.
[2] 袁茜茜, 吕星月, 冯大权, 等. 基于技术驱动与服务创新的虚拟现实产业发展研究[J]. 中国工程科学, 2024, 26(1): 35-44.
YUAN X X, LYU X Y, FENG D Q, et al.Development of Virtual Reality Industry Based on Technology Drive and Service Innovation[J]. Strategic Study of CAE, 2024, 26(1): 35-44.
[3] 刘安南, 孙加兴, 徐海兰, 等. 虚拟现实技术对孤独症谱系障碍患者治疗效果的meta分析[J]. 中国康复医学杂志, 2024, 39(8): 1194-1198.
LIU A N, SUN J X, XU H L, et al.Meta-Analysis of the Therapeutic Effect of Virtual Reality Technology on Autism Spectrum Disorder's Patients[J]. Chinese Journal of Rehabilitation Medicine, 2024, 39(8): 1194-1198.
[4] PRAKASH A, SHARMA S.A Low-Cost System to Control Prehension Force of a Custom-Made Myoelectric Hand Prosthesis[J]. Research on Biomedical Engineering, 2020, 36(3): 237-247.
[5] 吴庭丞. 基于肌电信号的前臂假肢动作识别研究与实现[D]. 哈尔滨: 哈尔滨工业大学, 2017: 1-8.
WU T C.Research and Implementation of Forearm Prosthetic Motion Recognition Based on EMG Signal [D]. Harbin: Harbin Institute of Technology, 2017: 1-8.
[6] 李鹏, 乔清理, 吴竞. 基于MEMS加速度传感器的无手鼠标[J]. 传感器与微系统, 2016, 35(11): 80-83.
LI P, QIAO Q L, WU J.Hand-Free Mouse Based on MEMS Acceleration Sensor[J]. Transducer and Microsystem Technologies, 2016, 35(11): 80-83.
[7] NABULSI A A.Hand Gesture Recognition via Electromyographic (EMG) Armband for Cad Software Control[D]. Columbia, MO, USA: University of Missouri-Kansas City, 2018.
[8] COOGAN C G, HE B.Brain-Computer Interface Control in a Virtual Reality Environment and Applications for the Internet of Things[J]. IEEE Access, 2018, 6: 10840-10849.
[9] 王瑞, 董石羽, 肖江浩. 智能汽车界面设计的人机自然交互研究[J]. 机械设计, 2019, 36(2): 132-136.
WANG R, DONG S Y, XIAO J H.Research on Human-Machine Natural Interaction of Intelligent Vehicle Interface Design[J]. Journal of Machine Design, 2019, 36(2): 132-136.
[10] 李欣洋, 金彤彤, 王韫. 基于自然人机交互的居家智能椅健康促进系统设计[J]. 包装工程, 2023, 44(22): 208-215.
LI X Y, JIN T T, WANG Y.Health Promotion System Design of Home Smart Chair Based on Natural Human-Computer Interaction[J]. Packaging Engineering, 2023, 44(22): 208-215.
[11] 王瑞. 基于自然交互方式的智能产品设计研究[J]. 机械设计, 2019, 36(S1): 29-33.
WANG R.Research on Intelligent Product Design Based on Natural Interaction[J]. Journal of Machine Design, 2019, 36(S1): 29-33.
[12] 孙晓枫, 赵新军, 吕春梅, 等. 视听联觉在多通道人机自然交互中的应用研究[J]. 机械设计与制造, 2021(10): 236-240.
SUN X F, ZHAO X J, LYU C M, et al.Application of Audio-Visual Relevance in Natural Multi-Modal Human-Machine Interaction[J]. Machinery Design & Manufacture, 2021(10): 236-240.
[13] GALDIERI R, CARROZZINO M.Natural Interaction in Virtual Reality for Cultural Heritage[C]//VR Technologies in Cultural Heritage. Cham: Springer International Publishing, 2019.
[14] 祝长康, 吴迪. 城市轨道交通车站的无障碍设计[J]. 城市轨道交通研究, 2023, 26(8): 192-194.
ZHU C K, WU D.Accessibility Design of Urban Rail Transit Station[J]. Urban Mass Transit, 2023, 26(8): 192-194.
[15] 李静雅, 任艺轩. 看见音乐:多模态交互技术在听障人群无障碍音乐体验中的设计应用[J]. 装饰, 2023(11): 142-144.
LI J Y, REN Y X.See Music: Design Application on Enhancing the Musical Experience for Hearing-Impaired People Based on Multi-Model Interaction Technologies[J]. Zhuangshi, 2023(11): 142-144.
[16] 张兴旺, 郝彦娜, 王璐. 面向听障用户的数字图书馆信息无障碍智能交互技术研究述评[J]. 图书馆学研究, 2020(21): 2-12.
ZHANG X W, HAO Y N, WANG L.A Review of Research on Digital Library Information Accessibility Intelligent Interaction Technologies for Hearing Impaired Users[J]. Research on Library Science, 2020(21): 2-12.
[17] 喻国明, 苏健威, 黄哲浩. 生成式AI时代媒介的自然交互范式及其实践进路——基于语用学视角的分析[J]. 编辑之友, 2024(3): 58-65.
YU G M, SU J W, HUANG Z H.Media's Natural Interaction Paradigm and Practical Approaches in the Generative AI Era: An Analysis Based on the Perspective of Pragmatics[J]. Editorial Friend, 2024(3): 58-65.
[18] 张钰曌, 陈洋. 基于感官代偿的特殊教育学校公共空间无障碍设计策略研究[J]. 建筑学报, 2017(S2): 56-62.
ZHANG Y Z, CHEN Y.Research on Barrier-Free Design Strategy of Public Space in Special Education Schools Based on Sensory Compensation[J]. Architectural Journal, 2017(S2): 56-62.
[19] 杨云刚, 刘钧圣, 赵军民, 等. 基于层次分析法的导引头选型决策研究[J]. 弹箭与制导学报, 2021, 41(6): 59-62.
YANG Y G, LIU J S, ZHAO J M, et al.Research of Seeker Selection Decision Based on Analytic Hierarchy Process[J]. Journal of Projectiles, Rockets, Missiles and Guidance, 2021, 41(6): 59-62.
[20] DAHLBÄCK N, JÖNSSON A, AHRENBERG L. Wizard of Oz Studies: Why and how[C]//Proceedings of the 1st International Conference on Intelligent User Interfaces-IUI '93. Orlando, Florida, USA. ACM, 1993: 193-200.
[21] 李占利, 党琪, 李洪安, 等. 基于层次分析法的牙齿隐形正畸方案评价与优选[J]. 图学学报, 2021, 42(5): 856-865.
LI Z L, DANG Q, LI H A, et al.Evaluation and Optimal Selection of Invisible Orthodontic Schemes Based on Analytic Hierarchy Process[J]. Journal of Graphics, 2021, 42(5): 856-865.
[22] 张皓, 吴虎胜, 王伟博. 基于AHP-FCE法的“低慢小”目标防控分队装备体系任务满意度评估[J]. 兵工自动化, 2024, 43(8): 64-70.
ZHANG H, WU H S, WANG W B.Task Satisfaction Evaluation of Equipment System for "Low-Slow-Small" Target Prevention and Control Units Based on AHP-FCE Method[J]. Ordnance Industry Automation, 2024, 43(8): 64-70.
[23] LIU Y F, LI B, XI P C, et al.Neuromorphic Transcutaneous Electrical Nerve Stimulation (nTENS) Induces Efficient Tactile-Related Cortical Networks in Forearm Amputees[J]. Science China Technological Sciences, 2023, 66(5): 1451-1460.
[24] 单新颖, 俞梦孙. 下肢截肢患者运动表象的脑电功率谱改变[J]. 中国康复理论与实践, 2022, 28(11): 1360-1364.
SHAN X Y, YU M S.Electroencephalogram Power Spectrum as Motor Imagery for Lower Limb Amputees[J]. Chinese Journal of Rehabilitation Theory and Practice, 2022, 28(11): 1360-1364.
[25] HYZY M, BOND R, MULVENNA M, et al.System Usability Scale Benchmarking for Digital Health Apps: Meta-Analysis[J]. JMIR MHealth and UHealth, 2022, 10(8): e37290.