Continuous Sign Language Recognition Algorithm Based on Global Attention Mechanism and LSTM

YANG Guan-ci, HAN Hai-fenga, LIU Sai-sai, JIANG Ya-wen, LI Yang

Packaging Engineering ›› 2022, Vol. 43 ›› Issue (8) : 28-34.

PDF(1594 KB)
PDF(1594 KB)
Packaging Engineering ›› 2022, Vol. 43 ›› Issue (8) : 28-34. DOI: 10.19554/j.cnki.1001-3563.2022.08.004

Continuous Sign Language Recognition Algorithm Based on Global Attention Mechanism and LSTM

  • YANG Guan-ci1, HAN Hai-fenga2, LIU Sai-sai3, JIANG Ya-wen3, LI Yang3
Author information +
History +

Abstract

To improve the continuous sign language recognition accuracy and alleviate the communication barrier between hearing-impaired people and non hearing-impaired people, this paper proposed the continuous sign language recognition algorithm based on Global Attention Mechanism and LSTM (CSLR-GAML). The video data is preprocessed by applying inter-frame difference to eliminate redundant video frames, and then the feature sequences of the key frames are extracted by using ResNet. After that, the attention mechanism is used to update the network parameters, which is capable of obtain the global feature of sign language, and then the LSTM is employed to finish the timing sequence analysis. Finally, use the Chinese continuous sign language data set CSL to check algorithm performance. And the experimental results show that the average recognition accuracy of the proposed algorithm is 90.08%, and the average word error rate is 41.2%. Compared CSLR-GAML with other Five algorithms, the proposed CSLR-GAML has advantages in recognition accuracy and translation performance. The sontinuous sign language recognition algorithm based on Global Attention Mechanism and LSTM realizes continuous sign language recognition, and has good recognition effect and translation performance. It is of positive significance to promote the barrier free integration of hearing-impaired people into society.

Key words

sign language recognition; feature extraction; global attention mechanism; LSTM

Cite this article

Download Citations
YANG Guan-ci, HAN Hai-fenga, LIU Sai-sai, JIANG Ya-wen, LI Yang. Continuous Sign Language Recognition Algorithm Based on Global Attention Mechanism and LSTM[J]. Packaging Engineering. 2022, 43(8): 28-34 https://doi.org/10.19554/j.cnki.1001-3563.2022.08.004
PDF(1594 KB)

Accesses

Citation

Detail

Sections
Recommended

/