Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition

Andre Neyra-Gutierrez; Pedro Shiguihara-Juarez

doi:10.1109/INTERCON50315.2020.9220243

Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition

Andre Neyra-Gutierrez
, Pedro Shiguihara-Juarez

Faculty of Health Sciences

Universidad Peruana de Ciencias Aplicadas

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

8 Scopus citations

Abstract

In peruvian sign language (PSL), recognition of static gestures has been proposed earlier. However, to state a conversation using sign language, it is also necessary to employ dynamic gestures. We propose a method to extract a feature vector for dynamic gestures of PSL. We collect a dataset with 288 video sequences of words related to dynamic gestures and we state a workflow to process the keypoints of the hands, obtaining a feature vector for each video sequence with the support of a video summarization technique. We employ 9 neural networks to test the method, achieving an average accuracy ranging from 80% and 90%, using 10 fold cross-validation.

Original language	English
Title of host publication	Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781728193779
DOIs	https://doi.org/10.1109/INTERCON50315.2020.9220243
State	Published - Sep 2020
Event	27th IEEE International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020 - Virtual, Lima, Peru Duration: 3 Sep 2020 → 5 Sep 2020

Publication series

Name	Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020

Conference

Conference	27th IEEE International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020
Country/Territory	Peru
City	Virtual, Lima
Period	3/09/20 → 5/09/20

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 7 Affordable and Clean Energy

Keywords

Dynamic Gestures
Feature Extraction
Peruvian Signal Language
Sign Language Recognition
Video Summarization

Access to Document

10.1109/INTERCON50315.2020.9220243

Cite this

Neyra-Gutierrez, A., & Shiguihara-Juarez, P. (2020). Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition. In Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020 Article 9220243 (Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INTERCON50315.2020.9220243

Neyra-Gutierrez, Andre ; Shiguihara-Juarez, Pedro. / Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition. Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020. Institute of Electrical and Electronics Engineers Inc., 2020. (Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020).

@inproceedings{9f353063ff024e34b915ca6609b3bc11,

title = "Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition",

abstract = "In peruvian sign language (PSL), recognition of static gestures has been proposed earlier. However, to state a conversation using sign language, it is also necessary to employ dynamic gestures. We propose a method to extract a feature vector for dynamic gestures of PSL. We collect a dataset with 288 video sequences of words related to dynamic gestures and we state a workflow to process the keypoints of the hands, obtaining a feature vector for each video sequence with the support of a video summarization technique. We employ 9 neural networks to test the method, achieving an average accuracy ranging from 80\% and 90\%, using 10 fold cross-validation.",

keywords = "Dynamic Gestures, Feature Extraction, Peruvian Signal Language, Sign Language Recognition, Video Summarization",

author = "Andre Neyra-Gutierrez and Pedro Shiguihara-Juarez",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 27th IEEE International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020 ; Conference date: 03-09-2020 Through 05-09-2020",

year = "2020",

month = sep,

doi = "10.1109/INTERCON50315.2020.9220243",

language = "Ingl{\'e}s",

series = "Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020",

}

Neyra-Gutierrez, A & Shiguihara-Juarez, P 2020, Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition. in Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020., 9220243, Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020, Institute of Electrical and Electronics Engineers Inc., 27th IEEE International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020, Virtual, Lima, Peru, 3/09/20. https://doi.org/10.1109/INTERCON50315.2020.9220243

Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition. / Neyra-Gutierrez, Andre; Shiguihara-Juarez, Pedro.
Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020. Institute of Electrical and Electronics Engineers Inc., 2020. 9220243 (Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition

AU - Neyra-Gutierrez, Andre

AU - Shiguihara-Juarez, Pedro

PY - 2020/9

Y1 - 2020/9

N2 - In peruvian sign language (PSL), recognition of static gestures has been proposed earlier. However, to state a conversation using sign language, it is also necessary to employ dynamic gestures. We propose a method to extract a feature vector for dynamic gestures of PSL. We collect a dataset with 288 video sequences of words related to dynamic gestures and we state a workflow to process the keypoints of the hands, obtaining a feature vector for each video sequence with the support of a video summarization technique. We employ 9 neural networks to test the method, achieving an average accuracy ranging from 80% and 90%, using 10 fold cross-validation.

AB - In peruvian sign language (PSL), recognition of static gestures has been proposed earlier. However, to state a conversation using sign language, it is also necessary to employ dynamic gestures. We propose a method to extract a feature vector for dynamic gestures of PSL. We collect a dataset with 288 video sequences of words related to dynamic gestures and we state a workflow to process the keypoints of the hands, obtaining a feature vector for each video sequence with the support of a video summarization technique. We employ 9 neural networks to test the method, achieving an average accuracy ranging from 80% and 90%, using 10 fold cross-validation.

KW - Dynamic Gestures

KW - Feature Extraction

KW - Peruvian Signal Language

KW - Sign Language Recognition

KW - Video Summarization

UR - https://www.scopus.com/pages/publications/85095444502

U2 - 10.1109/INTERCON50315.2020.9220243

DO - 10.1109/INTERCON50315.2020.9220243

M3 - Contribución a la conferencia

AN - SCOPUS:85095444502

T3 - Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020

BT - Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 27th IEEE International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020

Y2 - 3 September 2020 through 5 September 2020

ER -

Neyra-Gutierrez A, Shiguihara-Juarez P. Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition. In Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020. Institute of Electrical and Electronics Engineers Inc. 2020. 9220243. (Proceedings of the 2020 IEEE 27th International Conference on Electronics, Electrical Engineering and Computing, INTERCON 2020). doi: 10.1109/INTERCON50315.2020.9220243

Feature Extraction with Video Summarization of Dynamic Gestures for Peruvian Sign Language Recognition

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this