Skip to main navigation Skip to search Skip to main content

Señatalk: Inclusive Web Application for the Recognition and Translation of Peruvian Sign Language (PSL) Using Recurrent Neural Networks (LSTM)

  • Universidad Peruana de Ciencias Aplicadas

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Peruvian Sign Language (PSL) recognition is approached as a dynamic sequence classification problem. SeñaTalk, an inclusive web application for real-time LSP recognition and translation, is presented using a model based on LSTM networks and spatial vectors extracted using MediaPipe. The system captures key points of the face, hands and body, generating sequences that are classified to predict signs associated with the alphabet and basic words. A dataset of 15 dynamic gestures was used and a comparative benchmarking was performed between CNN, Vision Transformer and LSTM models, evaluating accuracy, response time, robustness and generalization capacity. The results show that the LSTM model offers the best balance between 98.0% accuracy and temporal efficiency, being the most suitable for implementation in accessible, inclusive and real-time applications.

Original languageEnglish
Title of host publicationProceedings - 4th International Conference on Computer Applications Technology, CCAT 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages110-114
Number of pages5
ISBN (Electronic)9798331556549
DOIs
StatePublished - 2025
Event4th International Conference on Computer Applications Technology, CCAT 2025 - Chengdu, China
Duration: 14 Nov 202516 Nov 2025

Publication series

NameProceedings - 4th International Conference on Computer Applications Technology, CCAT 2025

Conference

Conference4th International Conference on Computer Applications Technology, CCAT 2025
Country/TerritoryChina
CityChengdu
Period14/11/2516/11/25

Keywords

  • Deep learning
  • Inclusive web application
  • LSP
  • LSTM
  • recognition and translation
  • RNN

Fingerprint

Dive into the research topics of 'Señatalk: Inclusive Web Application for the Recognition and Translation of Peruvian Sign Language (PSL) Using Recurrent Neural Networks (LSTM)'. Together they form a unique fingerprint.

Cite this