International Journal of Computer Applications |
Foundation of Computer Science (FCS), NY, USA |
Volume 175 - Number 23 |
Year of Publication: 2020 |
Authors: A.I. El-Alfi, R. Adly, H.M. Ibrahim |
10.5120/ijca2020920767 |
A.I. El-Alfi, R. Adly, H.M. Ibrahim . Building Real-Time Translation of Arabic Sign Language System using Mechatronic Approach. International Journal of Computer Applications. 175, 23 ( Oct 2020), 48-54. DOI=10.5120/ijca2020920767
Each individual use language to communicate with others. The normal person uses phonetic language but the deaf uses sign language. So, all of them are using different language and having trouble dealing with the other. This paper aims to assist the deaf people to communicate with normal people by building real-time translation Arabic sign language system (ArSL). This system has two parts. The first part translates ArSl to phonetic language by using mechatronic approach. A Data Glove (DG) was built by flex sensors to get the hand gesture of ArSL and convert it to digital data. This data is interrupted to speech via speech knowledge base for Arabic phonetic language. The second part translates Arabic phonetic language to ArSL by using speech recognition for Arabic language to translate speech to text, and then translate text to ArSL via video knowledge base for Arabic language. This system is characterized by mobile, real-time translation, easy in usage and its support for Arabic language.