To help deaf children, aka do not hear, to learn hijaiyah letters, Semarang State Polytechnic students (Polines) have succeeded in making an application that makes learning easier.
The creators of the application are Aldi Azmi Arfiah and Muhammad Hanif Dzaky Alifi. They are Polynes Informatics Engineering students. Their supervisors are Lilik Triyono and Slamet Handoko.
Aldi Azmi Arfiah said this Android-based application can help deaf people, especially children, in learning the hijaiyah letters. "This application uses image classification technology to translate gestures," he explained, via a written message, Sunday (11/21/2021).
When the user presses scan, he continued, the application will process the image captured by the camera. Then the application will perform image classification using the image.
Then the application will take the letter labels with the highest similarity and display the results in the form of gesture images, Arabic letters, and Latin letters based on the classification results. This application has a function to translate hijaiyah letters into other forms that can be used as learning materials.
The model in this application is divided into 6 models, each of which has 5 letters in it, the user can change the model. The accuracy of the existing model is still low, which is only around 60 percent. "So the light intensity is very large in influencing the accuracy of the model," he said.
This application also has other features, namely a dictionary, games in the form of sliding puzzles, and quizzes to test user understanding.
In the dictionary menu there are two views, namely a list of letters and a dictionary that can be replaced by swiping on the smartphone screen.
On the letter list menu there are 30 pictures of hijaiyah gestures and letters, consisting of 28 general hijaiyah letters plus tamar butoh and lamalif.
On the dictionary menu there is a list of Latin hijaiyah letters, if you click it, it will display detailed data in the form of gesture images, Arabic letters, and Latin letters.
"Interestingly, this application also provides a game menu. In the game menu, users can play a sliding puzzle type game with the puzzle image being played is a gestural image of the hijaiyah letter. Each letter has its own puzzle, users will get a random puzzle when opening this menu," he explained.
In addition, he said, there is a quiz menu. Users will be presented with 10 questions, each question is obtained from a random selection of 30 hijaiyah letters. If the user answers correctly then the application will display a checklist animation and if incorrect the application will display a cross application. If the user has completed 10 questions, the application will display the value obtained from the total correct answers.
Through this application, the innovator team hopes that this application can be useful and can make it easier to help deaf children learn the hijaiyah letter. "This is our contribution to helping deaf children learn hijaiyah letters," he added. (*)
This article has been published on TribunJateng.com with the title Polines Students Create Hijaiyah Letter Learning Applications for Deaf Children, https://jateng.tribunnews.com/2021/11/21/mahasiswa-polines-buat-application-pembelajaran-huruf- hijaiyah-for-child-deaf-impaired?page=2.
Author: mamdukh adi priyanto | Editor: moh anhar