Deep Learning-Enhanced Kitabah Application for Inclusive and Adaptive Quranic Sign Language Education
DOI:
https://doi.org/10.23917/ijolae.v8i2.15390Keywords:
advanced education and learning, AI-assisted learning, deep learning, inclusive learning, innovative learning design, Kitabah method, mobile learning technology, progressive education, enhanced learningAbstract
People with hearing and speech disabilities (PHSD) continue to face barriers in accessing Quranic literacy education due to the dominance of auditory–verbal instructional approaches and the limited availability of adaptive digital learning environments. Although sign language recognition (SLR) technologies have advanced significantly, most existing systems are not aligned with pedagogically and theologically grounded Quranic learning frameworks. This study aims to develop and evaluate a deep learning-enhanced Kitabah application to support inclusive, adaptive, and technology-enhanced Quranic sign language education for PHSD learners. The study employed two approaches: (1) the development of a Kitabah-based mobile learning application integrating interactive visual–motor learning features, and (2) the implementation of a deep learning-based SLR model using ResNet-18 with transfer learning for static Hijaiyyah gesture recognition. The mobile application was evaluated through black-box testing and the System Usability Scale (SUS), while the SLR model was assessed using accuracy, precision, recall, and F1-score metrics. Results showed that all application functionalities operated successfully, with the application achieving a SUS score of 78.06, indicating good usability and accessibility. The SLR model achieved 98% classification accuracy across 31 Hijaiyyah sign classes, demonstrating strong recognition performance. These findings indicate that integrating the Kitabah method with deep learning and mobile learning technology can support progressive, inclusive, and adaptive Quranic literacy education through AI-assisted and learner-centered educational experiences for PHSD learners.
Downloads
References
Agustin, R. R., Maulana, H., & Mandyartha, E. P. (2023). Detection of Actions BI-SINDO (Indonesian Sign Language) in-to Text-to-Speech using Long Short-Term Memory with MediaPipe Holistics. Jurnal Teknik Informatika (Jutif), 5(4), 1051–1061. https://doi.org/10.52436/1.jutif.2024.5.4.1492
Ajid, S. N., Kusumaningtyas, D. A., Ratih, K., & Lava, S. (2025). Strategies for In-tegrating Problem-Based Learning, Tea-ching Modules, and Formative Asses-sments to Enhance Learning Outcomes and Critical Thinking Skills. Indonesian Journal on Learning and Advanced Education (IJOLAE), 7(2), 218–232. https://doi.org/10.23917/ijolae.v7i2.8612
Al Fajar, M., Dar, M. H., & Rohani, R. (2022). Application of Waterfall model in development of family planning parti-cipants information system. Sinkron, 7(2), 679–686. https://doi.org/10.33395/sinkron.v7i2.11387
Al-Barham, M., Alsharkawi, A., Al-Yaman, M., Al-Fetyani, M., Elnagar, A., SaAleek, A. A., & Al-Odat, M. (2023). RGB Arabic Alphabets Sign Language Dataset. http://arxiv.org/abs/2301.11932
Al-Barham, M., Sa’aleek, A. A., Al-Odat, M., Hamad, G., Al-Yaman, M., & Elna-gar, A. (2022). Arabic Sign Language Recognition Using Deep Learning Mo-dels. 2022 13th International Conference on Information and Communication Sys-tems, ICICS 2022, 226–231. https://doi.org/10.1109/ICICS55353.2022.9811162
Ali, A., & Codina, G. (2024). Representa-tions of Disability in Qur’anic Narrati-ves. Journal of Disability and Religion. https://doi.org/10.1080/23312521.2024.2353603
Al-Khuraym, B. Y., & Ismail, M. M. Ben. (2022). Arabic Sign Language Recogni-tion using Lightweight CNN-based Ar-chitecture. International Journal of Ad-vanced Computer Science and Applica-tions, 13(4), 319–328. https://doi.org/10.14569/IJACSA.2022.0130438
Almubarak, A., Nahadi, N., Yuliani, G., Ta-lib, C. A., & Arini, D. N. (2025). Stein-buch’s Epistemological Model and the Reality of Particles: A Philosophical Perspective for Chemistry Education. In-donesian Journal on Learning and Ad-vanced Education (IJOLAE), 37–51. https://doi.org/10.23917/ijolae.v7i1.23911
Alnuaim, A., Zakariah, M., Hatamleh, W. A., Tarazi, H., Tripathi, V., & Amoatey, E. T. (2022). Human-Computer Interaction with Hand Gesture Recognition Using ResNet and MobileNet. Computational Intelligence and Neuroscience, 2022. https://doi.org/10.1155/2022/8777355
Alsaadi, Z., Alshamani, E., Alrehaili, M., Al-rashdi, A. A. D., Albelwi, S., & Elfaki, A. O. (2022). A Real Time Arabic Sign Language Alphabets (ArSLA) Recogni-tion Model Using Deep Learning Archi-tecture. Computers, 11(5). https://doi.org/10.3390/computers11050078
Alsharif, B., Altaher, A. S., Altaher, A., Ilyas, M., & Alalwany, E. (2023). Deep Learning Technology to Recognize Ame-rican Sign Language Alphabet. Sensors, 23(18). https://doi.org/10.3390/s23187970
Arthur Limantara, M., & Tristianto, D. (2024). SIBI Alphabet Detection System Based on Convolutional Neural Network (CNN) Method as Learning Media. In-ternet of Things and Artificial Intelligen-ce Journal, 4(1), 143–161. https://doi.org/10.31763/iota.v4i1.716
Castilla, D., Jaen, I., Suso-Ribera, C., Garcia-Soriano, G., Zaragoza, I., Breton-Lopez, J., Mira, A., Diaz-Garcia, A., & Garcia-Palacios, A. (2024). Psychometric Pro-perties of the Spanish Full and Short Forms of the System Usability Scale (SUS): Detecting the Effect of Negati-vely Worded Items. International Jour-nal of Human-Computer Interaction, 40(15), 4145–4151. https://doi.org/10.1080/10447318.2023.2209840
Darmawan, I. D. M. B. A., Linawati, L., Su-kadarmika, G., Wirastuti, N. M. A. E. D., Pulungan, R., Mulyanto, & Hariyan-ti, N. K. D. (2023). Advancing Total Communication in SIBI: A Proposed Conceptual Framework for Sign Lan-guage Translation. 2023 International Conference on Smart-Green Technology in Electrical and Information Systems (ICSGTEIS), 23–28. https://doi.org/10.1109/ICSGTEIS60500.2023.10424020
Dzulkifli, I. (2022). Quranic Education for Deaf Students in Malaysia; Implementa-tion and Challenges. Nadwa: Jurnal Pendidikan Islam. https://doi.org/10.21580/nw.2022.16.1.10823
Fadlilah, U., Mahamad, A. K., & Handaga, B. (2021). The Development of Android for Indonesian Sign Language Using Tensorflow Lite and CNN: An Initial Study. Journal of Physics: Conference Series, 1858(1). https://doi.org/10.1088/1742-6596/1858/1/012085
Fadlilah, U., Mahamad, A. K., Handaga, B., Saon, S., Ratih, K., Rahmawati, L. E., & Thamrin, H. (2022a). Android Applica-tion Prototype of Basic BISINDO Intro-duction and Practice for General People.
Fadlilah, U., Mahamad, A. K., Handaga, B., Saon, S., Ratih, K., Rahmawati, L. E., & Thamrin, H. (2022b, September). An-droid Application Prototype of Basic BISINDO Introduction and Practice for General People. Proceeding of Internati-onal Conference on Special Edcation in South East Asia Region (ICSAR 2022).
Fadlilah, U., Wismoyohadi, D., Mahamad, A. K., & Handaga, B. (2019). Bisindo information system as potential daily sign language learning. AIP Conference Proceedings, 2114. https://doi.org/10.1063/1.5112492
Farouk, A. M., Zenhom, A. M., Abdelaleem, E. M., Fadel, S. A., Elsayed, K. K. A., Mohammed, M. S., Hassan, R. H., & Shedeed, H. A. (2024). A New Appro-ach for Arabic Sign Language Recogni-tion (ArSLR). NILES 2024 - 6th Novel Intelligent and Leading Emerging Scien-ces Conference, Proceedings, 545–550. https://doi.org/10.1109/NILES63360.2024.10753193
Hartanto, D., Fauziah, M., Moog, R. C., Ri-zal, Y., Diki Herdiansyah, & Hanum, N. C. (2025). Virtual Art Therapy for Ado-lescence Mental Health Education: Sys-tematic Literature Review and Future Perspectives. Indonesian Journal on Le-arning and Advanced Education (IJO-LAE), 7(2), 233–251. https://doi.org/10.23917/ijolae.v7i2.8200
Khwuta, Y. D. D. Y., Londa, M. A., & Wee, Y. A. (2023). Designing and building a business data collection application using the waterfall method. MATRIX : Jurnal Manajemen Teknologi Dan Informatika, 13(1), 42–51. https://doi.org/10.31940/matrix.v13i1.42-51
Kinanti, A., & Maulana, D. (2024). Convolu-tional Neural Network Implementation in BISINDO Alphabet Sign Language Re-cognition System Using Flask. Interna-tional Journal of New Media Techno-logy), 11(1), 16.
Khusnani, A., Jufriansah, A., Wahab, D. S., Samana, F. R. A., Bahruddin, S. A., Anwar, Z., … Arifin, A. S. (2026). Temporal and Spatial Dynamics of Vol-canic Aerosols: Absorbing Aerosol In-dex (AAI) Analysis During the Eruption of Mount Lewotobi Laki-laki. Jurnal Penelitian Sains Teknologi, 2(1), 34–43. https://doi.org/10.23917/saintek.v2i1.15729
Meitantya, M. D., Sari, C. A., Rachmawanto, E. H., & Ali, R. R. (2024). VGG-16 Ar-chitecture on CNN for American Sign Language Classification. Jurnal Teknik Informatika (Jutif), 5(4), 1165–1171. https://doi.org/10.52436/1.jutif.2024.5.4.2160
Nugraha, M. F. A., Roemintoyo, R., Djono, D., & Al-Hakimi, H. (2024). Deve-lopment of a Mobile Application for Oc-cupational Health and Safety Education in Vocational High Schools: A Case Study in Construction and Housing En-gineering. Indonesian Journal on Lear-ning and Advanced Education (IJOLAE), 315–327. https://doi.org/10.23917/ijolae.v6i3.235921
Podder, K. K., Ezeddin, M., Chowdhury, M. E. H., Sumon, M. S. I., Tahir, A. M., Ayari, M. A., Dutta, P., Khandakar, A., Mahbub, Z. Bin, & Kadir, M. A. (2023). Signer-Independent Arabic Sign Lan-guage Recognition System Using Deep Learning Model. Sensors, 23(16). https://doi.org/10.3390/s23167156
Putrada, A. G., Alamsyah, N., Fauzan, M. N., & Perdana, D. (2023). PCA-SVM for a Lightweight ASL Hand Gesture Image Recognition. Proceedings of the International Conference on Electrical Engineering and Informatics. https://doi.org/10.1109/ICEEI59426.2023.10346744
Rakhmadi, A., Khairunnisa, S., Adhantoro, M. S., Riyadi, S., Yudhana, A., & Su-nardi. (2025). EfficientNetB0-Based Re-cognition of Arabic Sign Language for Quranic Recitation Support. 2025 12th International Conference on Electrical Engineering, Computer Science and In-formatics (EECSI), 137–143. https://doi.org/10.1109/EECSI67060.2025.11290662
Rakhmadi, A., Yudhana, A., & Sunardi. (2025a). A Study of Worldwide Patterns in Alphabet Sign Language Recognition Using Convolutional and Recurrent Neu-ral Networks. Jurnal Teknik Informatika (JUTIF), 6(1), 187–204. https://doi.org/10.52436/1.jutif.2025.6.1.4202
Rakhmadi, A., Yudhana, A., & Sunardi, S. (2025b). VGG16-Based Feature Extrac-tion for Arabic Alphabet Sign Language Classification to Support Qur’anic Tada-rus Accessibility. Jurnal Teknik Infor-matika (Jutif), 6(4), 2602–2624. https://doi.org/10.52436/1.jutif.2025.6.4.4953
Rifanka, I. N., Panjaitan, R. G. P., Tenria-waru, A. B., & Li, L. (2025). Deve-lopment and Validation of a Hemostatic Activity-Based Learning Video on the Cir-culatory System for High School Bi-ology Education. Indonesian Journal on Learning and Advanced Education (IJOLAE), 69–87. https://doi.org/10.23917/ijolae.v7i1.23749
Rumetna, M. S., Lina, T. N., Rajagukguk, I. S., Pormes, F. S., & Santoso, A. B. (2022). Payroll Information System De-sign Using Waterfall Method. Internati-onal Journal of Advances in Data and Information Systems, 3(1). https://doi.org/10.25008/ijadis.v3i1.1227
Sab, I., & Biradar, A. (2023). ASL and Hand Gesture Emoji Translator Using Compu-ter Vision. 2023 14th International Con-ference on Computing Communication and Networking Technologies, ICCCNT 2023. https://doi.org/10.1109/ICCCNT56998.2023.10308381
Setiawan, A., & Ulinnuha, M. (2026). Deve-lopment and Feasibility Testing of Virtu-al Reality Based Learning Media for Practicum in LAN and Fiber Optic Network Cabling Using the 4D Model. Jurnal Penelitian Sains Teknologi, 2(1), 20–33. https://doi.org/10.23917/saintek.v2i1.12693
Downloads
Submitted
Accepted
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Aris Rakhmadi, Anton Yudhana, Sunardi Sunardi, Yuli Rahmawati
This work is licensed under a Creative Commons Attribution 4.0 International License.
