Assessing the Usability of an Immersive Computer Assembly Simulation Based on Hand Gesture Control
DOI:
https://doi.org/10.23917/ieltech.v1i2.17443Keywords:
Immersive Simulation, Hand Gesture Control, Computer Assembly, Vocational Education, Usability EvaluationAbstract
Vocational computer assembly training frequently relies on conventional static media, which fails to provide the interactive spatial visualization necessary for mastering complex hardware handling. This study aims to develop and evaluate the usability and pedagogical effectiveness of a computer assembly simulation utilizing hand gesture control to address this educational gap. Employing the Research and Development (R&D) methodology guided by the ADDIE framework, the interactive medium was developed using Unity 3D and the Leap Motion Controller. Following rigorous validation by media and material experts, a field evaluation was conducted involving 30 vocational high school students. The System Usability Scale (SUS) was administered to assess user experience, while a pre-test and post-test design, analyzed via a Paired Sample T-Test, measured the impact on learning outcomes. Expert appraisals categorized the simulation as "Very Feasible," scoring 89.1% for media and 79.58% for material quality. The user evaluation yielded an average SUS score of 64.6 ("Marginal High"), reflecting a minor initial learning curve associated with the novel controller-free interface. Crucially, the intervention significantly enhanced student performance, with average scores increasing from 57.00 to 87.00 (Sig. = 0.000). These findings demonstrate that despite moderate initial cognitive friction regarding usability, immersive hand gesture simulations profoundly elevate practical skill mastery, offering a secure and highly effective pedagogical alternative to traditional didactic instruction.
Downloads
References
Alexandre, B., Reynaud, E., Osiurak, F., & Navarro, J. (2018). Acceptance and acceptability criteria: A literature review. Cognition Technology & Work, 20(2), 165–177. https://doi.org/10.1007/s10111-018-0459-1
Badarudin, R., Hariyanto, D., Supriyadi, E., Djatmiko, I. W., Husna, A. F., Kassymova, G. K., & Lu, Y. (2024). Enhancing Digital Learning in Electrical Machines Practical Course Using a Cutting-Edge Desktop Virtual Laboratory for DC Motor Simulation. TEM Journal, 2522–2533. https://doi.org/10.18421/tem133-78
Bailey, S. K. T., Lewis, J. E., Ciccone, B. A., Friedland, R. L., & Reiner, C. C. (2022). Assessing Usability of Untethered Head-Mounted Displays for Medical Education. Simulation in Healthcare The Journal of the Society for Simulation in Healthcare, 18(1), 58–63. (35093978). https://doi.org/10.1097/sih.0000000000000637
Chakravarthi, B., M, P. P. B., Imandi, R., & N, P. K. B. (2023). A Comprehensive Review of Leap Motion Controller-Based Hand Gesture Datasets. 1–7. https://doi.org/10.1109/nelex59773.2023.10421030
Checa, D., Miguel-Alonso, I., & Bustillo, A. (2021). Immersive virtual-reality computer-assembly serious game to enhance autonomous learning. Virtual Reality, 27(4), 3301–3318. (34961808). https://doi.org/10.1007/s10055-021-00607-1
Criollo-C, S., Guerrero-Arias, A., Uzcátegui, J. E. C., Arif, Y. M., Fortuna, A., Prasetya, F., & Luján‐Mora, S. (2024). Improving Higher Education With the Use of Mobile Augmented Reality (MAR): A Case Study. IEEE Access, 12, 139003–139017. https://doi.org/10.1109/access.2024.3465833
Hardianto, H., Wahyuni, L., Rosnelly, R., Nasution, M. I. A., & Harahap, C. B. (2024). Computer Assembly Training at SMK Tritech Indonesia. Publikasi Pengabdian Masyarakat., 4(2), 173–185. https://doi.org/10.22303/publidimas.v4i2.395
Hidayatullah, R. S., Supardji, S., & Susila, I. W. (2024). Development of Digital Learning Simulators to Increase Vocational Students’ Prior Knowledge. TEM Journal, 1981–1988. https://doi.org/10.18421/tem133-26
Jamalian, N., Gillies, M., Leymarie, F. F., & Pan, X. (2022). The Effects of Hand Tracking on User Performance: An experimental study of an object selection based memory game. 768–776. https://doi.org/10.1109/ismar55827.2022.00095
Joshi, S. (2024). Controlling 3D Models in VR using Hand Gestures. International Journal for Research in Applied Science and Engineering Technology, 12(4), 1605–1609. https://doi.org/10.22214/ijraset.2024.60166
Kaushik, K. (2024). Hand Gestures for Personal Computer Control. International Journal for Research in Applied Science and Engineering Technology, 12(4), 5183–5192. https://doi.org/10.22214/ijraset.2024.60894
Maryati, T., Elmunsyah, H., & Sutadji, E. (2016). The Contribution of Teaching Skill and Learning Skill To The Competence Achievement of Computer Assembly in Public Vocational High School of Malang City. Journal of Education and Vocational Research, 7(3), 38–47. https://doi.org/10.22610/jevr.v7i3.1414
Mulders, M., Buchner, J., & Kerres, M. (2020). A Framework for the Use of Immersive Virtual Reality in Learning Environments. International Journal of Emerging Technologies in Learning (iJET), 15(24), 208–208. https://doi.org/10.3991/ijet.v15i24.16615
Naser, K. (2024). Tech-Enhanced Learning. International Journal of Interactive Mobile Technologies (iJIM), 18(6), 67–83. https://doi.org/10.3991/ijim.v18i06.46187
Olade, S. id_orcid 0000-0001-7158-1728. (2025). Exploring blending Virtual Reality and traditional lab instruction as a pedagogical tool: Early results from teaching PC Assembly. Research Portal (Queen’s University Belfast). https://pure.qub.ac.uk/en/publications/32b3d607-70cd-4a69-9d47-efec76b51fd5
Pieschacon, J. M., Costabile, M., Cunningham, A., Zucco, J., Itzstein, S. V., & Smith, R. (2024). Smart Pipette: Elevating Laboratory Performance With Tactile Authenticity and Real-Time Feedback. IEEE Transactions on Visualization and Computer Graphics, 31(9), 5788–5800. (39356603). https://doi.org/10.1109/tvcg.2024.3472837
Singh, G., & Ahmad, F. (2024). An interactive augmented reality framework to enhance the user experience and operational skills in electronics laboratories. Smart Learning Environments, 11(1). https://doi.org/10.1186/s40561-023-00287-1
Sırakaya, M., & Çakmak, E. K. (2018). Effects of Augmented Reality on Student Achievement and Self-Efficacy in Vocational Education and Training. International Journal for Research in Vocational Education and Training, 5(1), 1–18. https://doi.org/10.13152/ijrvet.5.1.1
Solmaz, S., Gerling, K., Kester, L., & Gerven, T. V. (2024). Behavioral intention, perception and user assessment in an immersive virtual reality environment with CFD simulations. Virtual Reality, 28(2). https://doi.org/10.1007/s10055-024-00985-2
Vuletic, T., Duffy, A., Hay, L., McTeague, C., Campbell, G., & Grealy, M. (2019). Systematic literature review of hand gestures used in human computer interaction interfaces. International Journal of Human-Computer Studies, 129, 74–94. https://doi.org/10.1016/j.ijhcs.2019.03.011
Yamtinah, S., VH, E. S., Saputro, S., Ariani, S. R. D., Shidiq, A. S., Sari, D. R., & Ilyasa, D. G. (2023). Augmented reality learning media based on tetrahedral chemical representation: How effective in learning process? Eurasia Journal of Mathematics Science and Technology Education, 19(8). https://doi.org/10.29333/ejmste/13436
