SisCek: A Deep Learning-Based Face Recognition System for Real-Time Exam Impersonation Detection
DOI:
https://doi.org/10.23917/saintek.v2i2.16998Keywords:
face recognition, deep learning, impersonation detection, examination system, artificial intelligenceAbstract
The digital transformation of educational assessment systems has accelerated the adoption of computer-based technologies; however, it still faces significant challenges related to security and identity verification of examination participants. One of the major issues is impersonation, where unauthorized individuals act as proxies during exams, thereby compromising academic integrity. This study aims to develop and evaluate SisCek (Sistem Pendeteksi Calo Ujian/ Exam Broker Detection System) based on face recognition and deep learning as a solution to automatically and in real time detect and prevent such practices. The research employs an experimental approach involving facial data collection, preprocessing, model training using a Convolutional Neural Network (CNN), and integrated system implementation. The evaluation is conducted using accuracy, False Acceptance Rate (FAR), and False Rejection Rate (FRR), as well as testing under real examination scenarios. The results show that the proposed model achieves an accuracy of 96.8%, with a FAR of 2.1% and an FRR of 3.4%. System-level testing demonstrates a detection success rate of 96% for both legitimate participants and impostors, with an average response time of 2.5 seconds, satisfying real-time system requirements. Comparative analysis indicates that SisCek outperforms conventional systems and previous studies, particularly in real-time impersonation detection and full integration with examination systems. This study provides a significant contribution to the development of AI-based examination security systems and has strong potential to enhance the integrity, fairness, and credibility of educational assessment in the digital era.
Downloads
References
[1] C. Chookhampaeng, C. Kamha, and S. Chookhampaeng, “Problems and Needs Assessment to Learning Management of Computational Thinking of Teachers at the Lower Secondary Level,” Journal of Curriculum and Teaching, vol. 12, no. 3, p. 172, May 2023, doi: 10.5430/jct.v12n3p172.
[2] L. M. Brevik, G. B. Gudmundsdottir, A. Lund, and T. A. Strømme, “Transformative agency in teacher education: Fostering professional digital competence,” Teach. Teach. Educ., vol. 86, p. 102875, Nov. 2019, doi: 10.1016/j.tate.2019.07.005.
[3] J. Nishchal, S. Reddy, and P. N. Navya, “Automated Cheating Detection in Exams using Posture and Emotion Analysis,” in 2020 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), IEEE, Jul. 2020, pp. 1–6. doi: 10.1109/CONECCT50063.2020.9198691.
[4] H. He, Q. Zheng, R. Li, and B. Dong, “Using Face Recognition to Detect ‘Ghost Writer’ Cheating in Examination,” 2019, pp. 389–397. doi: 10.1007/978-3-030-23712-7_54.
[5] M. Emara, N. M. Hutchins, S. Grover, C. Snyder, and G. Biswas, “Examining student regulation of collaborative, computational, problem-solving processes in openended learning environments,” Journal of Learning Analytics, vol. 8, no. 1, pp. 49–74, 2021, doi: 10.18608/JLA.2021.7230.
[6] S. Srivastava, V. K. Tripathi, S. Tripathi, A. Samy, M. Bhat, and A. Kumar, “Real-Time Social Media Sentiment Prediction Using BERT, CNN, and LSTM Techniques,” in 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI), IEEE, Mar. 2025, pp. 1–6. doi: 10.1109/IATMSI64286.2025.10985197.
[7] X. Sun, P. Wu, and S. C. H. Hoi, “Face detection using deep learning: An improved faster RCNN approach,” Neurocomputing, vol. 299, pp. 42–50, Jul. 2018, doi: 10.1016/j.neucom.2018.03.030.
[8] X. Sun, P. Wu, and S. C. H. Hoi, “Face detection using deep learning: An improved faster RCNN approach,” Neurocomputing, vol. 299, pp. 42–50, Jul. 2018, doi: 10.1016/j.neucom.2018.03.030.
[9] S. A. Putra, Z. Zainuddin, and M. Niswar, “Face Recognition in Mobile-Based Test Systems Using FaceNet,” in 2022 8th International Conference on Education and Technology (ICET), IEEE, Oct. 2022, pp. 107–111. doi: 10.1109/ICET56879.2022.9990684.
[10] Y. S. Baso et al., “Reducing Cheating in Online Exams Through the Proctor Test Model,” International Journal of Advanced Computer Science and Applications, vol. 14, no. 1, 2023, doi: 10.14569/IJACSA.2023.0140139.
[11] A. H. Putri, A. Samsudin, M. G. Purwanto, and A. Suhandi, “Examination of Conceptual Change Research Over A Decade: A Bibliometric Analysis Using Science Mapping Tool,” Indonesian Journal on Learning and Advanced Education (IJOLAE), vol. 4, no. 3, pp. 171–190, Sep. 2022, doi: 10.23917/ijolae.v4i3.18249.
[12] Z. Oberfield, “Unionization and Street-Level Bureaucracy: An Examination of Public School Teachers in the United States,” Rev. Public Pers. Adm., vol. 41, no. 3, pp. 419–446, Sep. 2021, doi: 10.1177/0734371X19894376.
[13] K. P. Waterman, L. Goldsmith, and M. Pasquale, “Integrating Computational Thinking into Elementary Science Curriculum: an Examination of Activities that Support Students’ Computational Thinking in the Service of Disciplinary Learning,” J. Sci. Educ. Technol., vol. 29, no. 1, pp. 53–64, Feb. 2020, doi: 10.1007/s10956-019-09801-y.
[14] K. Zhang, W. Zuo, Y. Chen, D. Meng, and L. Zhang, “Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising,” IEEE Transactions on Image Processing, vol. 26, no. 7, pp. 3142–3155, Jul. 2017, doi: 10.1109/TIP.2017.2662206.
[15] G. Yang et al., “Face Mask Recognition System with YOLOV5 Based on Image Recognition,” in 2020 IEEE 6th International Conference on Computer and Communications (ICCC), IEEE, Dec. 2020, pp. 1398–1404. doi: 10.1109/ICCC51575.2020.9345042.
[16] T.-Y. Zhang and D. Ye, “False data injection attacks with complete stealthiness in cyber–physical systems: A self-generated approach,” Automatica, vol. 120, p. 109117, Oct. 2020, doi: 10.1016/j.automatica.2020.109117.
[17] R. Vijayakumar, M. Poornima, S. Divyapriya, and T. Selvaganapathi, “Automated Student Attendance Tracker for End Semester Examination using Face Recognition System,” in 2022 3rd International Conference on Smart Electronics and Communication (ICOSEC), IEEE, Oct. 2022, pp. 1566–1570. doi: 10.1109/ICOSEC54921.2022.9952035.
[18] T. Valtonen et al., “Examining pre‐service teachers’ Technological Pedagogical Content Knowledge as evolving knowledge domains: A longitudinal approach,” J. Comput. Assist. Learn., vol. 35, no. 4, pp. 491–502, Aug. 2019, doi: 10.1111/jcal.12353.
[19] A. H. S. Ganidisastra and Y. Bandung, “An Incremental Training on Deep Learning Face Recognition for M-Learning Online Exam Proctoring,” in 2021 IEEE Asia Pacific Conference on Wireless and Mobile (APWiMob), IEEE, Apr. 2021, pp. 213–219. doi: 10.1109/APWiMob51111.2021.9435232.
[20] L. Khan, A. Amjad, K. M. Afaq, and H.-T. Chang, “Deep Sentiment Analysis Using CNN-LSTM Architecture of English and Roman Urdu Text Shared in Social Media,” Applied Sciences, vol. 12, no. 5, p. 2694, Mar. 2022, doi: 10.3390/app12052694.
[21] P. S., K. Krithivasan, P. S., and S. Sriram V.S., “Detection of Cyberattacks in Industrial Control Systems Using Enhanced Principal Component Analysis and Hypergraph-Based Convolution Neural Network (EPCA-HG-CNN),” IEEE Trans. Ind. Appl., vol. 56, no. 4, pp. 4394–4404, Jul. 2020, doi: 10.1109/TIA.2020.2977872.
[22] N. Zeng, H. Zhang, B. Song, W. Liu, Y. Li, and A. M. Dobaie, “Facial expression recognition via learning deep sparse autoencoders,” Neurocomputing, vol. 273, pp. 643–649, Jan. 2018, doi: 10.1016/j.neucom.2017.08.043.
[23] G. Guo and N. Zhang, “A survey on deep learning based face recognition,” Computer Vision and Image Understanding, vol. 189, p. 102805, Dec. 2019, doi: 10.1016/j.cviu.2019.102805.
[24] E. Pranav, S. Kamal, C. Satheesh Chandran, and M. H. Supriya, “Facial Emotion Recognition Using Deep Convolutional Neural Network,” in 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), IEEE, Mar. 2020, pp. 317–320. doi: 10.1109/ICACCS48705.2020.9074302.
[25] F. Santoso and A. Finn, “A Data-Driven Cyber–Physical System Using Deep-Learning Convolutional Neural Networks: Study on False-Data Injection Attacks in an Unmanned Ground Vehicle Under Fault-Tolerant Conditions,” IEEE Trans. Syst. Man Cybern. Syst., vol. 53, no. 1, pp. 346–356, Jan. 2023, doi: 10.1109/TSMC.2022.3170071.
[26] M. M. Masud, K. Hayawi, S. S. Mathew, T. Michael, and M. El Barachi, “Smart Online Exam Proctoring Assist for Cheating Detection,” 2022, pp. 118–132. doi: 10.1007/978-3-030-95405-5_9.
[27] J. Deng, J. Guo, J. Yang, N. Xue, I. Kotsia, and S. Zafeiriou, “ArcFace: Additive Angular Margin Loss for Deep Face Recognition,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 10, pp. 5962–5979, Oct. 2022, doi: 10.1109/TPAMI.2021.3087709.
[28] I. S. Jenset, K. Klette, and K. Hammerness, “Grounding Teacher Education in Practice Around the World: An Examination of Teacher Education Coursework in Teacher Education Programs in Finland, Norway, and the United States,” J. Teach. Educ., vol. 69, no. 2, pp. 184–197, Mar. 2018, doi: 10.1177/0022487117728248.
[29] F. Kamalov, D. Santandreu Calonge, and I. Gurrib, “New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution,” Sustainability, vol. 15, no. 16, p. 12451, Aug. 2023, doi: 10.3390/su151612451.
[30] P. Wang, K. Coetzee, A. Strachan, S. Monteiro, and L. Cheng, “Examining Rater Performance on the CELBAN Speaking: A Many-Facets Rasch Measurement Analysis,” Canadian Journal of Applied Linguistics, vol. 23, no. 2, pp. 73–95, Oct. 2020, doi: 10.37213/cjal.2020.30436.
[31] L. Hsu and Y.-J. Chen, “Examining teachers’ technological pedagogical and content knowledge in the era of cloud pedagogy,” S. Afr. J. Educ., vol. 39, no. S2, pp. 1–13, Dec. 2019, doi: 10.15700/saje.v39ns2a1572.
[32] G. Cooper, “Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence,” J. Sci. Educ. Technol., vol. 32, no. 3, pp. 444–452, Jun. 2023, doi: 10.1007/s10956-023-10039-y.
[33] C. Dharanya, N. Saravanan, T. Hemalatha, K. Dinesh, and M. Jagan, “Face Recognition For Exam Hall Seating Arrangement Using Deep Learning Algorithm,” in 2024 4th International Conference on Pervasive Computing and Social Networking (ICPCSN), IEEE, May 2024, pp. 130–133. doi: 10.1109/ICPCSN62568.2024.00030.
[34] A. Bucciol, S. Cicognani, and N. Montinari, “Cheating in university exams: the relevance of social factors,” Int. Rev. Econ., vol. 67, no. 3, pp. 319–338, Sep. 2020, doi: 10.1007/s12232-019-00343-8.
[35] P. J. Phillips et al., “Face recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms,” Proceedings of the National Academy of Sciences, vol. 115, no. 24, pp. 6171–6176, Jun. 2018, doi: 10.1073/pnas.1721355115.
[36] A. Chirumamilla, G. Sindre, and A. Nguyen-Duc, “Cheating in e-exams and paper exams: the perceptions of engineering students and teachers in Norway,” Assess. Eval. High. Educ., vol. 45, no. 7, pp. 940–957, Oct. 2020, doi: 10.1080/02602938.2020.1719975.
Downloads
Submitted
Accepted
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Shandy Yusril Fadlullah, Afifah Nur Hidayah, Yuanda Eka Saputra, Uslan, Santosa Pradana Putra Setya Negara
This work is licensed under a Creative Commons Attribution 4.0 International License.
