Assessment Instrument Development Competence among Pre-Service Language Tea-chers: Advancing Reflective Practice through Contextualized and Progressive Learning
Abstract
Assessment competence is critical for pre-service language teachers to construct valid, contextualized, and meaningful assessments that support advanced and responsive learning. This research assessed pre-service language teachers’ perception of assessment competence, the dimensions that comprise the construct and the role of reflection in bridging assessment theory and practice. Sequential explanatory mixed-method approach was used in this research in which 25 sixth-semester Language Education major students participated. Data on pre-service language teachers’ assessment competence were collected using a 10-item likert-scale questionnaire and analyzed using exploratory factor analysis and qualitative data on reflection in relation to the three dimensions were obtained from 10 interviews and analysis of 25 assessment rubrics. Although high levels of perceived competence were reported, substantial challenges remained in contextualizing assessment decisions and translating assessment knowledge into authentic learning situations. Three preliminary dimensions of assessment competence were identified: Evaluation Knowledge, Instrument Design Skills and Contextualization of Language Skills Assessment. It was also found out that there was a disparity between assessment knowledge and its implementation. Reflective practice emerged as a crucial mechanism for integrating these dimensions through contextualized, progressive, and practice-oriented learning experiences.
Full text article
References
Aalaa, M., Albakri, I. S. M. A., Singh, C. K. S., Hammed, H., Zaidan, A. A., Zaidan, B. B., … Jasim, A. N. (2019). Assessment and ranking framework for the English skills of pre-service teachers based on fuzzy Delphi and TOPSIS methods. IEEE Access, 7, 126201–126223.
Aini, S. W., & Mukhlis, M. (2022). Analisis taksonomi pada soal Asesmen Kompetensi Minimum literasi membaca di SMK Negeri 3 Pekanbaru. Diglosia: Jurnal Kajian Bahasa, Sastra, dan Pengajarannya, 5(4), 933–948. https://doi.org/10.30872/diglosia.v5i4.513
Amalia, F., Mustikawati, D., & Nuraeni, S. (2020). Reflective practice on lesson planning among EFL teacher educators. Indonesian Journal of Applied Linguistics, 10(1), 145–156. https://doi.org/10.17509/ijal.v10i1.23545
Angela, L., Handican, R., & Casanova, A. (2025). Linking belief to thought: A structural equation modeling analysis of self-efficacy and critical thinking among Indonesian pre-service teacher. Indonesian Journal on Learning and Advanced Education (IJOLAE), 393–410.
Anselmann, V. (2023). Promoting pre-service teachers reflections through critical incident training. Teaching and Teacher Education. https://doi.org/10.1016/j.tate.2022.103998
Ayubayeva, N., & McLaughlin, C. (2023). Action research as a school development approach: A systematic review. Educational Action Research, 31(2), 245–263. https://doi.org/10.1080/09650792.2022.2039254
Borg, S. (2023). Teacher cognition in language teaching. In C. J. Hall & R. Wicaksono (Eds.), The Routledge handbook of English language teaching (pp. 211–225).
Borg, S., & Edmett, A. (2019). Developing a self-assessment tool for English language teachers. Language Teaching Research, 23(5), 655–679.
Borromeo Ferri, R., & Greefrath, G. (2026). Enhancing pre-service teachers assessment competence through targeted training. Teaching and Teacher Education. https://doi.org/10.1016/j.tate.2025.104832
Braun, V., & Clarke, V. (2022). Conceptual and design thinking for thematic analysis. Qualitative Psychology, 9(1), 3–26. https://doi.org/10.1037/qup0000196
Cai, C., & Zheng, X. (2020). A sociocultural perspective on language teacher cognition: A review of the literature. Frontiers of Education in China, 15(3), 419–440. https://doi.org/10.1007/s11516-020-0021-2
Chen, J., Li, Z., & Zhang, J. (2026). Teacher cognition and its influence on practice: A systematic review of the last decade. Teaching and Teacher Education. https://doi.org/10.1016/j.tate.2026.104918
Cirocki, A., Anam, S., Drajati, N. A., & Soden, B. (2025). Assessment literacy among Indonesian pre-service English language teachers: A mixed-methods study. Iranian Journal of Language Teaching Research, 13(1), 23–44.
Cirocki, A., & Hallet, W. (2024). Reflective practice in English language teaching: A systematic review. Language Teaching Research, 28(1), 89–112. https://doi.org/10.1177/13621688231174523
Colwell, J., & Ince, C. (2021). Lesson study in initial teacher education: A systematic review. International Journal for Lesson and Learning Studies, 10(2), 143–158. https://doi.org/10.1108/IJLLS-11-2020-0093
Dy, A. S., & Sumayao, E. D. (2023). Influence of the pre-service teachers’ language proficiency to their teaching competence. AJELP: Asian Journal of English Language and Pedagogy, 11(1), 1–21.
Farmasari, S., Wardana, L. A., Herayana, D., & Suryaningsih, H. (2023). Pre-service EFL teachers' language assessment literacy satisfaction and assessment preparedness. International Journal of Language Education, 7(4), 646–660.
Giraldo, F., & Murcia, D. (2019). Language assessment literacy and the professional development of pre-service language teachers. Colombian Applied Linguistics Journal, 21(2), 243–259.
Guevarra, J. X. L., Bendicio, M. K. T., Aleroza, J. J., & Ilao, A. T. (2024). Assessment skills of pre-service teachers: Basis for the development of an assessment skills development guide. International Research Journal of Education and Technology, 6(7), 21–31.
Haerazi, H., S., Wandi, S., & Nurkamto, J. (2023). Diagnostic assessment in the Merdeka Curriculum: A case study of Indonesian language teachers. Indonesian Journal of Applied Linguistics, 12(3), 567–581. https://doi.org/10.17509/ijal.v12i3.56423
Hani, R. (2024). Reflective practice in assessment instrument development. Journal of Language Testing and Assessment, 41(1), 78–95. https://doi.org/10.1080/02602938.2023.2278845
Harmadi, F., Maryani, I., Sukirman, S., & Montano, E. C. N. (2025). Digital transformation: Exploring the relationship between literacy, motivation, and TPACK in elementary education. Indonesian Journal on Learning and Advanced Education (IJOLAE), 295–311.
Harizon, R., Putri, A., & Sari, D. (2023). Sequential explanatory design in language education research. Educational Methodology Review, 18(3), 212–229. https://doi.org/10.1080/1743727X.2023.2196789
Hasim, M., Yusop, F. D., & Adnan, M. (2025). Traditional versus innovative assessment practices in Malaysian language education. Assessment & Evaluation in Higher Education, 50(2), 156–173. https://doi.org/10.1080/02602938.2024.2391452
Hernández-López, E. M., Núñez-Mercado, P., & Bórquez-Morales, L. S. (2024). Assessing intercultural competence: The case of EFL pre-service teachers in the Mexican context. Journal of Intercultural Communication, 24(4), 84–96.
Hidayat, M. L., Abdurahman, S. G., Astuti, D. S., Prabawati, R., Anif, S., Hariyatmi, H., & Zannah, F. (2025). Pilot study of digital competency mapping of Indonesian preservice teachers: Rasch model analysis. Indonesian Journal on Learning and Advanced Education (IJOLAE), 100–116.
Hoang, L. P., Le, P. A., Le, H. T., Nguyen, D. T., Phan, T. C., Le, H. T., … Tran-Duong, Q. H. (2025). Evaluating educational assessment competence of pre-service teachers: Extended standards in the context of digital classroom assessment transformation. Education and Information Technologies, 30(12), 16347–16374.
Jamil, H. (2025). Formative assessment practices in Malay language speaking skills: Teachers’ feedback and implications for secondary education in Malaysia. Journal of Public Administration and Governance, 15(3), 1. https://doi.org/10.5296/jpag.v15i3.23475
Jia, Y., Oh, Y. J., Sibuma, B., LaBanca, F., & Lorentson, M. (2016). Measuring twenty-first century skills: Development and validation of a scale for in-service and pre-service teachers. Teacher Development, 20(2), 229–252.
Karacan, C. G., & Can, T. (2026). Assessing teacher digital competences in pre-service language teachers: Adaptation and validation of the DigCompEdu scale. Journal of Research on Technology in Education, 58(5), 1114–1133.
Kazakhykyzy, L., & Alagözlü, N. (2019). Developing and validating a scale to measure Turkish and Kazakhstani ELT pre-service teachers' intercultural communicative competence. International Journal of Instruction, 12(1), 931–946.
Kazaz, I., & Alagözlü, N. (2020). Evaluation of teaching practicum for pre-service English language teachers: A scale development study. Journal of Language and Linguistic Studies, 16(3), 1562–1593.
Köş, İ. E., & Celik, H. (2023). Global competence scale: An adaptation to measure pre-service English teachers’ global competences. International Journal of Assessment Tools in Education, 10(4), 813–838.
König, J., Bremerich-Vos, A., Buchholtz, C., Fladung, I., & Glutsch, N. (2020). Planning competence of pre-service German language teachers: Conceptualization, measurement, and validation. In Student learning in German higher education: Innovative measurement approaches and research results (pp. 53–74). Springer Fachmedien Wiesbaden.
Kurniawan, Y., Suryani, R., & Rahmawati, D. (2025). Portfolio-based assessment in English for Specific Purposes: A systematic review. English for Specific Purposes, 78, 34–49. https://doi.org/10.1016/j.esp.2024.10.003
Kusumaningtyas, D. A., Manyunu, M., Kurniasari, E., Awalin, A. N., Rahmaniati, R., & Febriyanti, A. (2024). Enhancing learning outcomes: A study on the development of higher order thinking skills based evaluation instruments for work and energy in high school physics. Indonesian Journal on Learning and Advanced Education (IJOLAE), 14–31.
Lázaro Cantabrana, J. L., Usart Rodríguez, M., & Gisbert Cervera, M. (2019). Assessing teacher digital competence: The construction of an instrument for measuring the knowledge of pre-service teachers. Journal of New Approaches in Educational Research, 8(1), 73–78.
Lazarević, N. (2018). Assessment of intercultural communicative competence in pre-service English language teachers: Challenges and practices. Nastava i Vaspitanje, 67(3), 471–487.
Leandro Cruz, J., & do Nascimento, N. (2020). Exploratory factor analysis for instrument validation in educational research. International Journal of Educational Methodology, 6(3), 523–534. https://doi.org/10.12973/ijem.6.3.523
Li, L. (2020). A sociocultural perspective on teacher cognition research: A review of the literature. Language Teaching Research, 24(3), 305–326. https://doi.org/10.1177/1362168818817369
Likita, A. J., et al. (2024). Strengthening mixed-methods research in education: A methodological review. Educational Researcher, 53(2), 89–104. https://doi.org/10.3102/0013189X231213456
Listeani, F. Y., Safi’i, I., & Ibrahim, N. (2021). Kelayakan instrumen evaluasi Buku Sekolah Elektronik (BSE) Bahasa Indonesia siswa SMA kelas XI. Diglosia: Jurnal Kajian Bahasa, Sastra, dan Pengajarannya, 4(3), 375–386. https://doi.org/10.30872/diglosia.v4i3.216
Lustyantie, N., Murtadho, F., Aceh, B., Pascasarjana, S., Jakarta, U. N., & Timur, J. (2025). Development of an assessment rubric for story writing skills in Indonesian integrated with Acehnese folklore for senior high school. Journal of Language Teaching and Learning, Linguistics and Literature, 4778, 1938–1946.
Marlina, L., Putri, D., & Wahyuni, S. (2023). Exploratory factor analysis for instrument validation in language education. International Journal of Educational Psychology, 12(2), 178–195. https://doi.org/10.17583/ijep.2023.10475
Mursyida, R., Nurhasanah, R., & Amri, Z. (2020). Training needs in reflective practice among Indonesian language teachers. Teacher Development, 24(3), 345–362. https://doi.org/10.1080/13664530.2020.1776922
Nguyen, H. T., Ngo, L. T., & Pham, T. H. (2026). E-portfolios for reflective practice in pre-service teacher education: A qualitative case study. Teaching and Teacher Education. https://doi.org/10.1016/j.tate.2025.104750
Nurhayati, Hardoko, & Warman. (2019). Pengembangan evaluasi pembelajaran tematik dengan menggunakan rubrik kelas IV di Gugus IV Kecamatan Samarinda Ulu. Diglosia: Jurnal Kajian Bahasa, Sastra, dan Pengajarannya, 2(1), 47–58. https://doi.org/10.30872/diglosia.v2i1.17
Ochoa, C., Giraldo, F., & Mosquera, R. (2024). Assessment instrument development competence in language teacher education. Language Assessment Quarterly, 21(3), 289–306. https://doi.org/10.1080/15434303.2024.2327891
Ölmezer-Öztürk, E., & Aydin, B. (2018). Toward measuring language teachers’ assessment knowledge: Development and validation of Language Assessment Knowledge Scale (LAKS). Language Testing in Asia, 8(1), 20.
Öztürk, E. Ö. (2021). Developing language assessment literacy of EFL pre-service teachers through classroom assessment course. International Journal of Contemporary Educational Research, 8(3), 13–22.
Racero Diz, A., & Canabal Guzmán, C. (2026). Teacher beliefs and instructional decision-making in contexts of structural vulnerability. Teaching and Teacher Education. https://doi.org/10.1016/j.tate.2026.104928
Rahmawati, D. (2023). Rubrics in writing assessment for secondary school students. Journal of Second Language Writing. https://doi.org/10.1016/j.jslw.2023.100953
Sumarni, S. (2023). Assessing digital competence among pre-service English language teachers: Strengths and weaknesses. Journal of English Education and Teaching, 7(3), 613–631.
Sutami, Hudiyono, Y., & Ilyas, M. (2020). Pengembangan instrumen asesmen higher order thinking skills (HOTS) pada mata pelajaran Bahasa Indonesia SMA dan SMK. Diglosia: Jurnal Kajian Bahasa, Sastra, dan Pengajarannya, 3(1), 102–113. https://doi.org/10.30872/diglosia.v3i1.24
Vetere, L. (2020). A Vygotskian approach to language teacher education: Joint mediated learning in concept development. Language Teaching Research, 24(5), 612–632. https://doi.org/10.1177/1362168820915678
Vogt, K., & Tsagari, D. (2020). Teacher training needs in language assessment literacy. Language Testing, 37(3), 345–367. https://doi.org/10.1177/0265532219879876
Vygotsky, L. (1980). Mind in society: The development of higher psychological processes (M. Cole, V. Jolm-Steiner, S. Scribner, & E. Souberman, Eds.). Harvard University Press. https://doi.org/10.2307/j.ctvjf9vz4
Wahyuni, S., & Arieffiani, M. (2022). Traditional assessment practices in Indonesian schools: A case study. Journal of Educational Practice, 13(2), 89–106. https://doi.org/10.1080/19415257.2022.2027891
Yüksel, H. G. (2014). Teachers of the future: Perceived teaching competences and visions of pre-service English language teachers. Journal of Human Sciences, 11(2), 27–39.
Zhang, D., & Wang, W. (2023). The current status and development of pre-service language teachers’ TLLT competence in a PjBL classroom. Cogent Education, 10(2), 2273174.
Authors
Copyright (c) 2026 Ariyana Ariyana, Soleh Ibrahim, Nakamura Kaito, Kim Ji-woo Kirana
This work is licensed under a Creative Commons Attribution 4.0 International License.