Automatic Assessment- Based Artificial Intellegent to Measure Students Environmental Literacy
DOI:
https://doi.org/10.23917/ijolae.v7i3.11240Keywords:
AI-based assessment, automatic assessment-based artificial intelligence, contextual learning, critical thinking skills, cultural sustainability, environmental literacy, sustainable development goalsAbstract
There is a need to measure the environmental literacy of secondary school students to promote awareness of environmental issues and provide sustainable solutions. Environmental literacy assessment is done using the UNESCO Criteria on Education and Culture Sustainable Development (ECSD). This study aimed to develop an automatic evaluation based on Artificial Intelligence (AABAI) to measure students’ environmental literacy in science subjects and environmental issues topics. This study uses the ADDIE development model, which includes analysis, design, development, implementation, and evaluation stages. The data were examined through both quantitative and qualitative approaches using Item Response Theory (IRT). Content validity of the AABAI instrument was confirmed through Aiken’s V analysis, indicating acceptable validity levels. All test items were deemed valid based on the Rasch model, considering item fit and difficulty parameters. The AABAI instrument has been implemented in educational settings and has successfully provided a comprehensive overview of junior high school students’ environmental literacy profiles. The use of AABAI as a transformative assessment can ensure that students care more about the environment and maintain environmental sustainability.
Downloads
References
Afriansyah, A., & Sukmayadi, T. (2022). Nilai kearifan lokal tradisi sedekah laut dalam meningkatkan semangat gotong royong masyarakat pesisir Pantai Pela-buhan Ratu. Jurnal Penelitian Ilmu-Ilmu Sosial, 3(1), 38-54.
Aiken, L.R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurument, 45(1), 131-142. doi: http://doi.org/10.1177/0013164485451012.
Akbar, M., & Maghfira, A. (2023). Pengaruh Sampah Plastik Dalam Pencemaran Air Laut Di Kota Makassar. Riset Sains Dan Teknologi Kelautan, 6(1), 25–29. https://doi.org/10.62012/sensistek.v6i1.24234
Ali, Z., Bhar, S. K., Abd Majid, S. N., & Masturi, S. Z. (2025). Exploring Student Beliefs: Does Interaction with AI Language Tools Correlate with Perceived English Learning Improvements? Education Sciences, 15(5), 1–18. https://doi.org/10.3390/educsci15050522
Aliviyanti, D., Kasitowati, R. D., Yona, D., Semedi, B., Rudianto, R., Asadi, M. A., ... & Dewi, C. S. U. (2022). Edukasi Bahaya Sampah Plastik pada Perairan dan Biota Laut di Sekolah Alam, Pantai Bajulmati, Kabupaten Malang, Jawa Timur. Abdi Geomedisains, 119-129.
Ariyatun, A., Sudarmin, S., Wardani, S., Saptono, S., & Winarto, W. (2024). Bibliometric Analysis of Environmental Literacy in Sustainable Development: A Comprehensive Review Based on Scopus Data From 2013 to 2023. International Journal of Educational Methodology, volume-10-(volume-10-issue-1-february-2024), 179–195. https://doi.org/10.12973/ijem.10.1.979
Aryanti, F., Surtikanti, H., & Riandi, R. (2017). Penerapan Problem Based Learning (PBL) berbantuan Teknologi Informasi dan Komunikasi untuk Meningkatkan Kemampuan Berpikir Kritis Siswa Pada Konsep Pencemaran Lingkungan. BIOSFER : Jurnal Biologi Dan Pendidikan Biologi, 2(1), 14–20. https://doi.org/10.23969/biosfer.v2i1.370
Awang, L. A., Yusop, F. D., & Danaee, M. (2024). Insights on usability testing: The effectiveness of an adaptive e-learning system for secondary school mathematics. International Electronic Journal of Mathematics Education, 19(3). https://doi.org/10.29333/iejme/14621
Azwar, S. (2015). Reliability and Validity (fourth). Pustaka Pelajar.
Blodgett, S. L., Barocas, S., Daumé, H., & Wallach, H. (2020). Language (Technology) is Power: A Critical Survey of “Bias” in NLP. Proceedings of the Annual Meeting of the Association for Computational Linguistics, c, 5454–5476. https://doi.org/10.18653/v1/2020.acl-main.485
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge.
Branch, Robert Maribe. (2009). Instructional Design: The ADDIE Approach.” New York: Springer.
Cui, W., Xue, Z., & Thai, K. P. (2018). Performance Comparison of an AI-Based Adaptive Learning System in China. Proceedings 2018 Chinese Automation Congress, CAC 2018, 3170–3175. https://doi.org/10.1109/CAC.2018.8623327
Dwiyanti Suryono, D. (2019). Sampah Plastik di Perairan Pesisir dan Laut : Implikasi Kepada Ekosistem Pesisir Dki Jakarta. Jurnal Riset Jakarta, 12(1), 17–23. https://doi.org/10.37439/jurnaldrd.v12i1.2
Ferrara, E. (2024). Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies. Sci, 6(1). https://doi.org/10.3390/sci6010003
García-Ceberino, J. M., Antúnez, A., Ibáñez, S. J., & Feu, S. (2020). Design and validation of the instrument for the measurement of learning and performance in football. International Journal of Environmental Research and Public Health, 17(13), 1–22. https://doi.org/10.3390/ijerph17134629
George, D., & Mallery, P. (2020). IBM SPSS Statistics 26 Step by Step: A Simple Guide and Reference (Sixteenth).” Routledge. https://doi.org/10.4324/9780429056765
Gligorea, I., Cioca, M., Oancea, R., Gorski, A. T., Gorski, H., & Tudorache, P. (2023). Adaptive Learning Using Artificial Intelligence in e-Learning: A Literature Review. Education Sciences, 13(12). https://doi.org/10.3390/educsci13121216
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021). Artificial intelligence for student assessment: A systematic review. Applied Sciences (Switzerland), 11(12). https://doi.org/10.3390/app11125467
Hambleton, R. K., & Swaminathan, H. (1985). Items Response Theory: Princi-ples and Application. Kluwer-Nijjhoff Publish.
Hamid, T., Chhabra, M., Ravulakollu, K., Singh, P., Dalal, S., & Dewan, R. (2022). A Review on Artificial Intelligence in Orthopaedics. Proceedings of the 2022 9th International Conference on Computing for Sustainable Global Development, INDIACom 2022, 365–369. https://doi.org/10.23919/INDIACom54597.2022.9763178
Handiyati, T., Qomariyah, S., & Kurniawan, J. (2023). Peran Pembelajaran Berbasis Lingkungan Dalam Meningkatkan Pemahaman Peserta Didik Di MI Cimahi Peuntas Kabupaten Sukabumi. Jurnal Pendidikan Karakter, 1(4), 108–140. https://doi.org/10.2307/j.ctv1nth4c.13
Hohn, S; Acevedos-Trejos, E; Abrams, J. et al. (2013). The long-term legacy of plastic mass production. Journal of Cleaner Production, 0–48.
Hungerford, H. R., & Peyton, R. Ben. (1976). A Paradigm of Environmental Action. Department Health Education.
Husamah, H., Rahardjanto, A., Hadi, S., Lestari, N., & Ummah BK, M. K. (2023). Spirituality-based environmental literacy among prospective biology teacher in Indonesia: Analysis based on gender, accreditation, and semester-level aspects. JPBI (Jurnal Pendidikan Biologi Indonesia), 9(3), 418–432. https://doi.org/10.22219/jpbi.v9i3.29500
Jambeck, J. R., Geyer, R., Wilcox, C., Siegler, T. R., Perryman, M., Andrady, A., Narayan, R., & Law, K. L. (2015). Plastic waste inputs from land into the ocean. Science, 347(6223), 768–771. https://doi.org/10.1126/science.1260352
Kahn, R. (2008). From Education for Sustainable Development to Ecopedagogy: Sustaining Capitalism or Sustaining Life? Green Theory & Praxis: The Journal of Ecopedagogy, 4(1), 1–14. https://doi.org/10.3903/gtp.2008.1.2
Krstić, L., Aleksić, V., & Krstić, M. (2022). Artificial Intelligence in Education: A Review. Technics and Informatics in Education – TIE 2022, September, 223–228. https://doi.org/10.46793/tie22.223k
Law, K. L., Starr, N., Siegler, T. R., Jambeck, J. R., Mallos, N. J., & Leonard, G. H. (2020). The United States’ contribution of plastic waste to land and ocean. Science Advances, 6(44), 1–7. https://doi.org/10.1126/sciadv.abd0288
Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2019). Intelligence unleashed: an argument for AI in education. Resource document (Issue October).
Mardapi, D. (2008). Teknik Penyusunan Ins-trumen Tes dan Non Tes. Yogyakarta: Mitra Cendekia.
Masrobi, Intan Valentina, Widodo Casraji Putra, Umi Hanni, Maulidiyanto, & Gusman, T. A. (2022). Upaya Meningkatkan Kesadaran Masyarakat Terhadap Pentingnya Kebersihan Pantai Sarwajala. BAKTIMU : Jurnal Pengabdian Kepada Masyarakat, 2(2), 87–94. https://doi.org/10.37874/bm.v2i2.375
McBeth, B., Hungerford, H., Marcinkowski, T., Volk, T., & ... (2011). National Environmental Literacy Assessment, Phase Two: Measuring the Effectiveness of North American Environmental Education Programs with Respect to the Parameters of Environmental Literacy. NOAA and NAAEE ….
Memarian, B., & Doleck, T. (2024). A review of assessment for learning with artificial intelligence. Computers in Human Behavior: Artificial Humans, 2(1), 100040. https://doi.org/10.1016/j.chbah.2023.100040
Mistiani, W., Istiyono, E., & Syamsudin, A. (2022). European Journal of Educational Research. European Journal of Educational Research, 11(1), 69–81. https://pdf.eu-jer.com/EU-JER_9_1_395.pdf
Oriondo, L. L., Dallo-Antonio, E. M. (1984). Evaluating Educational Outcomes (Test, Measurement, and Evaluation) (5th Editio). REX Printing Company, Inc, 279-280.
Örs, M. (2022). A Measurement of the Environmental Literacy of Nursing Students for a Sustainable Environment. Sustainability (Switzerland), 14(17). https://doi.org/10.3390/su141711003
Piaget, J. (1972). The psychology of the child. New York: Basic Books.
Puspita, M. (2017). Kearifan Lokal dalam Pengelolaan Sumberdaya Pesisir dan Laut: Hukum Adat Laot dan Lembaga Panglima Laot di Nanggroe Aceh Darussalam. Sabda : Jurnal Kajian Kebudayaan, 3(2). https://doi.org/10.14710/sabda.v3i2.13253
Putra, H., & Dupuy, K. F. P. (2023). Strategi Coastal Zone Management pada Pengurangan Sampah Plastik Sesuai ke SDGs Ke 14 Ekosistem laut di Wilayah Pesisr DKI Jakarta. Riset Sains Dan Teknologi Kelautan, 6(2), 178–182. https://doi.org/10.62012/sensistek.v6i2.31701
Salleh, S. M., & Ong, E. T. (2019). The Development and Validation of an Instrument to Measure Higher Order Thinking Skills. Journal of Advanced Research in Dynamical and Control Systems, 11(8 Special Issue), 150–162. https://doi.org/10.36681/tused.2025.004
Samidjo, G. S., Widodo, A. S., Kusumastuti, L., & Suryadin, A. (2023). Literasi Lingkungan melalui Pendidikan di MTs Muhammadiyah Gantung Belitung Timur, Bangka Belitung. Warta LPM, 184-196.
Santosa, R., Roshayanti, F., & Siswanto, J. (2021). Analisis Literasi Lingkungan Siswa SMP. JPPS (Jurnal Penelitian Pendidikan Sains), 10(02), 1976–1982.
Subali, B. (2015). Pengukuran Kreativitas Keterampilan Proses Sains Dalam Konteks Assessment for Learning. Jurnal Cakrawala Pendidikan, 1(1), 130–144. https://doi.org/10.21831/cp.v1i1.4196
Sumadi, C. D., Mulyani, S., & ES, W. A. (2015). Pengembangan Media Game Senyawa Hidrokarbon Pada Pembelajaran Kimia Di Sma Batik 1 Surakarta Dan Sma Batik 2 Surakarta. Jurnal Pendidikan Kimia , 4(2), 82–88.
Syahmani, S., Hafizah, E., Sauqina, S., Adnan, M. Bin, & Ibrahim, M. H. (2021). STEAM Approach to Improve Environmental Education Innovation and Literacy in Waste Management: Bibliometric Research. Indonesian Journal on Learning and Advanced Education (IJOLAE), 3(2), 130–141. https://doi.org/10.23917/ijolae.v3i2.12782
Szczytko, R., Stevenson, K., Peterson, M. N., Nietfeld, J., & Strnad, R. L. (2019). Development and validation of the environmental literacy instrument for adolescents. Environmental Education Research, 25(2), 193–210. https://doi.org/10.1080/13504622.2018.1487035
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Cambridge, MA: Harvard University Press.
Wang, S., Wang, F., Zhu, Z., Wang, J., Tran, T., & Du, Z. (2024). Artificial intelligence in education: A systematic literature review. Expert Systems with Applications, 252(PA), 124167. https://doi.org/10.1016/j.eswa.2024.124167
Widarmanto, N. (2018). Kearifan Lokal dalam Pengelolaan Sumberdaya Perikanan. Sabda : Jurnal Kajian Kebudayaan, 13(1), 18–26.
Williamson, B., & Eynon, R. (2020). Historical threads, missing links, and future directions in AI in education. Learning, Media and Technology, 45(3), 223–235. https://doi.org/10.1080/17439884.2020.1798995
Yaacoub, A., & Prevost, L. (2025). Analyzing Feedback Mechanisms in AI-Generated MCQs : Insights into Readability , Lexical Properties , and Levels of Challenge. Proceedings of the 9th International Conference on Computer, Software and Modeling (ICCSM).
Zhai, X., Chu, X., Chai, C. S., Jong, M. S. Y., Istenic, A., Spector, M., Liu, J. B., Yuan, J., & Li, Y. (2021). A Review of Artificial Intelligence (AI) in Education from 2010 to 2020. Complexity, 2021. https://doi.org/10.1155/2021/8812542
Submitted
Accepted
Published
Issue
Section
License
Copyright (c) 2025 Fitri April Yanti, Rendy Wikrama Wardana, Buyung Buyung, Elza Heryensi, Noorzana Khamis
This work is licensed under a Creative Commons Attribution 4.0 International License.
