The Landscape of Textbook Evaluation Research: A Bibliometric Analysis of Changing Media and Evaluative Approaches
DOI:
https://doi.org/10.23917/varidika.v38i3.14474Keywords:
textbook, textbook evaluation, bibliometric, digital textbookAbstract
This study aims to describe performance analysis and co-occurance analysis of “textbook evaluation” keywords based on bibliographic analysis. This research uses quantitative descriptive methods in the form of bibliometric analysis that used the Vosviewer application as the data processor and conducts using the PRISMA method. Research articles collected on the Scopus with a publication period of the last 12 years, from 2013 to 2025. The results of research based on (a) performance analysis and (b) the conceptual structure of the research based on the relationship between keywords The data analysis showed that medical science and language science were the two most researched subjects. Furthermore, from the research findings, it can be concluded that the research trend with textbook evaluation topic has two major themes; textbook content analysis and digital textbooks. The future researchers suggest examining the content of textbooks with changes in students' skills and/or attitudes or evaluating the content of textbooks with a particular learning approach. In terms of digital textbook topics, the development of digital textbooks that utilize the latest technology and the utilization of textbook evaluation is still very possible to be observed.
Downloads
References
Abed, E. R., & Al-Absi, M. M. (2015). Content analysis of jordanian elementary textbooks during 1970-2013 as case study. International Education Studies, 8(3), 159–166. https://doi.org/10.5539/ies.v8n3p159
Alimorad, Z. (2016). Cultural Values Represented in First Certificate Masterclass Taught in Iran: Uncovering the Hidden Curriculum. SAGE Open, 6(1). https://doi.org/10.1177/2158244016636431
Alpizar-Chacon, I., & Sosnovsky, S. (2021). Knowledge models from PDF textbooks. New Review of Hypermedia and Multimedia, 27(1–2), 128–176. https://doi.org/10.1080/13614568.2021.1889692
Amerian, M., & Pouromid, S. (2018). Language teachers’ beliefs on materials use and their locus of control: Case-studies from Iran and Japan. Indonesian Journal of Applied Linguistics, 7(3), 583–593. https://doi.org/10.17509/ijal.v7i3.9808
Amiri, A., & Rezvani, R. (2021). A tale of three official english textbooks: An evaluation oftheir horizontal and vertical alignments. Language Related Research, 12(3), 51–79. https://doi.org/10.29252/LRR.12.3.3
Asai, T., Honda, R., Watanabe, K., & Ozasa, T. (2020). A correspondence analysis of fifty-five japanese historical first-to fifth-year english-as-a-foreign-language textbooks. International Journal of Learning, Teaching and Educational Research, 19(4), 223–247. https://doi.org/10.26803/ijlter.19.4.14
Bhatti, I., Jones, K., Richardson, L., Foreman, D., Lund, J., & Tierney, G. (2011). E-learning vs lecture: Which is the best approach to surgical teaching? Colorectal Disease, 13(4), 459–462. https://doi.org/10.1111/j.1463-1318.2009.02173.x
Blazar, D., Heller, B., Kane, T., Polikoff, M., Staiger, D., Carrell, S., & Kurlaender, M. (2019). Learning by the Book. … Development in Early Childhood: Sources of …, March.
Bogaerds-Hazenberg, S. T. M., Evers-Vermeul, J., & van den Bergh, H. (2022). What textbooks offer and what teachers teach: an analysis of the Dutch reading comprehension curriculum. Reading and Writing, 35(7), 1497–1523. https://doi.org/10.1007/s11145-021-10244-4
Boonroungrut, C., Saroinsong, W. P., & Thamdee, N. (2022). Research on students in covid-19 pandemic outbreaks: A bibliometric network analysis. International Journal of Instruction, 15(1), 457–472. https://doi.org/10.29333/iji.2022.15126a
Bremholm, J. (2020). Evaluating textbooks for primary grade reading instruction A usable heuristic for L1 education. L1 Educational Studies in Language and Literature, 20(20), 1–21. https://doi.org/10.17239/L1ESLL-2020.20.02.01
Brown, S. (2016). Young Learners’ Transactions With Interactive Digital Texts Using E-Readers. Journal of Research in Childhood Education, 30(1), 42–56. https://doi.org/10.1080/02568543.2015.1105887
Bullock, A., Dimond, R., Webb, K., Lovatt, J., Hardyman, W., & Stacey, M. (2015). How a mobile app supports the learning and practice of newly qualified doctors in the UK: An intervention study. BMC Medical Education, 15(1), 1–6. https://doi.org/10.1186/s12909-015-0356-8
Çağlayan Akay, E., Yılmaz Soydan, N. T., & Kocarık Gacar, B. (2022). Bibliometric analysis of the published literature on machine learning in economics and econometrics. Social Network Analysis and Mining, 12(1). https://doi.org/10.1007/s13278-022-00916-6
Calafato, R., & Gudim, F. (2022). Literature in contemporary foreign language school textbooks in Russia: Content, approaches, and readability. Language Teaching Research, 26(5), 826–846. https://doi.org/10.1177/1362168820917909
Chakraborty, D., & Kidman, G. (2021). Inquiry Process Skills in Primary Science Textbooks: Authors and Publishers’ Intentions. Research in Science Education, 1419–1433. https://doi.org/10.1007/s11165-021-09996-4
Dabbagh, A., & Atai, M. R. (2022). Exploring Cultural Conceptualisations and Metacultural Competence in Local EAP Textbooks: A Semiotic Approach. Journal of Asia TEFL, 19(1), 141–162. https://doi.org/10.18823/asiatefl.2022.19.1.9.141
Ding, Y., Rousseau, R., & Wolfram, D. (2017). Measuring Scholarly Impact. In Representing Scientific Knowledge. https://doi.org/10.1007/978-3-319-62543-0_4
Dockx, J., Bellens, K., & Fraine, B. De. (2020). Do Textbooks Matter for Reading Comprehension ? A Study in Flemish Primary Education. Frontiers in Psychology, 10(January), 1–19. https://doi.org/10.3389/fpsyg.2019.02959
Donthu, N., Kumar, S., & Pattnaik, D. (2020). Forty-five years of Journal of Business Research: A bibliometric analysis. Journal of Business Research, 109(October 2019), 1–14. https://doi.org/10.1016/j.jbusres.2019.10.039
Fahimnia, B., Sarkis, J., & Davarzani, H. (2015). Green supply chain management: A review and bibliometric analysis. In International Journal of Production Economics (Vol. 162). Elsevier. https://doi.org/10.1016/j.ijpe.2015.01.003
Fahmi, F., Pratolo, B. W., & Abbas, A. (2022). The core aspects of teacher’s book content: An analysis on teacher’s needs. International Journal of Evaluation and Research in Education, 11(3), 1575–1584. https://doi.org/10.11591/ijere.v11i3.22370
Fallucchi, F., Ghattas, B., Spielhaus, R., & De Luca, E. W. (2022). Digital Qualitative and Quantitative Analysis of Arabic Textbooks. Future Internet, 14(8), 1–14. https://doi.org/10.3390/fi14080237
Farashaiyan, A., Tan, K. H., & Sahragard, R. (2018). An evaluation of the pragmatics in the “cutting edge” intermediate textbooks. 3L: Language, Linguistics, Literature, 24(4), 158–170. https://doi.org/10.17576/3L-2018-2404-12
Fayyazi, M. S., & Pirloojeh, H. S. (2020). A content analysis of the elementary school farsi reading and writing textbooks from frame semantics’ point of view. Language Related Research, 11(4), 211–240.
Garad, A., Al-Ansi, A. M., & Qamari, I. N. (2021). The role of e-learning infrastructure and cognitive competence in distance learning effectiveness during the covid-19 pandemic. Cakrawala Pendidikan, 40(1), 81–91. https://doi.org/10.21831/cp.v40i1.33474
Garg, K. C., & Singh, R. K. (2022). A Bibliometric Study of Papers Published in Library and Information Science Research during 1994-2020. DESIDOC Journal of Library and Information Technology, 42(1), 57–63. https://doi.org/10.14429/DJLIT.42.1.17480
Gedik Bal, N. (2020). Students’ and instructors’ evaluation of a foreign language textbook from an intercultural perspective. Journal of Language and Linguistic Studies, 16(4), 2023–2038. www.jlls.org
Ghorbanchian, E., Youhanaee, M., & Barati, H. (2014). A study of Iranian high school English textbooks based on the standard criteria. Theory and Practice in Language Studies, 4(2), 411–422. https://doi.org/10.4304/tpls.4.2.411-422
Ghosh, K. (2022). Remediating textbook deficiencies by leveraging community question answers. Education and Information Technologies, 27(7), 10065–10105. https://doi.org/10.1007/s10639-022-10937-5
Guerrero-Alcedo, J. M., Espina-Romero, L. C., & Nava-Chirinos, Á. A. (2022). Gamification in the University Context: Bibliometric Review in Scopus (2012-2022). International Journal of Learning, Teaching and Educational Research, 21(5), 309–325. https://doi.org/10.26803/ijlter.21.5.16
Gunawan, B., Ratmono, B. M., Abdullah, A. G., Sadida, N., & Kaprisma, H. (2022). Research Mapping in the Use of Technology for Fake News Detection: Bibliometric Analysis from 2011 to 2021. Indonesian Journal of Science and Technology, 7(3), 471–496. https://doi.org/10.17509/ijost.v7i3.51449
Hardyman, W., Bullock, A., Brown, A., Carter-Ingram, S., & Stacey, M. (2013). Mobile technology supporting trainee doctors’ workplace learning and patient care: An evaluation. BMC Medical Education, 13(1). https://doi.org/10.1186/1472-6920-13-6
Harms, M. (2009). The EQUATOR network and the PRISMA statement for the reporting of systematic reviews and meta-analyses. Physiotherapy, 95(4), 237–240. https://doi.org/10.1016/j.physio.2009.10.001
Hoffer, N., Lex, S., & Simon, U. K. (2022). Virology in Schoolbooks—A Comprehensive Analysis of Austrian Biology Textbooks for Secondary School and Implications for Improvement. Sustainability (Switzerland), 14(18). https://doi.org/10.3390/su141811562
Indarti, N., Jie, F., & Setyaningsih, I. (2018). Bibliometric analysis of the term “green manufacturing.” International Journal of Management Concepts and Philosophy, 11(3), 315. https://doi.org/10.1504/ijmcp.2018.10014233
Jesson, J., Matheson, L., & Lacey, F. M. (2011). Doing Your Literature Review - Traditional and Systematic Techniques. Sage.
Ji, Q. (2022). Readability Evaluation of Books in Chinese as a Foreign Language Using the Machine Learning Algorithm. Mobile Information Systems, 2022. https://doi.org/10.1155/2022/5957566
Maleki, A., Mollaee, F., & Khosravi, R. (2014). A content evaluation of Iranian pre-university ELT textbook. Theory and Practice in Language Studies, 4(5), 995–1000. https://doi.org/10.4304/tpls.4.5.995-1000
Mardasari, O. R., Susilowati, N. E., Luciandika, A., Minerva, P., & Yanhua, Z. (2022). New Designed Technology-Based Textbook of Indonesian for Foreign Speakers (BIPA). Journal of Higher Education Theory and Practice, 22(8), 105–113. https://doi.org/10.33423/jhetp.v22i8.5326
Martínez-Heredia, N., González-Gijón, G., Soriano Díaz, A., & Amaro Agudo, A. (2021). Dating Violence: A Bibliometric Review of the Literature in Web of Science and Scopus. Social Sciences, 10(11), 445. https://doi.org/10.3390/socsci10110445
Muhammad, U. A., Fuad, M., Ariyani, F., & Suyanto, E. (2022). Bibliometric analysis of local wisdom-based learning: Direction for future history education research. International Journal of Evaluation and Research in Education (IJERE), 11(4), 2209. https://doi.org/10.11591/ijere.v11i4.23547
Muktiani, N. R., Soegiyanto, Siswantoyo, Rahayu, S., & Hermawan, H. A. (2022). Augmented reality mobile app-based multimedia learning of Pencak Silat to enhance the junior high school students’ learning outcomes. Cakrawala Pendidikan, 41(2), 553–568. https://doi.org/10.21831/cp.v41i2.49217
Mune, C., & Agee, A. (2016). Are e-books for everyone? An evaluation of academic e-book platforms’ accessibility features. Journal of Electronic Resources Librarianship, 28(3), 172–182. https://doi.org/10.1080/1941126X.2016.1200927
Pradipta, R. F., Purnamawati, F., Yasin, M. H. M., Dewantoro, D. A., Irvan, M., & Susilawati, S. Y. (2020). Online Learning Resource Based on One ID Website for All Access (OIAA) as a Student Learning Assistance System. Proceedings - 2020 6th International Conference on Education and Technology, ICET 2020, 77–83. https://doi.org/10.1109/ICET51153.2020.9276589
Ramaiah, C. K., & Rao, M. S. (2021). Media and Information Literacy: A Bibliography. Journal of Information Literacy, 41(4), 316–336. https://doi.org/10.11645/8.2.1962
Ren, X. (2022). Evaluating Lexical Complexity From EGP to ESP Textbooks. Journal of Language Teaching and Research, 13(5), 974–980. https://doi.org/10.17507/jltr.1305.09
Roskos, K., Brueck, J., & Lenhart, L. (2017). An analysis of e-book learning platforms: Affordances, architecture, functionality and analytics. International Journal of Child-Computer Interaction, 12, 37–45. https://doi.org/10.1016/j.ijcci.2017.01.003
Rusek, M., & Vosyková, L. (2021). Evaluation of Czech Non-Chemical Vocational School Chemistry Textbooks’ Text Difficulty. Chemistry, Didactics, Ecology, Metrology, 26(1–2), 99–108. https://doi.org/10.2478/cdem-2021-0008
Sari, N. T. A. (2011). Visible boys, invisible girls: The representation of gender inlearn english with tito (a critical discourse analysis of english language textbooks for primary school). Indonesian Journal of Applied Linguistics, 1(1), 84–104. https://doi.org/10.17509/ijal.v1i1.101
Sultan, Rapi, M., Mayong, & Suardi. (2020). Textbook discourse readability: Gender, reading interest, and socio-economic status of students with poor reading ability. Cakrawala Pendidikan, 39(3), 583–596. https://doi.org/10.21831/cp.v39i3.32326
Suwandi, S., Yunus, A., & Rahmawati, L. E. (2017). Ecological intelligence values in Indonesian language textbooks for junior high school students. Pertanika Journal of Social Sciences and Humanities, 25(September), 237–248.
Suwandi, S., Zainnuri, H., & Yunus, A. (2019). Ecological literacy values in Indonesian language textbook for senior high school students published by Ministry of Education and Culture. Journal of Physics: Conference Series, 1360(1). https://doi.org/10.1088/1742-6596/1360/1/012006
Vicente, S., Verschaffel, L., Sánchez, R., & Múñez, D. (2022). Arithmetic word problem solving. Analysis of Singaporean and Spanish textbooks. Educational Studies in Mathematics, 375–397. https://doi.org/10.1007/s10649-022-10169-x
Wan Sulaiman, W. N. A., & Mustafa, S. E. (2020a). Theory on Exploring Acceptance and Adoption of Digital Textbooks: A Guide for the Book Publishing Industry. Publishing Research Quarterly, 36(3), 381–398. https://doi.org/10.1007/s12109-020-09742-0
Wan Sulaiman, W. N. A., & Mustafa, S. E. (2020b). Usability Elements in Digital Textbook Development: A Systematic Review. Publishing Research Quarterly, 36(1), 74–101. https://doi.org/10.1007/s12109-019-09675-3
Yada, S., Kageura, K., & Paris, C. (2020). Identification of tweets that mention books. International Journal on Digital Libraries, 21(3), 265–287. https://doi.org/10.1007/s00799-019-00273-4
Yazdanmehr, E., & Shoghi, S. (2014). Design and Application of a ‘ Textbook Visual Effects ’ Evaluation Checklist. Theory and Practice in Language Studies, 4(3), 473–480. https://doi.org/10.4304/tpls.4.3.473-480
Zhu, Z., Yao, X., Qin, Y., Lu, Z., Ma, Q., Zhao, X., & Liu, L. (2022). Visualization and mapping of literature on the scientific analysis of wall paintings: a bibliometric analysis from 2011 to 2021. Heritage Science, 10(1), 1–13. https://doi.org/10.1186/s40494-022-00735-0
Downloads
Submitted
Accepted
Published
Versions
- 04/18/2026 (2)
- 04/07/2026 (1)
Issue
Section
License
Copyright (c) 2026 Firstya Evi Dianastiti, Gallant Karunia Assidik, Mashud Syahroni
This work is licensed under a Creative Commons Attribution 4.0 International License.
