EFA and CFA analysis: Development and validation of a test instrument for mathematical abstraction skills

Authors

DOI:

https://doi.org/10.23917/jramathedu.v10i2.7601

Keywords:

Confirmatory factor analysis (CFA), Test instrument validation, Mathematical abstraction skills, Educational measurement

Abstract

Mathematical abstraction skills are fundamental for advanced reasoning and problem-solving; however, assessing these skills in senior high school students poses challenges due to the limited availability of validated instruments. This study aims to develop and validate a test instrument for measuring mathematical abstraction skills in Indonesian high school students. The instrument targets three hierarchical cognitive levels: perceptual abstraction, internalization, and interiorization. A quantitative approach was used, involving Exploratory and Confirmatory Factor Analysis (EFA and CFA) to establish construct validity. Content validity was first evaluated by 17 mathematics educators using Aiken’s V index, followed by expert judgment from five specialists. A field test with 507 students provided the dataset for analysis. Findings from EFA and CFA confirmed that the instrument exhibited strong construct validity and reliability, with clear alignment between items and the targeted abstraction levels. The internal consistency metrics demonstrated the instrument’s ability to reliably assess mathematical abstraction across cognitive hierarchies. This validated tool contributes to mathematics education by providing a reliable means for assessing abstraction skills, facilitating improvements in instructional strategies and student evaluations. Its potential applications extend to educational research and classroom assessments, offering educators insights into students’ reasoning processes to support deeper learning outcomes. 

References

Abreu-Mendoza, R. A., Chamorro, Y., Garcia-Barrera, M. A., & Matute, E. (2018). The contributions of executive functions to mathematical learning difficulties and mathematical talent during adolescence. PLOS ONE, 13(12), e0209267. https://doi.org/10.1371/journal.pone.0209267

Ade Andriani, I. D. N. S. (2021). Students’ Thinking Process in Solving Abstraction Problems in Mathematics: A Case Study on Limited Test of Development Research Instrument. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(6), 2594–2601. https://doi.org/10.17762/turcomat.v12i6.5705

Ahmadah, I. F. (2020). Algebraic Reasoning of Student with Keirsey Personality Type in Solving Mathematical Problem. Eduma : Mathematics Education Learning and Teaching, 9(2), 42. https://doi.org/10.24235/eduma.v9i2.7191

Al‐Dossary, S. A., & Almohayya, B. M. (2023). Measurement Invariance of the Arabic Version of the Flourishing Scale in a Sample of Special Education Teachers. Psychology in the Schools, 61(1), 67–79. https://doi.org/10.1002/pits.23030

Alvarenga, W. d. A., Nascimento, L. C., Rebustini, F., Santos, C. B. d., Muehlan, H., Schmidt, S., Bullinger, M., Liberato, F. M. G., & Vieira, M. (2022). Evidence of Validity of Internal Structure of the Functional Assessment of Chronic Illness Therapy-Spiritual Well-Being Scale (FACIT-Sp-12) in Brazilian Adolescents With Chronic Health Conditions. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.991771

Bahar, A. K., & Maker, C. J. (2020). Culturally Responsive Assessments of Mathematical Skills and Abilities: Development, Field Testing, and Implementation. Journal of Advanced Academics, 31(3), 211–233. https://doi.org/10.1177/1932202X20906130

Balkan, İ. (2023). Investigation of Seventh Grade Students’ Transition Skills among Representations. Journal of Computer and Education Research, 11(22), 552–571. https://doi.org/10.18009/jcer.1312608

Beckers, S., & Halpern, J. Y. (2018). Abstracting Causal Models. http://arxiv.org/abs/1812.03789

Cetin, I., & Dubinsky, E. (2017). Reflective abstraction in computational thinking. Journal of Mathematical Behavior, 47, 70–80. https://doi.org/10.1016/j.jmathb.2017.06.004

Cooley, L. (2002). Writing in calculus and reflective abstraction. The Journal of Mathematical Behavior, 21(3), 255–282. https://doi.org/10.1016/S0732-3123(02)00129-3

Coolidge, F. L., & Overmann, K. A. (2012). Numerosity, abstraction, and the emergence of symbolic Thinking. Current Anthropology, 53(2), 204–225. https://doi.org/10.1086/664818

Dewi, I., Siregar, N., Andriani, A., & Ritonga, A. (2019). Analysis of Communication and Mathematical Abstraction Ability of Junior High School Students’ using Student Activity Sheets Based on Model of Learning Mean – Ends Analysis. Proceedings of the Proceedings of The 5th Annual International Seminar on Trends in Science and Science Education, AISTSSE 2018, 18-19 October 2018, Medan, Indonesia. https://doi.org/10.4108/eai.18-10-2018.2287325

Dirgantoro, K. P. S., Soesanto, R. H., & Yanti, Y. (2024). Constructing Mathematical Bitterness Scale Related to Teacher Factor. Jurnal Elemen, 10(2), 395–409. https://doi.org/10.29408/jel.v10i2.25508

Dreyfus, T. (2014). Abstraction in Mathematics Education. In Encyclopedia of Mathematics Education (pp. 5–8). Springer Netherlands. https://doi.org/10.1007/978-94-007-4978-8_2

Dreyfus, T., & Kidron, I. (2014). Introduction to Abstraction in Context (AiC). https://doi.org/10.1007/978-3-319-05389-9_6

Ferrari, P. L. (2003). Abstraction in mathematics. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 358(1435), 1225–1230. https://doi.org/10.1098/rstb.2003.1316

Fiantika, F. R., Budayasa, I. K., & Lukito, A. (2018). Internal process: what is abstraction and distortion process? Journal of Physics: Conference Series, 983, 012086. https://doi.org/10.1088/1742-6596/983/1/012086

Fitriani, N., Hidayah, I. S., & Nurfauziah, P. (2021). Live Worksheet Realistic Mathematics Education Berbantuan Geogebra: Meningkatkan Abstraksi Matematis Siswa SMP pada Materi Segiempat. JNPM (Jurnal Nasional Pendidikan Matematika), 5(1), 37. https://doi.org/10.33603/jnpm.v5i1.4526

Fitriani, N., & Nurfauziah, P. (2019). Gender and mathematical abstraction on geometry. Journal of Physics: Conference Series. https://doi.org/10.1088/1742-6596/1315/1/012052

Fitriani, N., Suryadi, D., & Darhim, D. (2018). the Students’ Mathematical Abstraction Ability Through Realistic Mathematics Education With Vba-Microsoft Excel. Infinity Journal, 7(2), 123. https://doi.org/10.22460/infinity.v7i2.p123-132

Flora, D. B., & Flake, J. K. (2017). The purpose and practice of exploratory and confirmatory factor analysis in psychological research: Decisions for scale development and validation. Canadian Journal of Behavioural Science / Revue Canadienne Des Sciences Du Comportement, 49(2), 78–88. https://doi.org/10.1037/cbs0000069

Fu, Y., Wen, Z., & Wang, Y. (2022). A Comparison of Reliability Estimation Based on Confirmatory Factor Analysis and Exploratory Structural Equation Models. Educational and Psychological Measurement, 82(2), 205–224. https://doi.org/10.1177/00131644211008953

Gautam, A., Bortz, W., & Tatar, D. (2020). Abstraction through multiple representations in an integrated computational thinking environment. Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE, 393–399. https://doi.org/10.1145/3328778.3366892

Gold, M. E. (2018). Level of Abstraction in Legal Thinking. Southern Illinois University Law Journal, 42, 117–223.

Gray, E., & Tall, D. (2007). Abstraction as a natural process of mental compression. Mathematics Education Research Journal, 19(2), 23–40. https://doi.org/10.1007/BF03217454

Güler, N., Teker, G. T., & İlhan, M. (2019). The Turkish Adaptation of the Statistics Anxiety Scale for Graduate Students. Eğitimde Ve Psikolojide Ölçme Ve Değerlendirme Dergisi, 10(4), 435–450. https://doi.org/10.21031/epod.550765

Hakim, L. L., Alghadari, F., & Widodo, S. A. (2019). Virtual manipulatives media in mathematical abstraction. Journal of Physics: Conference Series, 1315(1), 012017. https://doi.org/10.1088/1742-6596/1315/1/012017

Hanif, Q., Budiyanto, C. W., & Yuana, R. A. (2021). Abstract Thinking Skills of High School Students in STEM Learning: Literature Review. Journal of Physics: Conference Series, 1808(1), 012019. https://doi.org/10.1088/1742-6596/1808/1/012019

Hazzan, O., & Zazkis, R. (2005). Reducing abstraction: The case of school mathematics. Educational Studies in Mathematics. https://doi.org/10.1007/s10649-005-3335-x

Hemmi, K., Bråting, K., & Lepik, M. (2021). Curricular approaches to algebra in Estonia, Finland and Sweden – a comparative study. Mathematical Thinking and Learning, 23(1), 49–71. https://doi.org/10.1080/10986065.2020.1740857

Hershkowitz, R., Hadas, N., Dreyfus, T., & Schwarz, B. B. (2007). Abstracting processes, from individuals’ constructing of knowledge to a group’s “shared knowledge.” Mathematics Education Research Journal. https://doi.org/10.1007/BF03217455

Hershkowitz, R., Schwarz, B. B., & Dreyfus, T. (2007). Processes of Abstraction in Context the Nested Epistemic Actions Model. Journal for Research in Mathematics Education. Mar2001, Vol. 32 Issue 2, P195. 28p. 1. http://medicina.iztacala.unam.mx/medicina/dreyfus.pdf

Hong, J. Y., & Kim, M. K. (2016). Mathematical Abstraction in the Solving of Ill-Structured Problems by Elementary School Students in Korea. EURASIA Journal of Mathematics, Science and Technology Education, 12(2), 267–281. https://doi.org/10.12973/eurasia.2016.1204a

Hutagalung, E. E., Mulyana, E., & Pangaribuan, T. R. (2020). Mathematical abstraction: Students’ concept of triangles. Journal of Physics: Conference Series, 1521(3). https://doi.org/10.1088/1742-6596/1521/3/032106

Iuculano, T., & Menon, V. (2018). Development of Mathematical Reasoning. In Stevens’ Handbook of Experimental Psychology and Cognitive Neuroscience (pp. 1–40). Wiley. https://doi.org/10.1002/9781119170174.epcn406

Juul, J. (2007). A certain level of abstraction. 3rd Digital Games Research Association International Conference: “Situated Play”, DiGRA 2007, 510–515.

Kamina, P., & Iyer, N. (2009). From Concrete to Abstract: Teaching for Transfer of Learning when Using Manipulatives. NERA Conference Proceedings 2009.

Kellman, P. J., Massey, C. M., & Son, J. Y. (2010). Perceptual Learning Modules in Mathematics: Enhancing Students’ Pattern Recognition, Structure Extraction, and Fluency. Topics in Cognitive Science, 2(2), 285–305. https://doi.org/10.1111/j.1756-8765.2009.01053.x

Khasanah, N., Nurkaidah, N., Dewi, R., & Prihandika, Y. A. (2019). The Process of Student’s Mathematic Abstract from Spatial Intelligence. Journal of Mathematics and Mathematics Education, 9(2), 24. https://doi.org/10.20961/jmme.v9i2.48396

Kidron, I., & Dreyfus, T. (2008). Abstraction in Context, Combining Constructions, Justification and Enlightenment. Proceedings of the 31st Annual Conference of the Mathematics Education Research Group of Australasia.

Kiliçoğlu, E., & Kaplan, A. (2019). An Examination of Middle School 7th Grade Students’ Mathematical Abstraction Processes. Journal of Computer and Education Research, 7(13), 233–256. https://doi.org/10.18009/jcer.547975

Kinanti, M. A. H., Sujadi, I., Indriati, D., & Kuncoro, K. S. (2023). Examining students’ cognitive processes in solving algebraic numeracy problems: A Phenomenology study. Jurnal Elemen, 9(2), 494–508. https://doi.org/10.29408/jel.v9i2.13266

Little, J. L., & McDaniel, M. A. (2015). Some learners abstract, others memorize examples: Implications for education. Translational Issues in Psychological Science. https://doi.org/10.1037/tps0000031

Lyn, D. (2023). Ways of thinking in STEM-based problem solving. ZDM – Mathematics Education, 55(7), 1219–1230. https://doi.org/10.1007/s11858-023-01474-7

Mitchelmore, M., & White, P. (2007). Abstraction in Mathematics Learning. Mathematics Education Research Journal, 19(2), 1–9.

Moessinger, P., & Poulin-Dubois, D. (1981). Piaget on Abstraction. Swiss Federal Institute of Technology, 24, 347–353.

Murtianto, Y. H., Sutrisno, Nizaruddin, & Muhtarom. (2019). Effect of Learning Using Mathematica Software Toward Mathematical Abstraction Ability, Motivation, and Independence of Students in Analytic Geometry. Infinity Journal, 8(2), 219–228. https://doi.org/10.22460/infinity.v8i2.p219-228

Nasir, M. N. M., Mohamad, M., Ghani, N. I. A., & Afthanorhan, A. (2020). Testing Mediation Roles of Place Attachment and Tourist Satisfaction on Destination Attractiveness and Destination Loyalty Relationship Using Phantom Approach. Management Science Letters, 443–454. https://doi.org/10.5267/j.msl.2019.8.026

Nisa, L. C., Waluya, St. B., Kartono, & Mariani, S. (2022). Developing Mathematical Conceptual Understanding Through Problem-Solving: The Role of Abstraction Reflective. https://doi.org/10.2991/assehr.k.211125.009

Noor, N., & Alghadari, F. (2021). Case of Actualizing Geometry Knowledge in Abstraction Thinking Level for Constructing a Figure. International Journal of Educational Studies in Mathematics, 8(1), 16–26. https://doi.org/10.17278/ijesim.797749

Nurjannah, S., & Kusnandi. (2021). Literature study: the role of abstraction ability to strengthen students early knowledge in mathematics learning. Journal of Physics: Conference Series, 1806(1), 012064. https://doi.org/10.1088/1742-6596/1806/1/012064

Nurrahmah, A., Zaenuri, & Wardono. (2021). Analysis of students difficulties in mathematical abstraction thinking in the mathematics statistic course. Journal of Physics: Conference Series, 1918(4), 042112. https://doi.org/10.1088/1742-6596/1918/4/042112

Ocy, D. R., Rahayu, W., & Arthur, R. (2024). Rasch model analysis: Evaluating students’ spatial thinking ability in higher-order thinking skills trigonometric comparison assessment (HOTS-TCA). Jurnal Gantang, 9(2), 191–204. https://doi.org/10.31629/jg.v9i2.6949

Ocy, D. R., Rahayu, W., & Makmuri, M. (2023). Rasch Model Analysis: Development Of Hots-Based Mathematical Abstraction Ability Instrument According To Riau Islands Culture. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 12(4), 3542–3560.

Özdemir, A., KARAŞAN, S., & ŞAHAL, M. (2021). An examination of the relationship between secondary school students’ abstract thinking skills, self-efficacy perceptions and attitudes towards mathematics. Participatory Educational Research, 8(2), 391–406. https://doi.org/10.17275/per.21.45.8.2

Panjaitan, B. (2018). The reflective abstraction profile of junior high school students in solving mathematical problems based on cognitive style of field independent and field dependent. Journal of Physics: Conference Series, 1088, 012094. https://doi.org/10.1088/1742-6596/1088/1/012094

Pratt, D., & Noss, R. (2010). Designing for mathematical abstraction. International Journal of Computers for Mathematical Learning. https://doi.org/10.1007/s10758-010-9160-z

Prihono, E. W., Lapele, F., Jumaeda, S., Sukadari, S., & Nurjanah, S. (2022). EFA of Pedagogic Competence Instrument to Measure Teacher Performance. https://doi.org/10.2991/assehr.k.220129.059

Putra, J. D., Suryadi, D., & Juandi, D. (2018). Mathematical abstraction ability of prospective math teacher students. Journal of Physics: Conference Series, 1132, 012049. https://doi.org/10.1088/1742-6596/1132/1/012049

Raychaudhuri, D. (2014). Adaptation and extension of the framework of reducing abstraction in the case of differential equations. International Journal of Mathematical Education in Science and Technology, 45(1), 35–57. https://doi.org/10.1080/0020739X.2013.790503

Reed, S. K. (2016). A Taxonomic Analysis of Abstraction. Perspectives on Psychological Science, 11(6), 817–837. https://doi.org/10.1177/1745691616646304

Rich, K. M., & Yadav, A. (2020). Applying Levels of Abstraction to Mathematics Word Problems. TechTrends, 64(3), 395–403. https://doi.org/10.1007/s11528-020-00479-3

Shrestha, N. (2021). Factor Analysis as a Tool for Survey Analysis. American Journal of Applied Mathematics and Statistics, 9(1), 4–11. https://doi.org/10.12691/ajams-9-1-2

Simon, M. A. (2020). Elaborating reflective abstraction for instructional design in mathematics: Postulating a Second Type of Reflective Abstraction. Mathematical Thinking and Learning, 22(2), 162–171. https://doi.org/10.1080/10986065.2020.1706217

Spiller, J., Clayton, S., Cragg, L., Johnson, S., Simms, V., & Gilmore, C. (2023). Higher level domain specific skills in mathematics; The relationship between algebra, geometry, executive function skills and mathematics achievement. PLOS ONE, 18(11), e0291796. https://doi.org/10.1371/journal.pone.0291796

Sterner, P., De Roover, K., & Goretzko, D. (2024). New Developments in Measurement Invariance Testing - An Overview and Comparison of EFA-based Approaches. https://doi.org/10.31234/osf.io/wsert

Susac, A., Bubic, A., Vrbanc, A., & Planinic, M. (2014). Development of abstract mathematical reasoning: the case of algebra. Frontiers in Human Neuroscience, 8. https://doi.org/10.3389/fnhum.2014.00679

Uygun, T., & Guner, P. (2022). Representation of Algebraic Reasoning in Sets through Argumentation. International Journal of Contemporary Educational Research, 6(2), 215–229. https://doi.org/10.33200/ijcer.557781

Warren, E., & Cooper, T. J. (2009). Developing mathematics understanding and abstraction: The case of equivalence in the elementary years. Mathematics Education Research Journal, 21, 76–95. https://doi.org/10.1007/BF03217546

White, P., & Mitchelmore, M. C. (2010). Teaching for Abstraction: A Model. Mathematical Thinking and Learning, 12(3), 205–226. https://doi.org/10.1080/10986061003717476

Xiao, Y., Liu, H., & Hau, K.-T. (2019). A Comparison of CFA, ESEM, and BSEM in Test Structure Analysis. Structural Equation Modeling: A Multidisciplinary Journal, 26(5), 665–677. https://doi.org/10.1080/10705511.2018.1562928

Žakelj, A., Cotič, M., & Doz, D. (2024). Demetriou’s tests and levels of algebraic abilities and proportional reasoning in seventh, eighth, and ninth grades. European Journal of Science and Mathematics Education, 12(2), 326–334. https://doi.org/10.30935/scimath/14460

Zehetmeier, D., Böttcher, A., Brüggemann-Klein, A., & Thurner, V. (2019). Defining the competence of abstract thinking and evaluating CS-students’ level of abstraction. Proceedings of the Annual Hawaii International Conference on System Sciences, 2019-Janua, 7642–7651. https://doi.org/10.24251/hicss.2019.921

Zelazo, P. D. (2018). Abstracting and Aligning Essential Features of Cognitive Development. Human Development, 61(1), 43–48. https://doi.org/10.1159/000486749

Downloads

Submitted

2024-12-13

Accepted

2025-06-02

Published

2025-04-30

How to Cite

Ocy, D. R., Sarifah, I., & Riyadi, R. (2025). EFA and CFA analysis: Development and validation of a test instrument for mathematical abstraction skills . JRAMathEdu (Journal of Research and Advances in Mathematics Education), 10(2), 101–119. https://doi.org/10.23917/jramathedu.v10i2.7601

Issue

Section

Articles