Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore
Yıl: 2021 Cilt: 8 Sayı: 1 Sayfa Aralığı: 90 - 105 Metin Dili: İngilizce DOI: 10.21449/ijate.690576 İndeks Tarihi: 31-05-2021
Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore
Öz: The purpose of this research is to examine measurement invariance ofcollaborative problem solving skills measured by PISA 2015 Xandar subtest forSingapore, Norway, and Turkey. The research was conducted with 2990participants’ data obtained from Turkey (1032), Norway (923), and Singapore(1035) on PISA 2015 collaborative problem solving study. In the first part of thestudy, exploratory factor analysis was performed to obtain the factor structure ofthe Xandar subtest. Then, the model data fit was checked by confirmatory factoranalysis via / df (3.127), RMSEA (0.027), CFI (0.987) and TLI (0.979) values.Multi-group confirmatory factor analysis was used in invariance analyses. Thefindings show that the collaborative problem solving model met only configuralinvariance across the countries and has not met the metric, scale, and strictinvariance stages. The results show that meaningful comparisons cannot be madebetween the countries, because the factor loadings, variances, error variances, andcovariances differ among countries.
Anahtar Kelime: Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
- Bahadır, E. (2012). According programme for ınternational student assessment (PISA 2009), investigation of variables that affect Turkish students' reading skills by regions [Master Thesis]. Hacettepe University, Ankara.
- Başusta, N.B., & Gelbal, S. (2015). Examination of Measurement Invariance at Groups’ Comparisons: A Study on PISA Student Questionnaire. Hacettepe University Journal of Education, 30 (4), 80-90
- Bollen, K. A. (1989). Structural equations with latent variables. Wiley- Interscience Publication.
- Byrne, B. M. (2004). Testing for multigroup invariance using AMOS graphics: A road less traveled. Structural equation modeling, 11(2), 272-300.
- Bryne, B. M. & Watkins, D. (2003). The issue of measurement invariance revisited. Journal Of Cross-Cultural Psychology, 34, (2), 155-175.
- Brown, T.A. (2015). Confirmatory factor analysis for applied research. (Second Edition). The Guilford Press.
- Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-Fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255.
- Çokluk, Ö., Şekercioğlu, G., & Büyüköztürk, Ş. (2018). Sosyal bilimler için çok değişkenli istatistik: SPSS ve LISREL uygulamaları. Pegem.
- Demir, Ö., & Seferoğlu, S.S. (2017). İşbirlikli Problem Çözmenin Kodlama Eğitimine Yansıması Olarak Eşli Kodlamanın İncelenmesi. 5 th International Instructional Technologies& Teacher Education Symposium. 11-13 October 2017, İzmir.
- Erkoç, M.F. (2018). The effect of collaborative game design on critical thinking, problem solving and algorithm development skills [Doctoral Dissertation]. İstanbul University.
- Greiff, S., Wüstenberg, S., Molnár, G., Fischer, A., Funke, J., & Csapó, B. (2013). Complex problem solving in educational contexts - something beyond g: Concept, assessment, measurement invariance, and construct validity. Journal of Educational Psychology, 105(2), 364-379.
- Hesse, F. W. (2017). Designs for operationalizing collaborative problem solving for automated assesment. Journal of Educational Measurement, Spring, 54(1), 12-35.
- Jöreskog, K. G., & Sörbom, D. (1993). Lisrel 8: Structural equation modeling with the simplis command language. Lincolnwood: Scientific Software International, Inc.
- Karakoç Alatlı, B. (2016). Investigation of measurement invariance of literacy tests in the Programme for International Student Assessment (PISA - 2012) [Published Doctoral Dissertation]. Ankara University.
- Kıbrıslıoğlu, N. (2015). The investigation of measurement invariance PISA 2012 mathematics learning model according to culture and gender: Turkey - China (Shangai) – Indonesia [Master Thesis] Hacettepe University.
- Lance, C. E., & Vandenberg, R. J., (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational research methods, 3(1), 4-70.
- Mark, B. A., & Wan, T.T.H (2005). Testing measurement equivalence in a patient satisfaction instrument. Western Journal of Nursing Research, 27(6), 772-787.
- Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Pyschometrika, 58, 525-543.
- Millsap, R. E., & Kwok, O. M. (2004). Evaluating the impact of partial factorial invariance on selection in two populations. Psychological methods, 9(1), 93.
- Nelson, L.M. (2009). Instructional-design theories and models: A new paradigm of instructional theory, Volume II. Routledge Publishing, (ISBN 978-0-8058-2859-7)
- OECD, 2017. PISA 2015 results (Volume 5): Collaborative problem solving. OECD Publishing.
- O'Neil, H. F., Chuang, S. H., & Chung, G. K. (2003). Issues in the computer-based assessment of collaborative problem solving. Assessment in Education: Principles, Policy & Practice, 10(3), 361-373.
- Oliden, P., E., & Lizaso, J, M. (2013) Invariance levels across language versions of the PISA 2009 reading comprehension tests in Spain, Psicothema, 25(3), 390-395.
- Özdemir, S. (2005). The effects of individual and collaborative problem-based learning using an online asynchronized learning tool on critical thinking abilities, academic achievements, and attitudes toward internet use [Doctoral Dissertation]. Gazi University.
- Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87(3), 517.
- Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of psychological research online, 8(2), 23-74.
- Tabachnick, B. G., Fidell, L. S., & Ullman, J. B. (2007). Using multivariate statistics (Vol. 5). Boston, MA: Pearson.
- Uyar, Ş. (2011). An investigation of measurement invariance of learning strategies model across different groups in PISA Turkey sample [Master Thesis] Hacettepe University.
- Uzunosmanoğlu, S.D. (2013). Examining computer supported collaborative problem solving processes using the dual- eye tracking paradigm [Master’s Thesis]. Orta Doğu Teknik Üniversitesi.
- Wang, J., & Wang, X. (2012). Structural equation modelling: Applications using mplus. (First edition). UK: Wiley Publications.
- Wu, D. A., Li, Z., & Zumbo, B. D. (2007). Decoding the meaning of factorial ınvariance and updating the practice of multi-group confirmatory factor analysis: A demonstration with TIMSS data. Practical Assesment, Research and Evaluation, 12(3), 1-26.
- Yandı, A., Köse, İ. A., & Uysal, Ö. (2017). Farklı Yöntemlerle Ölçme Değişmezliğinin İncelenmesi: Pisa 2012 Örneği. Mersin University Journal of the Faculty of Education, 13(1), 243-253.
| APA | TEKİN Y, Cobanoglu Aktan D (2021). Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. , 90 - 105. 10.21449/ijate.690576 |
| Chicago | TEKİN YUSUF TANER,Cobanoglu Aktan Derya Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. (2021): 90 - 105. 10.21449/ijate.690576 |
| MLA | TEKİN YUSUF TANER,Cobanoglu Aktan Derya Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. , 2021, ss.90 - 105. 10.21449/ijate.690576 |
| AMA | TEKİN Y,Cobanoglu Aktan D Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. . 2021; 90 - 105. 10.21449/ijate.690576 |
| Vancouver | TEKİN Y,Cobanoglu Aktan D Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. . 2021; 90 - 105. 10.21449/ijate.690576 |
| IEEE | TEKİN Y,Cobanoglu Aktan D "Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore." , ss.90 - 105, 2021. 10.21449/ijate.690576 |
| ISNAD | TEKİN, YUSUF TANER - Cobanoglu Aktan, Derya. "Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore". (2021), 90-105. https://doi.org/10.21449/ijate.690576 |
| APA | TEKİN Y, Cobanoglu Aktan D (2021). Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. International Journal of Assessment Tools in Education, 8(1), 90 - 105. 10.21449/ijate.690576 |
| Chicago | TEKİN YUSUF TANER,Cobanoglu Aktan Derya Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. International Journal of Assessment Tools in Education 8, no.1 (2021): 90 - 105. 10.21449/ijate.690576 |
| MLA | TEKİN YUSUF TANER,Cobanoglu Aktan Derya Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. International Journal of Assessment Tools in Education, vol.8, no.1, 2021, ss.90 - 105. 10.21449/ijate.690576 |
| AMA | TEKİN Y,Cobanoglu Aktan D Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. International Journal of Assessment Tools in Education. 2021; 8(1): 90 - 105. 10.21449/ijate.690576 |
| Vancouver | TEKİN Y,Cobanoglu Aktan D Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore. International Journal of Assessment Tools in Education. 2021; 8(1): 90 - 105. 10.21449/ijate.690576 |
| IEEE | TEKİN Y,Cobanoglu Aktan D "Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore." International Journal of Assessment Tools in Education, 8, ss.90 - 105, 2021. 10.21449/ijate.690576 |
| ISNAD | TEKİN, YUSUF TANER - Cobanoglu Aktan, Derya. "Investigation of measurement invariance of PISA 2015 collaborative problem solving skills: Turkey, Norway and Singapore". International Journal of Assessment Tools in Education 8/1 (2021), 90-105. https://doi.org/10.21449/ijate.690576 |
