A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment

Arican, Muhammet; Sen, Sedat

A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment

Sedat ŞEN, (Harran Üniversitesi, Eğitim Fakültesi, Eğitim Bilimleri, Bölümü, Şanlıurfa, Türkiye)

Muhammet ARICAN (Ahi Evran Üniversitesi, Eğitim Fakültesi, Matematik Eğitimi, Kırşehir, Türkiye)

Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi

2 0

Yıl: 2015 Cilt: 6 Sayı: 2 Sayfa Aralığı: 238 - 253 Metin Dili: Türkçe İndeks Tarihi: 29-07-2022

A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment

Öz:

Bu çalışmanın amacı büyük ölçekli bir sınavın tanılayıcı değerlendirme yaklaşımlarından biriyle analiz edilmesidir. Bazı araştırmacılar büyük ölçekli sınavların (örn: TIMSS) kullanışlılığını sorguluyor olsa da katılımcı ülkeler bu sınavlardan alınan sonuçları kullanarak müfredatlarında ve öğretim metotlarında geliştirmeler yapmaya devam etmektedir. Bu sınavlarda yaygın olarak kullanılan ve tek bir puan sunmaya dayalı olan uygulamalar öğrencinin genel performansı hakkında bilgi sunsa da tanısal bilgi sunmada yeterli değildir. Öğrencilerin bilişsel olarak güçlü ve zayıf yanlarıyla ilgili daha detaylı bilgi sunabilmek için bilişsel tanı modelleri geliştirilmiştir. Bu çalışmada Kore ve Türkiye veri setleri kullanılarak TIMSS 2011 sekizinci sınıf matematik sorularının bilişsel tanı modellerinden DINA model ile tekrar analizi yapılmıştır. Bu modelden elde edilen sonuçlar kullanılarak iki ülke öğrencilerinin performanslarının karşılaştırılması yapılmıştır.

Anahtar Kelime:

Konular: Tarih

TIMSS 2011 Sınavına Kore ve Türkiye'den Katılan Öğrencilerin Matematik Performanslarının Tanısal Bir Karşılaştırılması

Öz:

The purpose of the present study was to analyze an international large-scale data set using a cognitive assessment approach. Although some researchers question the usefulness of international large-scale assessments (e.g., TIMSS), participating countries have continued to use the results from these large-scale assessments to improve their curricula and teaching methods. Despite the common reporting practice--single-score--in these large scale assessments gives useful insights about students' overall performances, they still lack diagnostic information. Cognitive diagnosis models (CDMs) were developed to provide more feedback on students' cognitive strengths and weaknesses. This study retrofitted the TIMSS 2011 eighth grade mathematics assessment by applying a specific CDM called the DINA (the deterministic, inputs, noisy, "and" gate) model to data from South Korea and Turkey. Results of the DINA model were used to make a detailed comparison between students of these two countries.

Anahtar Kelime:

Konular: Tarih

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık

Choi, M. K., Lee, Y-S., & Park, Y. S. (2015). What CDM can tell about what students have learned: An analysis of TIMSS eighth grade mathematics. Eurasia Journal of Mathematics, Science & Technology Education, 11(6), 1563-1577.
Chung, Y.L., & Son, D.H. (2000). Effects of cooperative learning strategy on achievement and science learning attitudes in middle school biology. Journal of the Korean Association for Research in Science Education, 20, 611-623.
Common Core State Standards Initiative (2010). The common core state standards for mathematics. Washington, D.C.: Author. Common Core State Standards Initiative (2014). Myths vs. facts. Retrieved from http://www.corestandards.org/about-the-standards/myths-vs-facts/
de la Torre, J. (2008). An empirically-based method of Q-matrix validation for the DINA model: Development and applications. Journal of Educational Measurement, 45, 343-362.
de la Torre, J., & Lee, Y. S. (2008, March). Relationships between cognitive diagnosis, CTT and IRT indices: An empirical investigation. Paper presented at the Annual Meeting of the National Council on Measurement in Education, New York.
de la Torre, J. (2009). DINA model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34, 115-130.
de la Torre, J. (2011). The generalized DINA model framework. Psychometrika, 76(2), 179-199.
DiBello, L., Roussos, L. A., & Stout, W. (2007). Review of cognitively diagnostic assessment and a summary of psychometric models. In C. V. Rao & S. Sinharay (Eds.), Handbook of Statistics (Vol. 26, Psychometrics) (pp. 979-1027). Amsterdam: Elsevier.
Dogan, E., & Tatsuoka, K. (2008). An international comparison using a diagnostic testing model: Turkish students' profile of mathematical skills on TIMSS-R. Educational Studies in Mathematics, 68(3), 263- 272.
Doornik, J. A. (2003). Object-oriented matrix programming using Ox (version 3.1) [Computer software]. London: Timberlake Consultants Press.
Fisher, D. L., & Kim, H. B. (1999, April). Constructivist learning environments in science classes in Korea. Paper presented at the Annual Meeting of the American Educational Research Association, Montreal, Canada.
Fu, J., & Li, Y. (2007, April). An integrated review of cognitively diagnostic psychometric models. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Haertel, E. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 301-323.
Hartz, S. M. (2002). A Bayesian framework for the unified model for assessing cognitive abilities: Blending theory with practicality. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign, Urbana-Champaign, IL.
Henson, R. A., Templin, J. L., & Willse, J. T. (2009). Defining a family of cognitive diagnosis models using log- linear models with latent variables. Psychometrika, 74, 191-210.
Holliday, W. G., & Holliday, B. W. (2003). Why using international comparative math and science achievement data from TIMSS is not helpful. The Education Forum, 67, 250-257.
House, J.D. (2009). Classroom instructional strategies and science career interest for adolescent students in Korea: Results from the TIMSS 2003 assessment. Journal of Instructional Psychology, 36, 13-19.
Im, S., & Park, H. J. (2010). A comparison of US and Korean students' mathematics skills using a cognitive diagnostic testing method: linkage to instruction. Educational Research and Evaluation, 16(3), 287-301.
Junker, B. W., & Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258-272.
Kim, K., Kim, S., Kim, N., Park, S., Kim, J., Park, H., & Jung, S. (2008). Characteristics of achievement trend in Korea's middle and high school students from International Achievement Assessment (TIMSS/PISA) (KICE Research report, RRE-2008-3-1). Seoul, Korea: Korea Institute of Curriculum and Evaluation.
Lee, Y.-S., Park, Y.S., & Taylan, D. (2011). A cognitive diagnostic modeling of attribute mastery in Massachusetts, Minnesota, and the U.S. national sample using the TIMSS 2007. International Journal of Testing, 11, 144-177.
Lee, Y.-S., Johnson, M., Park, J. Y., Sachdeva, R., Zhang, J., & Waldman, M. (2013, April). A multidimensional scaling (mds) approach for investigating students' cognitive weakness and strength on the TIMSS 2007 mathematics assessment. Paper presented at the 2013 Annual Meeting of the American Educational Research Association Conference in San Francisco, CA.
Leighton, J., & Gierl, M. (2007). Why cognitive diagnostic assessment? In J. P. Leighton & M. J. Gierl (Eds.), Cognitive diagnostic assessment for education (pp. 3-18). Cambridge: Cambridge University Press.
Mullis, I.V.S., Martin, M.O., Foy, P., & Arora, A. (2012). TIMSS 2011 International Results in Mathematics. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.
Nichols, P. D., Chipman, S. F., & Brennan, R. L. (Eds.). (2012). Cognitively diagnostic assessment. Hillsdale, NJ: Erlbaum.
Oh, S. (2005). Discursive roles of the teacher during class sessions for students presenting their science investigation. International Journal of Science Education, 27, 1825-1851.
Ozturk, D., & Ucar, S. (2010). By using TIMSS data, determination and comparison of the factors that affects science achievement of 8 grade students from Taiwan and Turkey. Cukurova University Journal of Social Sciences, 19(3), 241-256.
Park, K.M. (2004, July). Mathematics teacher education in East Asian countries: From the perspective of pedagogical content knowledge. Paper presented at the 10th International Congress on Mathematical Education, Copenhagen, Denmark.
Roussos, L., DiBello, L. V., Stout, W., Hartz, S., Henson, R. A., & Templin, J. H. (2007). The fusion model skills diagnosis system. In J. P. Leighton, & Gierl, M. J. (Ed.), Cognitively diagnostic assessment for education: Theory and practice. (pp. 275-318). Thousand Oaks, CA: SAGE.
Rupp, A. A., & Templin, J. L. (2008a). Unique characteristics of diagnostic classification models: A comprehensive review of the current state-of-the-art. Measurement, 6(4), 219-262.
Rupp, A. A., & Templin, J. (2008b). The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model. Educational and Psychological Measurement, 68(1), 78-96.
Rupp, A. A., Templin, J. L., & Henson, R. A. (2010). Diagnostic assessment: Theory, methods, and applications. New York: Guilford Press.
Tatsuoka, K. (1985). A probabilistic model for diagnosing misconceptions in the pattern classification approach. Journal of Educational Statistics, 12, 55-73.
Templin, J., & Henson, R. (2006). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11, 287-305.
Toker, T., & Green, K. (2012, April). An application of cognitive diagnostic assessment on TIMMS-2007 8th Grade Mathematics items.Paper presented at the annual meeting of the American Educational Research Association, Vancouver, British Columbia, Canada.
von Davier, M. (2005). A general diagnostic model applied to language testing data. ETS Research Report RR- 05-16.
Wang, J. (2001). TIMSS primary and middle school data: Some technical concerns. Educational Researcher, 30, 17-21.

APA	Sen S, Arican M (2015). A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. , 238 - 253.
Chicago	Sen Sedat,Arican Muhammet A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. (2015): 238 - 253.
MLA	Sen Sedat,Arican Muhammet A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. , 2015, ss.238 - 253.
AMA	Sen S,Arican M A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. . 2015; 238 - 253.
Vancouver	Sen S,Arican M A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. . 2015; 238 - 253.
IEEE	Sen S,Arican M "A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment." , ss.238 - 253, 2015.
ISNAD	Sen, Sedat - Arican, Muhammet. "A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment". (2015), 238-253.

APA	Sen S, Arican M (2015). A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 6(2), 238 - 253.
Chicago	Sen Sedat,Arican Muhammet A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi 6, no.2 (2015): 238 - 253.
MLA	Sen Sedat,Arican Muhammet A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, vol.6, no.2, 2015, ss.238 - 253.
AMA	Sen S,Arican M A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi. 2015; 6(2): 238 - 253.
Vancouver	Sen S,Arican M A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi. 2015; 6(2): 238 - 253.
IEEE	Sen S,Arican M "A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment." Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 6, ss.238 - 253, 2015.
ISNAD	Sen, Sedat - Arican, Muhammet. "A Diagnostic Comparison of Turkish and Korean Students' Mathematics Performances on the TIMSS 2011 Assessment". Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi 6/2 (2015), 238-253.