Profile analysis as a generalized differential item functioning analysis method

YILDIRIM, Selda; YILDIRIM, H.Hüseyin; VERHELST, Norman

Profile analysis as a generalized differential item functioning analysis method

H.Hüseyin YILDIRIM, (Abant İzzet Baysal Üniversitesi, Eğitim Fakültesi, Bolu, Türkiye)

Selda YILDIRIM, (Abant İzzet Baysal Üniversitesi, Eğitim Fakültesi, Bolu, Türkiye)

Norman VERHELST (Eurometrics, Tiel, The, Netherlands)

Eğitim ve Bilim

7 2

Yıl: 2014 Cilt: 39 Sayı: 172 Sayfa Aralığı: 49 - 64 Metin Dili: Türkçe İndeks Tarihi: 29-07-2022

Profile analysis as a generalized differential item functioning analysis method

Öz:

Bu çalışma, bir testte farklı işleyen soruları belirlemek üzere, profil analizine dayanan yeni bir metodu (PADIF) tanıtmakta ve bir örnek üzerinde işe yararlılığını incelemektedir. Bu genelleştirilmiş metodun klasik yöntemlerden iki önemli farkı analizlerin soru değil soru grupları üzerinde yürütülmesi ve sonuçların belirli bir öğrenci grubundaki bütünsel etkisinin görülebileceği şekilde bir araya getirilebilmesidir. Çalışmada 169213 öğrenciden elde edilen Uluslararası Öğrenci Başarısını Belirleme Programı (PISA) 2003 Matematik Test verisi kullanılmıştır. Sonuçlar ülkeler bazında bir araya getirilmiştir. Elde edilen bulgular bu alandaki literatürle karşılaştırılarak incelenmiştir. Sonuçlar PADIF’in uluslararası çalışmalarda gözden kaçan değerli bilgileri açığa çıkarmada ümit verici yeni bir metot olabileceğini göstermektedir.

Anahtar Kelime:

Konular: Eğitim, Eğitim Araştırmaları

Genelleştirilmiş farklı işleyen madde analiz yöntemi olarak profil analizi

Öz:

This study investigates the utility of a recent generalized differential item functioning analysis method based on profile analysis (PADIF). Two characteristics of PADIF are that the analysis is not at the item level but at the level of item categories and that the method can be used with an arbitrary number of groups. In the study, 169213 students’ responses to the mathematics tests of the Programme for International Student Assessment (PISA) 2003 are used. The outcomes are aggregated at the country level. The results of PADIF are further evaluated in line with the findings in the literature. The results support PADIF as a promising method to reveal valuable information in international large scale assessments.

Anahtar Kelime:

Konular: Eğitim, Eğitim Araştırmaları

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık

Camilli, G., & Shepard, L. A. (1994). Methods for identifying biased test items. Thousand Oaks, CA: Sage Publications.
Ellerton, N.F. & Clements, M. A. (1991). Mathematics in language: A review of language factors in mathematics learning. Geelong, Victoria: Deakin University Press.
Heady, R. B., & Lucas, J. L. (1997). Permap: An interactive program for making perceptual maps. Behavior Research Methods, Instruments, & Computers, 29(3), 450-455.
Heady, R. B., & Lucas, J. L. (2010). MDS analysis using Permap 11.8. Retrieved from http://www.ucs.louisiana.edu/~rbh8900/
Klieme, E. & Baumert, J. (2001). Identifying national cultures of mathematics education: Analysis of cognitive demands and differential item functioning in TIMSS. European Journal of Psychology of Education, 16(3), 385 – 402.
Klieme, E., & Bos, W. (2000). Mathematikleistung und mathematischer Unterricht in Deutschland und Japan:Triangulation qualitativer und quantitativer Analysen am Beispiel der TIMSS-Studie. Zeitschrift fürErziehungswissenschaft,3.
O’Leary, M. (2001). Item format as a factor affecting the relative standing of countries in the Third International Mathematics and Science Study (TIMSS). Paper presented at the Annual Meeting of the American Educational Research Association, Seattle, WA.
OECD (2005). PISA 2003 technical report. Paris: OECD.
OECD (2009). Learning mathematics for life: A perspective from PISA. Paris: OECD.
Oshima, T. C., Raju, N. S., Flowers, C. P., & Slinde, J. A. (1998). Differential bundle functioning using the DFIT framework: Procedures for identifying possible sources of differential functioning. Applied Measurement in Education, 11, 353 – 369.
Pae, T. I. & Park, G. P. (2006). Examining the relationship between differential item functioning and differential test functioning. Language Testing, 23(4), 475 – 496.
Roussos, L. & Stout, W. (1996). A multidimensionality-based DIF analysis paradigm. Applied Psychological Measurement, 20, 355 – 371.
Verhelst, N. D. (2012). Profile analysis: a closer look at the PISA 2000 reading data. Scandinavian Journal of Educational Research, 56 (3), 315 – 332.
Wolf, R. M. (1998). Validity issues in international assessments. International Journal of Educational Research, 29, 491 – 501.
Yıldırım, H. H., & Yıldırım, S. (2011). Correlates of communalities as matching variables in differential item functioning analyses. H. U. Journal of Education, 40, 386 – 396.
Zumbo, B. D. (2003). Does item-level DIF manifest itself in scale-level analyses? Implications for translating language tests. Language Testing, 20, 136 – 147.
Zumbo, B. D. (2007). Three generations of DIF analyses: considering where it has been, where it is now, and where it is going. Language Assessment Quarterly, 4, 223 – 233.

APA	YILDIRIM H, YILDIRIM S, VERHELST N (2014). Profile analysis as a generalized differential item functioning analysis method. , 49 - 64.
Chicago	YILDIRIM H.Hüseyin,YILDIRIM Selda,VERHELST Norman Profile analysis as a generalized differential item functioning analysis method. (2014): 49 - 64.
MLA	YILDIRIM H.Hüseyin,YILDIRIM Selda,VERHELST Norman Profile analysis as a generalized differential item functioning analysis method. , 2014, ss.49 - 64.
AMA	YILDIRIM H,YILDIRIM S,VERHELST N Profile analysis as a generalized differential item functioning analysis method. . 2014; 49 - 64.
Vancouver	YILDIRIM H,YILDIRIM S,VERHELST N Profile analysis as a generalized differential item functioning analysis method. . 2014; 49 - 64.
IEEE	YILDIRIM H,YILDIRIM S,VERHELST N "Profile analysis as a generalized differential item functioning analysis method." , ss.49 - 64, 2014.
ISNAD	YILDIRIM, H.Hüseyin vd. "Profile analysis as a generalized differential item functioning analysis method". (2014), 49-64.

APA	YILDIRIM H, YILDIRIM S, VERHELST N (2014). Profile analysis as a generalized differential item functioning analysis method. Eğitim ve Bilim, 39(172), 49 - 64.
Chicago	YILDIRIM H.Hüseyin,YILDIRIM Selda,VERHELST Norman Profile analysis as a generalized differential item functioning analysis method. Eğitim ve Bilim 39, no.172 (2014): 49 - 64.
MLA	YILDIRIM H.Hüseyin,YILDIRIM Selda,VERHELST Norman Profile analysis as a generalized differential item functioning analysis method. Eğitim ve Bilim, vol.39, no.172, 2014, ss.49 - 64.
AMA	YILDIRIM H,YILDIRIM S,VERHELST N Profile analysis as a generalized differential item functioning analysis method. Eğitim ve Bilim. 2014; 39(172): 49 - 64.
Vancouver	YILDIRIM H,YILDIRIM S,VERHELST N Profile analysis as a generalized differential item functioning analysis method. Eğitim ve Bilim. 2014; 39(172): 49 - 64.
IEEE	YILDIRIM H,YILDIRIM S,VERHELST N "Profile analysis as a generalized differential item functioning analysis method." Eğitim ve Bilim, 39, ss.49 - 64, 2014.
ISNAD	YILDIRIM, H.Hüseyin vd. "Profile analysis as a generalized differential item functioning analysis method". Eğitim ve Bilim 39/172 (2014), 49-64.