Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels

DOĞAN GÜL, Çilem; ÇOKLUK BÖKEOĞLU, ÖMAY; GÜL, Emrah

Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels

ÖMAY ÇOKLUK BÖKEOĞLU, (Ankara Üniversitesi, Eğitim Bilimleri Fakültesi, Ölçme ve Değerlendirme Anabilim Dalı, Ankara, Türkiye)

Emrah GÜL, (Hakkari Üniversitesi, Ölçme ve Değerlendirme Dairesi Başkanlığı, Hakkari Türkiye)

Çilem DOĞAN GÜL (Ankara Üniversitesi, Eğitim Bilimleri Fakültesi, Ölçme ve Değerlendirme Anabilim Dalı, Ankara, Türkiye)

Kuram ve Uygulamada Eğitim Bilimleri

9 0

Yıl: 2016 Cilt: 16 Sayı: 1 Sayfa Aralığı: 319 - 330 Metin Dili: İngilizce İndeks Tarihi: 29-07-2022

Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels

Öz:

The study aims to examine whether differential item function is displayed in three different test forms that have item orders of random and sequential versions (easy-to-hard and hard-to-easy), based on Classical Test Theory (CTT) and Item Response Theory (IRT) methods and bearing item difficulty levels in mind. In the correlational research, the data from a total of 578 seventh graders were gathered using an Atomic Structures Achievement Test. R programming language and "difR" package were employed for all the analyses. As a result of the analyses, it was concluded that a comparison of IRT- and CTT-based methods indicate a greater number of items with distinctively significant differential item functioning. Different item ordering leads students at the same ability levels to display different performances on the same items. As a result, it is found that item order differentiates the probability of correct response to the items for those at the same ability levels. A test form of sequential easy-to-hard questions brings more advantages than that of a hard-to-easy sequence or a random version. The findings show that it is essential to arrange tests that are employed to make decisions about people in consideration with psychometric principles.

Anahtar Kelime:

Konular: Eğitim, Eğitim Araştırmaları

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Bibliyografik

Angoff, W. H. (Ed.). (1993). Perspectives on differential item functioning methodology. Differential item functioning. New Jersey, NJ: Lawrence Erlbaum Associates Publishers.
Ankara Üniversitesi Eğitim Bilimleri Fakültesi. (2011). Ankara Üniversitesi Eğitim Bilimleri Fakültesi'nin YGS hakkında görüşü [The view of Faculty of Education, Ankara University about the Higher Education Entrance Examination]. Retrieved from http://rigel2.cc.ankara.edu.tr/dyr.php?id=11705
Balch, W. R. (1989). Item order affects performance on multiple-choice exams. Teaching of Psychology, 16(2), 75-77.
Brenner, M. H. (1964). Test hardy, reliability, and discriminations of item hardy order. Journal of Applied Psychology, 48(2), 98-100.
Camilli, G., & Shepard, L. A. (1994). Methods for identifying biased test items. London, UK: Sage.
Carlson, J. L., & Ostrosky, A. L. (1992). Item sequence and student performance on multiple-choice exams: Further evidence. Journal of Economic Education, 2(3), 232-235.
Doğan-Gül, Ç. (2014). Madde güçlüklerine göre farklı sıralanan testlerde düşük ve yüksek kaygılı öğrencilerin akademik başarıları puanlarının karşılaştırılması [A comparison of academic achievement scores of students with high and low anxiety levels in different sequence tests according to item difficulty] (Master's thesis, Ankara University, Ankara, Turkey). Retrieved from http://tez2.yok.gov.tr/
Hambletton, R. K., & Swaminathan, H. (1989). Item response theory: Principles and applications. Boston, MA: Kluwer-Nijhoff Publishing.
Holland, P. W., & Wainer, H. (Ed.). (1993). Differential item functioning. New Jersey, NJ: Lawrence Erlbaum Associates Publishers.
Impara, J., & Foster, D. (2006) Strategies to minimize test fraud. In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development (pp. 91-114). Mahwah, NJ: Lawrence Erlbaum Associates.
Kubiszyen, T., & Borich, G. (2013). Educational testing and measurement: Classroom application and practice. Hoboken, NJ: John Wiley & Sons, INC.
Laffittee, R. G. (1984). Effects of item order on achievement test scores and students' perceptions of test hardy. Teaching of Psychology, 77(4), 212-214.
Magis, D., Beland, S., & Raiche, G. (2015). Collection of methods to detect dichotomous Differential Item Functioning (DIF). Package 'difR'. Retrieved from https://cran.r-project.org/ web/packages/difR/difR.pdf
Millsap, R. E., & Everson, H. T. (1993). Methodology review: Statistical approaches for assessing measurement bias. Applied Psychological Measurement, 17, 297-334.
Osterlind, S. (1983). Test item bias. Newbury Park, CA: Sage.
Pettijohn, T. F., & Sacco, M. F. (2007). Multiple-choice exam question order influences on student performance, completion time, and perceptions. Journal of Instructional Psychology, 34(3), 142-149.
Picou, A., & Milhomme, A. J. (1997). The effect of random and sequential versions on student test performance. Financial Practice & Education, 7, 85-90.
Santelices, M. V., & Wilson, M. (2012). On the relationship between differential item functioning and item hardy: An issue of methods? Item response theory approach to differential item functioning. Educational and Psychological Measurement 72(1), 5-36.
Tağ, S. M. (2012). Atomun yapısı konusunu öğrenmede klasik yöntemler ile bilgisayar destekli öğretimin öğrenci başarısına etkileri [The effects of classical methods and computer assisted instruction on student achievement in atomic structure learning] (Master's thesis, Fırat University, Elazığ, Turkey). Retrieved from http://tez2.yok.gov.tr/
Zumbo, B. D. (1999). A handbook on the theory and methods of Differential Item Functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (Ordinal) item scores. Ottawa ON: Directorate of Human Resources Research and Evaluation, Department of National Defense.
Zwick, R. J. (2012). A review of ETS differential item functioning assessment procedures: Flagging principles, minimum sample size requirements, and criterion refinement (Research Report). Educational Testing Service.

APA	ÇOKLUK BÖKEOĞLU Ö, GÜL E, DOĞAN GÜL Ç (2016). Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. , 319 - 330.
Chicago	ÇOKLUK BÖKEOĞLU ÖMAY,GÜL Emrah,DOĞAN GÜL Çilem Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. (2016): 319 - 330.
MLA	ÇOKLUK BÖKEOĞLU ÖMAY,GÜL Emrah,DOĞAN GÜL Çilem Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. , 2016, ss.319 - 330.
AMA	ÇOKLUK BÖKEOĞLU Ö,GÜL E,DOĞAN GÜL Ç Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. . 2016; 319 - 330.
Vancouver	ÇOKLUK BÖKEOĞLU Ö,GÜL E,DOĞAN GÜL Ç Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. . 2016; 319 - 330.
IEEE	ÇOKLUK BÖKEOĞLU Ö,GÜL E,DOĞAN GÜL Ç "Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels." , ss.319 - 330, 2016.
ISNAD	ÇOKLUK BÖKEOĞLU, ÖMAY vd. "Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels". (2016), 319-330.

APA	ÇOKLUK BÖKEOĞLU Ö, GÜL E, DOĞAN GÜL Ç (2016). Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. Kuram ve Uygulamada Eğitim Bilimleri, 16(1), 319 - 330.
Chicago	ÇOKLUK BÖKEOĞLU ÖMAY,GÜL Emrah,DOĞAN GÜL Çilem Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. Kuram ve Uygulamada Eğitim Bilimleri 16, no.1 (2016): 319 - 330.
MLA	ÇOKLUK BÖKEOĞLU ÖMAY,GÜL Emrah,DOĞAN GÜL Çilem Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. Kuram ve Uygulamada Eğitim Bilimleri, vol.16, no.1, 2016, ss.319 - 330.
AMA	ÇOKLUK BÖKEOĞLU Ö,GÜL E,DOĞAN GÜL Ç Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. Kuram ve Uygulamada Eğitim Bilimleri. 2016; 16(1): 319 - 330.
Vancouver	ÇOKLUK BÖKEOĞLU Ö,GÜL E,DOĞAN GÜL Ç Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. Kuram ve Uygulamada Eğitim Bilimleri. 2016; 16(1): 319 - 330.
IEEE	ÇOKLUK BÖKEOĞLU Ö,GÜL E,DOĞAN GÜL Ç "Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels." Kuram ve Uygulamada Eğitim Bilimleri, 16, ss.319 - 330, 2016.
ISNAD	ÇOKLUK BÖKEOĞLU, ÖMAY vd. "Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels". Kuram ve Uygulamada Eğitim Bilimleri 16/1 (2016), 319-330.