Investigating Test Equating Methods in Small Samples Through Various Factors*

ÖMÜR SÜNBÜL, SEÇİL; AŞİRET, Semih

Investigating Test Equating Methods in Small Samples Through Various Factors*

Semih AŞİRET, (Mersin Üniversitesi, Eğitim Fakültesi, Eğitim Bilimleri Ölçme ve Değerlendirme Anabilim Dalı, Mersin, Türkiye)

Seçil Ömür SÜNBÜL (Mersin Üniversitesi, Eğitim Fakültesi, Eğitim Bilimleri Ölçme ve Değerlendirme Anabilim Dalı, Mersin, Türkiye)

Kuram ve Uygulamada Eğitim Bilimleri

12 0

Yıl: 2016 Cilt: 16 Sayı: 2 Sayfa Aralığı: 647 - 668 Metin Dili: İngilizce İndeks Tarihi: 29-07-2022

Investigating Test Equating Methods in Small Samples Through Various Factors*

Öz:

In this study, equating methods for random group design using small samples through factors such as sample size, difference in difficulty between forms, and guessing parameter was aimed for comparison. Moreover, which method gives better results under which conditions was also investigated. In this study, 5,000 dichotomous simulated data consistent with the three-parameter logistic model were produced for each form (X and Y) by manipulating the factors' levels for random group design. In order to equate two test forms, the random groups design was used in this study. Simulated test forms were equated using the equating methods of identity, mean, linear, circle-arc, and 2- and 3-moments pre-smoothed equipercentile for different sample sizes (10, 25, 50, 75, 100, 150, 200) through 100 replications. The results obtained from this simulation study were evaluated based on the criterion of equating error (RMSE). The findings indicated that in the case where the sample size was 50 or more and the difficulty difference between forms was 0.4, equating the forms was concluded to give better results than not equating. Moreover, the circle-arc and mean-equating methods produced lower equating errors than other equating methods for small-sample equating under most of the conditions studied.

Anahtar Kelime:

Konular: Eğitim, Eğitim Araştırmaları

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Bibliyografik

Angoff, W. H. (1984). Scales, norms, and equivalent scores. Princeton, NJ: Educational Testing Service.
Babcock, B., Albano, A., & Raymond, M. (2012). Nominal weights mean equating: A method for very small samples. Educational and Psychological Measurement, 72(4), 608-628.
Bozdağ, S. (2010). Şans başarısının test eşitlemeye etkisi [The effect of chance of success on test equalization] (Master's thesis, Mersin University, Mersin, Turkey). Retrieved from https://tez.yok.gov.tr/UlusalTezMerkezi/
Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Mason, OH: Cengage Learning.
Cui, Z., & Kolen, M. J. (2009). Evaluation of two new smoothing methods in equating: The cubic b-spline pre-smoothing method and the direct pre-smoothing method. Journal of Educational Measurement, 46(2), 135-158.
Devdass, S. (2011). Conditions affecting the accuracy of classical equating methods for small samples under the NEAT design: A simulation study (Doctoral dissertation). University of North Carolina, NC.
Donlon, T. (Ed.). (1984). The College Board technical handbook for the scholastic aptitude test and achievement tests. New York: College Entrance Examination Board.
Dorans, N. J., Moses, T. P., & Eignor, D. R. (2010). Principles and practices of test score equating (ETS Research Report No. RR-10-29). Princeton, NJ: ETS.
Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and Applications. New York, NY: Springer.
Hanson, B. A., Zeng, L., & Colton, D. (1994). A comparison of pre-smoothing and post- smoothing methods in equipercentile equating (ACT Research Report No. 94-4). Iowa City, IA: American College Testing.
Harris, D. J., & Crouse, J. D. (1993). A study of criteria used in equating. Applied Measurement in Education, 6, 195-240.
Heh, V. K. (2007). Equating accuracy using small samples in the random groups design (Doctoral dissertation). Patton College of Education at Ohio University, Athens, OH.
Kim, S., vonDavier, A. A., & Haberman, S. (2006). An alternative to equating with small samples in the non-equivalent groups anchor test design. Paper presented at the annual Meeting of the National Council on Measurement in Education, San Francisco, CA.
Kim, S., vonDavier, A. A., & Haberman, S. (2008). Small-sample equating using a synthetic linking function. Journal of Educational Measurement, 45(4), 325-342.
Kolen, M. J. (1988). Traditional equating methodology. Educational Measurement: Issues and Practice, 7(4), 29-37.
Kolen, M. J., & Brennan, R. J. (1995). Test equating: Methods and practices. New York, NY: Springer-Verlag.
Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking: Method and practice (2nd ed.). New York, NY: Springer-Verlag.
Kurtz, A. M., & Dwyer, A. C. (2013). Small sample equating: Best practices using a Sas Macro. Retrieved from http://analytics.ncsu.edu/sesug/2013/BtB-11.pdf
Livingston, S. A. (1993). Small-sample equating with log-linear smoothing. Journal of Educational Measurement, 30, 23-39.
Livingston, S. A. (2004). Equating test scores (without IRT). Princeton, NJ: ETS.
Livingston, S. A., & Kim, S. (2009b). The circle-arc method for equating in small samples. Journal of Educational Measurement, 46(3), 330-343.
Livingston, S. A., & Kim, S. (2010). Random-groups equating with samples of 50 to 400 test takers. Journal of Educational Measurement, 47, 175-185.
Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
Öztürk, N. (2010). Akademik personel ve lisansüstü eğitimi giriş sınavı puanlarının eşitlenmesi üzerine bir çalışma [A study on equating the scores of the academic staff and postgraduate education entrance exam] (Master's thesis, Hacettepe University, Ankara, Turkey). Retrieved from https://tez.yok.gov.tr/UlusalTezMerkezi/
Öztürk, N., & Anıl, D. (2012). Akademik personel ve lisansüstü eğitimi giriş sınavı puanlarının eşitlenmesi üzerine bir çalışma [A study on equating the scores of the academic staff and postgraduate education entrance exam]. Eğitim ve Bilim, 37(165), 181-193.
Parshall, C. G., Houghton, P. D. B., & Kromrey, J. D. (1995). Equating error and statistical bias in small sample linear equating. Journal of Educational Measurement, 32(1), 37-54.
Skaggs, G. (2005). Accuracy of random groups equating with very small samples. Journal of Educational Measurement, 42(4), 309-330.
vonDavier, A. A., Holland, P. W., & Thayer, D. T. (2004). The kernel method of test equating. New York, NY: Springer-Verlag.

APA	AŞİRET S, ÖMÜR SÜNBÜL S (2016). Investigating Test Equating Methods in Small Samples Through Various Factors*. , 647 - 668.
Chicago	AŞİRET Semih,ÖMÜR SÜNBÜL SEÇİL Investigating Test Equating Methods in Small Samples Through Various Factors*. (2016): 647 - 668.
MLA	AŞİRET Semih,ÖMÜR SÜNBÜL SEÇİL Investigating Test Equating Methods in Small Samples Through Various Factors*. , 2016, ss.647 - 668.
AMA	AŞİRET S,ÖMÜR SÜNBÜL S Investigating Test Equating Methods in Small Samples Through Various Factors*. . 2016; 647 - 668.
Vancouver	AŞİRET S,ÖMÜR SÜNBÜL S Investigating Test Equating Methods in Small Samples Through Various Factors*. . 2016; 647 - 668.
IEEE	AŞİRET S,ÖMÜR SÜNBÜL S "Investigating Test Equating Methods in Small Samples Through Various Factors*." , ss.647 - 668, 2016.
ISNAD	AŞİRET, Semih - ÖMÜR SÜNBÜL, SEÇİL. "Investigating Test Equating Methods in Small Samples Through Various Factors*". (2016), 647-668.

APA	AŞİRET S, ÖMÜR SÜNBÜL S (2016). Investigating Test Equating Methods in Small Samples Through Various Factors*. Kuram ve Uygulamada Eğitim Bilimleri, 16(2), 647 - 668.
Chicago	AŞİRET Semih,ÖMÜR SÜNBÜL SEÇİL Investigating Test Equating Methods in Small Samples Through Various Factors*. Kuram ve Uygulamada Eğitim Bilimleri 16, no.2 (2016): 647 - 668.
MLA	AŞİRET Semih,ÖMÜR SÜNBÜL SEÇİL Investigating Test Equating Methods in Small Samples Through Various Factors*. Kuram ve Uygulamada Eğitim Bilimleri, vol.16, no.2, 2016, ss.647 - 668.
AMA	AŞİRET S,ÖMÜR SÜNBÜL S Investigating Test Equating Methods in Small Samples Through Various Factors*. Kuram ve Uygulamada Eğitim Bilimleri. 2016; 16(2): 647 - 668.
Vancouver	AŞİRET S,ÖMÜR SÜNBÜL S Investigating Test Equating Methods in Small Samples Through Various Factors*. Kuram ve Uygulamada Eğitim Bilimleri. 2016; 16(2): 647 - 668.
IEEE	AŞİRET S,ÖMÜR SÜNBÜL S "Investigating Test Equating Methods in Small Samples Through Various Factors*." Kuram ve Uygulamada Eğitim Bilimleri, 16, ss.647 - 668, 2016.
ISNAD	AŞİRET, Semih - ÖMÜR SÜNBÜL, SEÇİL. "Investigating Test Equating Methods in Small Samples Through Various Factors*". Kuram ve Uygulamada Eğitim Bilimleri 16/2 (2016), 647-668.