Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis
Yıl: 2019 Cilt: 7 Sayı: 8 Sayfa Aralığı: 1166 - 1172 Metin Dili: İngilizce DOI: 10.24925/turjaf.v7i8.1166-1172.2515 İndeks Tarihi: 31-08-2020
Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis
Öz: The aim of this study was to compare estimation methods: least squares method (LS), ridgeregression (RR), Principal component regression (PCR) to estimate the parameters of multipleregression model in situations when the underlying assumptions of least squares estimation areuntenable because of multicollinearity. For this aim, the effect of some body measurements on bodyweights (height at withers and rumps, body length, chest width, chest girth and chest depth, front,middle and hind rump width) obtained from totally 85 Karayaka lambs at weaning period raised atResearch Farm of Ondokuz Mayis University was examined. Mean square error, R2 value andsignificance of parameters were used to evaluate estimator performance. The multicollinearity,between front and middle rump width which were used to estimate live weight, was eliminated byusing RR and PCR. Although research findings showed that RR method had the smallest MSE andthe highest R2 value, the estimates of PCR were determined to be more consistent when theimportance tests of parameters were taken into account. The results showed that principal componentregression approach should be used to estimate the live weight of Karayaka lambs at weaning period.
Anahtar Kelime: Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
- Albayrak AS. 2005. Çoklu doğrusal bağlantı halinde en küçük kareler tekniğinin alternatifi yanlı tahmin teknikleri ve bir uygulama. ZKÜ sosyal bilimler dergisi. 1(1): 105-126.
- Albayrak AS. 2006. Uygulamalı çok değişkenli istatistik teknikleri. 1 Baskı. Mamak/Ankara. Asil yayın. ISBN: 975- 9091-98-4.
- Alpar R. 1997. Uygulamalı çok değişkenli istatiksel yöntemler. 1. Baskı. Kızılay/Ankara. Kültür ofset.
- Alpar R. 2011. Uygulamalı çok değişkenli istatistiksel yöntemler. 3. Baskı. Kızılay/Ankara. Detay Yayımcılık. ISBN:978-605- 5437-42-8
- Anderson B. 1998. Scandinavian evidence on growth and age structure, ESPE 1997 Conference at Uppsala University.
- Çamdeviren H, Demir N, Kanık A, Keskin S. 2005. Use of Principal component scores in multiple linear regression models for prediction of Chlorophyll-a in reservoirs, Ecological Modelling 181: 581-589. DOI: 10.1016/j.ecolmodel.2004.06.043
- Çankaya S, Altop A, Kul E, Erener G. 2009. Faktör analiz skorlari kullanilarak karayaka kuzularinda canli ağirlik tahmini. Anadolu tarım bilim. derg, 24(2): 98-102.
- Draper NR, Smith H. 1981. Applied regression analysis. 2nd Edition. New York: John Wiley & Sons, Inc.
- Ergüneş E. 2004. En küçük kareler yöntemi ile ridge regresyon yönteminin karşılaştırılmalı olarak incelenmesi, Yüksek Lisans Tezi. Çukurova Üniversitesi Fen Bilimleri Enstitüsü.
- Gunst RF, Mason RL. 1980. Regression analysis and its application: A data-oriented approach. New York: Marcel Dekker.
- Hintze JL. 2007. NCSS User’s Guide III - Regression and Curve Fitting, Chapter 340- Principal Components Regression, Kaysville/Utah. NCSS Statistical System.
- Hoerl AE, Kennard RW. 1970. Ridge regression: Biased estimation for nonerthogonal problems. Technometrics, 12(1): 55-67.
- Huber PJ, Dutter R. 1974. Numerical solution of robust regression problems. In: Compstat 1974 ( Ed: G. Brickmann) 165 – 172. Phsika Verlag, Wein.
- Huber PJ. 1974. Numerical solution of robust regression problems. In COMPSTAT 1974, Proc. Symposium on Computational Statistics. Physike Verlag.
- Kleinbaum DG, Kupper LL, Muller KE, Nizam A. 1998. Applied regression analysis and other multivariable methods, R.R. Donnelly and Sons Duxburry Press, USA.
- Kurtuluş M. 2001. Ridge regresyon üzerine bir çalışma. Yüksek Lisans Tezi. Gazi Üniversitesi, Fen Bilimleri Enstitüsü. Ankara.
- Sangun L, Çankaya S, Kayaalp GT, Akar M. 2009. Use of factor analysis scores in multiple regression model for estimation of body weight from some body measurements in lizardfish. J. Anim. Vet. Adv. 8: 47-50.
- Topal M, Eyduran E, Yağanoğlu AM, Sönmez A, Keskin S. 2010. Çoklu doğrusal bağlantı durumunda ridge ve temel bileşenler regresyon analiz yöntemlerinin kullanımı. Atatürk Üniversitesi Ziraat Fakültesi Dergisi, 41(1): 53-57.
- Üçkardeş F, Ercan E, Narinç D, AKSOY T. 2012. Japon bıldırcınlarında yumurta ak indeksinin ridge regresyon yöntemiyle tahmin edilmesi. Akademik Ziraat Dergisi, 1(1): 11-20
| APA | CANKAYA S, Eker S, ABACI S (2019). Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. , 1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| Chicago | CANKAYA Soner,Eker Samet,ABACI SAMET HASAN Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. (2019): 1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| MLA | CANKAYA Soner,Eker Samet,ABACI SAMET HASAN Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. , 2019, ss.1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| AMA | CANKAYA S,Eker S,ABACI S Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. . 2019; 1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| Vancouver | CANKAYA S,Eker S,ABACI S Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. . 2019; 1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| IEEE | CANKAYA S,Eker S,ABACI S "Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis." , ss.1166 - 1172, 2019. 10.24925/turjaf.v7i8.1166-1172.2515 |
| ISNAD | CANKAYA, Soner vd. "Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis". (2019), 1166-1172. https://doi.org/10.24925/turjaf.v7i8.1166-1172.2515 |
| APA | CANKAYA S, Eker S, ABACI S (2019). Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. Türk Tarım - Gıda Bilim ve Teknoloji dergisi, 7(8), 1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| Chicago | CANKAYA Soner,Eker Samet,ABACI SAMET HASAN Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. Türk Tarım - Gıda Bilim ve Teknoloji dergisi 7, no.8 (2019): 1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| MLA | CANKAYA Soner,Eker Samet,ABACI SAMET HASAN Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. Türk Tarım - Gıda Bilim ve Teknoloji dergisi, vol.7, no.8, 2019, ss.1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| AMA | CANKAYA S,Eker S,ABACI S Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. Türk Tarım - Gıda Bilim ve Teknoloji dergisi. 2019; 7(8): 1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| Vancouver | CANKAYA S,Eker S,ABACI S Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis. Türk Tarım - Gıda Bilim ve Teknoloji dergisi. 2019; 7(8): 1166 - 1172. 10.24925/turjaf.v7i8.1166-1172.2515 |
| IEEE | CANKAYA S,Eker S,ABACI S "Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis." Türk Tarım - Gıda Bilim ve Teknoloji dergisi, 7, ss.1166 - 1172, 2019. 10.24925/turjaf.v7i8.1166-1172.2515 |
| ISNAD | CANKAYA, Soner vd. "Comparison of Least Squares, Ridge Regression and Principal Component Approaches in the Presence of Multicollinearity in Regression Analysis". Türk Tarım - Gıda Bilim ve Teknoloji dergisi 7/8 (2019), 1166-1172. https://doi.org/10.24925/turjaf.v7i8.1166-1172.2515 |
