Yıl: 2020 Cilt: 28 Sayı: 3 Sayfa Aralığı: 1458 - 1473 Metin Dili: İngilizce DOI: 10.3906/elk-1907-92 İndeks Tarihi: 27-05-2020

Feature points-based image registration between satellite imagery and aerial images of agricultural land

Öz:
Rapid advancement in remote sensing sensors has resulted in an enormous increase in the use of satelliteimagery (SI) and images taken from unmanned aerial vehicles (UAVs) in a wide range of remote sensing applications.These applications include urban planning, environment monitoring, map updating, change detection, and precisionagriculture. This paper focuses on an agricultural application of SI and UAV images. SI-UAV images possess hightemporal, textural, and intensity differences due to rapid changes in agricultural crops with the passage of time. Featurepoints such as scale invariant feature transform (SIFT), oriented FAST and rotated BRIEF (ORB), and speeded-uprobust features (SURF) are not invariant to such differences and underperform in SI-UAV image registration. To dealwith this problem, we propose a new method that combines the strength of nearest neighbor (NN) and brute force (BF)descriptor matching strategies to register SI–UAV images. The proposed method is named NN-BF. For NN-BF firstcorresponding feature point descriptor matches are identified between SI-UAV images of the training set with overlaperror. Then the corresponding descriptors are matched with the descriptors of SI images of the test set with NNstrategy. The resulting descriptor matches are then further matched with the descriptors of UAV images of the testset using BF strategy. Finally, the descriptor matches obtained are processed with RANSAC to remove outliers andestimate a homography for image registration. Experiments are performed on an agricultural land image dataset. Theexperimental results show that the NN-BF method improves SIFT, SURF, and ORB feature point performances andalso outperforms recently proposed feature matching strategies for remote sensing images. SIFT on average obtains 6.1%and 18.9% better precision scores than SURF and ORB with NN-BF, respectively. SIFT also obtains lower root meansquare error than SURF and ORB with NN-BF.
Anahtar Kelime:

Konular: Mühendislik, Elektrik ve Elektronik Bilgisayar Bilimleri, Yazılım Mühendisliği Bilgisayar Bilimleri, Sibernitik Bilgisayar Bilimleri, Bilgi Sistemleri Bilgisayar Bilimleri, Donanım ve Mimari Bilgisayar Bilimleri, Teori ve Metotlar Bilgisayar Bilimleri, Yapay Zeka
Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • [1] Brown LG. A survey of image registration techniques. ACM Computing Surveys 1992; 24 (4): 325-376. doi: 10.1145/146370.146374
  • [2] Zitová B, Flusser J. Image registration methods: a survey. Image and Vision Computing 2003; 21 (11): 977-1000. doi: 10.1016/S0262-8856(03)00137-9
  • [3] Yang K, Pan A, Yang Y, Zhang S, Ong S et al. Remote sensing image registration using multiple image features. Remote Sensing 2017; 9 (6): 581.1-581.21. doi: 10.3390/rs9060581
  • [4] Ma J, Zhou H, Zhao J, Gao Y, Jiang J et al. Robust feature matching for remote sensing image registration via locally linear transforming. IEEE Transactions on Geoscience and Remote Sensing 2015; 53 (12): 6469-6481. doi: 10.1109/TGRS.2015.2441954
  • [5] Patel MI, Thakar VK, Shah SK. Image registration of satellite images with varying illumination level using HOG descriptor based SURF. Procedia Computer Science 2016; 93: 382-388. doi: 10.1016/j.procs.2016.07.224
  • [6] Saleem S, Bais A, Khawaja YM. Registering aerial photographs of farmland with satellite imagery. In: 2010 IEEE International Conference on Image Processing; Hong Kong, Hong Kong; 2010. pp. 945-948. doi: 10.1109/ICIP.2010.5651111
  • [7] Saleem S, Bais A, Sablatnig R. Towards feature points based image matching between satellite imagery and aerial photographs of agriculture land. Computers and Electronics in Agriculture 2016; 126: 12-20. doi: 10.1016/j.compag.2016.05.005
  • [8] Pajares G. Overview and current status of remote sensing applications based on unmanned aerial vehicles (UAVs). Photogrammetric Engineering & Remote Sensing 2015; 81 (4): 281-330. doi: 10.14358/PERS.81.4.281
  • [9] Liang J, Liu X, Huang K, Li X, Wang D et al. Automatic registration of multisensor images using an integrated spatial and mutual information (SMI) metric. IEEE Transactions on Geoscience and Remote Sensing 2014; 52 (1): 603-615. doi: 10.1109/TGRS.2013.2242895
  • [10] Tsai CH, Lin YC. An accelerated image matching technique for UAV orthoimage registration. ISPRS Journal of Photogrammetry and Remote Sensing 2017; 128: 130-145. doi: 10.1016/j.isprsjprs.2017.03.017
  • [11] Gong M, Zhao S, Jiao L, Tian D, Wang S. A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information. IEEE Transactions on Geoscience and Remote Sensing 2014; 52 (7): 4328-4338. doi: 10.1109/TGRS.2013.2281391
  • [12] Saleem S, Sablatnig R. A robust SIFT descriptor for multispectral images. IEEE Signal Processing Letters 2014; 21 (4): 400-403. doi: 10.1109/LSP.2014.2304073
  • [13] Nagarajan S, Schenk T. Feature-based registration of historical aerial images by area minimization. ISPRS Journal of Photogrammetry and Remote Sensing 2016; 116: 15-23. doi: 10.1016/j.isprsjprs.2016.02.012
  • [14] Schwind P, Suri S, Reinartz P, Siebert A. Applicability of the SIFT operator to geometric SAR image registration. International Journal of Remote Sensing 2010; 31 (8): 1959-1980. doi: 10.1080/01431160902927622
  • [15] Hasan M, Jia X, Robles-Kelly A, Zhou J, Pickering M. Multi-spectral remote sensing image registration via spatial relationship analysis on SIFT keypoints. IEEE International Geoscience and Remote Sensing Symposium 2010; 1011-1014. doi: 10.1109/IGARSS.2010.5653482
  • [16] Teke M, Temizel A. Multi-spectral satellite image registration using scale-restricted SURF. In: 2010 International Conference on Pattern Recognition; İstanbul, Turkey; 2010. pp. 2310-2313. doi: 10.1109/ICPR.2010.565
  • [17] Ricaurte P, Chilán C, Aguilera-Carrasco C, Vintimilla B, Sappa A. Feature point descriptors: infrared and visible spectra. Sensors 2014; 14 (2): 3690-3701. doi: 10.3390/s140203690
  • [18] Wong A, Clausi D. ARRSI: automatic registration of remote-sensing images. IEEE Transactions on Geoscience and Remote Sensing 2007; 45 (5): 1483-1493. doi: 10.1109/TGRS.2007.892601
  • [19] Wong A, Clausi D. AISIR: automated inter-sensor/inter-band satellite image registration using robust complex wavelet feature representations. Pattern Recognition Letters 2010; 31 (10): 1160-1167. doi: 10.1016/j.patrec.2009.05.016
  • [20] Saleem S, Bais A, Khawaja YM. Updating farmland satellite imagery using high resolution aerial images. In: IEEE 2011 Frontiers of Information Technology; Islamabad, Pakistan; 2011. pp. 133-136. doi: 10.1109/FIT.2011.32
  • [21] Sakarya U, Demirpolat C. SAR image time-series analysis framework using morphological operators and global and local information-based linear discriminant analysis. Turkish Journal of Electrical Engineering & Computer Sciences 2018; 26: 2958-2966. doi: 10.3906/elk-1712-339
  • [22] Zhuo X, Koch T, Kurz F, Fraundorfer F, Reinartz P. Automatic UAV image geo-registration by matching UAV images to georeferenced image data. Remote Sensing 2017; 9 (4): 376.1-376.25. doi: 10.3390/rs9040376
  • [23] Lowe DG. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 2004; 60 (2): 91-110. doi: 10.1023/B:VISI.0000029664.99615.94
  • [24] Rublee E, Rabaud V, Konolige K, Bradski G. ORB: An efficient alternative to SIFT or SURF. In: 2011 IEEE International Conference on Computer Vision; Barcelona, Spain; 2011. pp. 2564-2571. doi: 10.1109/ICCV.2011.6126544
  • [25] Bay H, Ess A, Tuytelaars T, Van Gool L, Speeded-up robust features (SURF). Computer Vision and Image Understanding 2008; 110 (3): 346-359. doi: 10.1016/j.cviu.2007.09.014
  • [26] Leutenegger S, Chli M, Siegwart RY. BRISK: Binary robust invariant scalable keypoints. In: 2011 IEEE International Conference on Computer Vision; Barcelona, Spain; 2011. pp. 2548-2555. doi: 10.1109/ICCV.2011.6126542
  • [27] Alcantarilla PF, Nuevo J, Bartoli A. Fast explicit diffusion for accelerated features in nonlinear scale spaces. In: 2013 British Machine Vision Conference; Bristol, UK; 2013. pp. 13.1-13.11. doi: 10.5244/C.27.13
  • [28] Mikolajczyk K, Schmid C. A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005; 27 (10): 1615-1630. doi: 10.1109/TPAMI.2005.188
  • [29] Yi Z, Zhiguo C, Yang X. Multi-spectral remote image registration based on SIFT. IET Electronics Letters 2008; 44 (2): 107-108. doi: 10.1049/el:20082477
  • [30] Vural MF, Yardimci Y, Temlzel A. Registration of multispectral satellite images with orientation-restricted SIFT. In: 2009 IEEE International Geoscience and Remote Sensing Symposium; Cape Town, South Africa; 2009. pp. 243-246. doi: 10.1109/IGARSS.2009.5417801
  • [31] Sedaghat A, Ebadi H. Remote sensing image matching based on adaptive binning SIFT descriptor. IEEE Transactions on Geoscience and Remote Sensing 2015; 53 (10): 5283-5293. doi: 10.1109/TGRS.2015.2420659
  • [32] Saleem S, Sablatnig R. A modified SIFT descriptor for image matching under spectral variations. In: 2013 International Conference on Image Analysis and Processing; Naples, Italy; 2013. pp. 652-661. doi: 10.1007/978-3- 642-41181-6_66
  • [33] Wu C, Wang Y, Karimi HR. A robust aerial image registration method using Gaussian mixture models. Neurocomputing 2014; 144: 546-552. doi: 10.1016/j.neucom.2014.04.012
  • [34] Zhao C, Goshtasby AA. Registration of multitemporal aerial optical images using line features. ISPRS Journal of Photogrammetry and Remote Sensing 2016; 117: 149-160. doi: 10.1016/j.isprsjprs.2016.04.002
  • [35] Wang G, Zhai Z, Xu B, Cheng Y. A parallel method for aerial image stitching using ORB feature points. In: 2017 IEEE/ACIS International Conference on Computer and Information Science; Wuhan, China; 2017. pp. 769-773. doi: 10.1109/ICIS.2017.7960096
  • [36] Lu Y, Gao K, Zhang T, Xu T. A novel image registration approach via combining local features and geometric invariants. PLOS One 2018; 13 (1): 1-18. doi: 10.1371/journal.pone.0190383
  • [37] Onyango F, Nex F, Peter M, Jende P. Accurate estimation of orientation parameters of UAV images through image registration with aerial oblique imagery. International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences 2017; 42: 599-605. doi: 10.5194/isprs-archives-XLII-1-W1-599-2017
  • [38] Fischler MA, Bolles RC. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 1981; 24 (6): 381-395. doi: 10.1145/358669.358692
  • [39] Chum O, Matas J. Matching with PROSAC–progressive sample consensus. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition; San Diego, CA, USA; 2005. pp. 220-226. doi: 10.1109/CVPR.2005.221
  • [40] Wu Y, Ma W, Gong M, Su L, Jiao L. A novel point-matching algorithm based on fast sample consensus for image registration. IEEE Geoscience and Remote Sensing Letters 2015; 12 (1): 43-47. doi: 10.1109/LGRS.2014.2325970
  • [41] Wu Y, Miao Q, Ma W, Gong M, Wang S. PSOSAC: particle swarm optimization sample consensus algorithm for remote sensing image registration. IEEE Geoscience and Remote Sensing Letters 2018; 15 (2): 242-246. doi: 10.1109/LGRS.2017.2783879
  • [42] Zhang K, Li X, Zhang J. A robust point-matching algorithm for remote sensing image registration. IEEE Geoscience and Remote Sensing Letters 2014; 11 (2): 469-473. doi: 10.1109/LGRS.2013.2267771
  • [43] Ma J, Jiang J, Zhou H, Zhao J, Guo X. Guided locality preserving feature matching for remote sensing image registration. IEEE Transactions on Geoscience and Remote Sensing 2018; 56 (8): 4435-4447. doi: 10.1109/TGRS.2018.2820040
  • [44] Wei Z, Han Y, Li M, Yang K, Yang Y et al. A small UAV based multi-temporal image registration for dynamic agricultural terrace monitoring. Remote Sensing 2017; 9 (9): 904.1-904.19. doi: 10.3390/rs9090904
  • [45] Tola E, Lepetit V, Fua P. Daisy: an efficient dense descriptor applied to wide-baseline stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 2010; 32 (5): 815-830. doi: 10.1109/TPAMI.2009.77
  • [46] Ye Y, Shan J, Hao S, Bruzzone L, Qin Y. A local phase based invariant feature for remote sensing image matching. ISPRS Journal of Photogrammetry and Remote Sensing 2018; 142: 205-221. doi: 10.1016/j.isprsjprs.2018.06.010
  • [47] Li J, Hu Q, Ai M. Rift: multi-modal image matching based on radiation-invariant feature transform. arXiv preprint arXiv:1804.09493 2018; 1-15. arxivId = 1804.09493
  • [48] Saleem S, Bais A, Sablatnig R, Ahmad A, Naseer N. Feature points for multisensor images. Computers & Electrical Engineering 2017; 1 (62): 511-523. doi: 10.1016/j.compeleceng.2017.04.032
  • [49] Ye Y, Shan J, A local descriptor based registration method for multispectral remote sensing images with non-linear intensity differences. ISPRS Journal of Photogrammetry and Remote Sensing 2014; 90: 83-95. doi: 10.1016/j.isprsjprs.2014.01.009
  • [50] Saleem S, Sablatnig R. Interest region description using local binary pattern of gradients. In: 2013 Scandinavian Conference on Image Analysis; Espoo, Finland; 2013. pp. 468-477. doi: 10.1007/978-3-642-38886-6_44
  • [51] Saleem S, Bais A, Sablatnig R. A performance evaluation of SIFT and SURF for multispectral image matching. In: 2012 International Conference on Image Analysis and Recognition; Aveiro, Portugal; 2012. pp. 166-173. doi: 10.1007/978-3-642-31295-3_20
APA ABBAS M, SALEEM S, SUBHAN F, BAIS A (2020). Feature points-based image registration between satellite imagery and aerial images of agricultural land. , 1458 - 1473. 10.3906/elk-1907-92
Chicago ABBAS Mohsin,SALEEM Sajid,SUBHAN Fazli,BAIS Abdul Feature points-based image registration between satellite imagery and aerial images of agricultural land. (2020): 1458 - 1473. 10.3906/elk-1907-92
MLA ABBAS Mohsin,SALEEM Sajid,SUBHAN Fazli,BAIS Abdul Feature points-based image registration between satellite imagery and aerial images of agricultural land. , 2020, ss.1458 - 1473. 10.3906/elk-1907-92
AMA ABBAS M,SALEEM S,SUBHAN F,BAIS A Feature points-based image registration between satellite imagery and aerial images of agricultural land. . 2020; 1458 - 1473. 10.3906/elk-1907-92
Vancouver ABBAS M,SALEEM S,SUBHAN F,BAIS A Feature points-based image registration between satellite imagery and aerial images of agricultural land. . 2020; 1458 - 1473. 10.3906/elk-1907-92
IEEE ABBAS M,SALEEM S,SUBHAN F,BAIS A "Feature points-based image registration between satellite imagery and aerial images of agricultural land." , ss.1458 - 1473, 2020. 10.3906/elk-1907-92
ISNAD ABBAS, Mohsin vd. "Feature points-based image registration between satellite imagery and aerial images of agricultural land". (2020), 1458-1473. https://doi.org/10.3906/elk-1907-92
APA ABBAS M, SALEEM S, SUBHAN F, BAIS A (2020). Feature points-based image registration between satellite imagery and aerial images of agricultural land. Turkish Journal of Electrical Engineering and Computer Sciences, 28(3), 1458 - 1473. 10.3906/elk-1907-92
Chicago ABBAS Mohsin,SALEEM Sajid,SUBHAN Fazli,BAIS Abdul Feature points-based image registration between satellite imagery and aerial images of agricultural land. Turkish Journal of Electrical Engineering and Computer Sciences 28, no.3 (2020): 1458 - 1473. 10.3906/elk-1907-92
MLA ABBAS Mohsin,SALEEM Sajid,SUBHAN Fazli,BAIS Abdul Feature points-based image registration between satellite imagery and aerial images of agricultural land. Turkish Journal of Electrical Engineering and Computer Sciences, vol.28, no.3, 2020, ss.1458 - 1473. 10.3906/elk-1907-92
AMA ABBAS M,SALEEM S,SUBHAN F,BAIS A Feature points-based image registration between satellite imagery and aerial images of agricultural land. Turkish Journal of Electrical Engineering and Computer Sciences. 2020; 28(3): 1458 - 1473. 10.3906/elk-1907-92
Vancouver ABBAS M,SALEEM S,SUBHAN F,BAIS A Feature points-based image registration between satellite imagery and aerial images of agricultural land. Turkish Journal of Electrical Engineering and Computer Sciences. 2020; 28(3): 1458 - 1473. 10.3906/elk-1907-92
IEEE ABBAS M,SALEEM S,SUBHAN F,BAIS A "Feature points-based image registration between satellite imagery and aerial images of agricultural land." Turkish Journal of Electrical Engineering and Computer Sciences, 28, ss.1458 - 1473, 2020. 10.3906/elk-1907-92
ISNAD ABBAS, Mohsin vd. "Feature points-based image registration between satellite imagery and aerial images of agricultural land". Turkish Journal of Electrical Engineering and Computer Sciences 28/3 (2020), 1458-1473. https://doi.org/10.3906/elk-1907-92