一种改进SURF算法的无人机影像快速配准方法An improved SURF algorithm-based UAV image fast registration method
徐瑞瑞,雷添杰,程结海,路京选,曲伟
摘要(Abstract):
无人机遥感系统应用领域较为广阔,为了解决无人机影像拼接过程中存在幅宽小、数量多、重叠度不规则等问题,研究提出一种以实际应用需要为导向的无人机遥感影像快速处理方法。在SURF(Speed Up Robust Feature)算法的基础上,先采用PROSAC(Progressive Sample Consensus)算法去除大量匹配点对提高遥感影像配准的精度,然后采用GPU(Graphic Processing Unit)并行运算提高改进SURF算法的计算速度,最后再使用PROSAC几何验证实现研究区影像精准拼接。结果表明:改进SURFGPU算法的准确率比SURF算法提高了7%,像元精度达到0.4个像元;改进的SURFGPU算法用于无人机遥感影像配准的运行时间比SURF算法约少16倍,计算时间达到毫秒级。改进SURF算法具有更好的匹配精度和更快的运行速度,能满足无人机遥感影像配准速度和精度的要求,尤其适用于应急救援等实时性要求较高的应用领域。
关键词(KeyWords): 无人机;遥感影像配准;SURF算法;SURFGPU算法;并行计算
基金项目(Foundation): “十三五”国家重点研发计划项目(2017YFB0504105);; 国家自然科学基金项目(41601569)
作者(Author): 徐瑞瑞,雷添杰,程结海,路京选,曲伟
DOI: 10.13928/j.cnki.wrahe.2021.04.003
参考文献(References):
- [1] 张永生.现场直播式地理空间信息服务的构思与体系[J].测绘学报,2011,40(1):1-4.ZHANG Yongsheng.The conception and architecture of live-service for geospatial information[J].Acta Geodaetica et Cartographica Sinica,2011,40(1):1-4.
- [2] 何敬,李永树,鲁恒,等.基于SIFT特征点的无人机影像拼接方法研究[J].光电工程,2011,38(2):122-126.HE Jing,LI Yongshu,LU Heng,et al.Research of UAV aerial image mosaicbased on SIFT[J].Opto-Electronic Engineering,2011,38(2):122-126.
- [3] ZITOVA B,FLUSSER J.Image registration methods:a survey[J].Image & Vision Computing,2003,21(11):977-1000.
- [4] 张小洪,李博,杨丹.一种新的Harris多尺度角点检测[J].电子与信息学报,2007,29 (7):1735-1738.ZHANG Xiaohong,LI Bo,YANG Dan.A novel Harris multi-scale corner detection algorithm[J].Journal of Electronics and Information Technology,2007,29 (7):1735-1738.
- [5] SMITH S M,BRADY J M.SUSAN:a new approach to low level image processing[J].International Journal of Computer Vision,1997,23(1):45-78.
- [6] LOWE D G.Distinctive image features from scale-invariantkeypoints[J].International Journal of Computer Vision,2004,60 (2):91-110.
- [7] BAY H,ESS A,TUYTELAARS T,et al.Speeded-Up robust features (SURF)[J].Computer Vision and Image Understanding,2008,110(3):346-359.
- [8] ARTAL R M,TARDOS J D.ORB-SLAM2:an open-source SLAM system for monocular,stereo,and RGB-D cameras[J].IEEE Transactions on Robotics,2017,33(5):1255-1262.
- [9] 董强,刘晶红,王超,等.基于改进BRISK的图像拼接算法[J].电子与信息学报,2017,39(2):444-450.DONG Qiang,LIU Jinghong,WANG Chao,et al.Image mosaic algorithm based on improved BRISK[J].Journal of Electronics & Information Technology,2017,39(2):444-450.
- [10] 李鹏,武文波,王宗伟.基于非线性尺度空间的多源遥感影像匹配[J].测绘科学,2015,40(7):41-44+103.LI Peng,WU Wenbo,WANG Zongwei.Multi-source remote sensing images matching based on nonlinear scale space[J].Science of Surveying and Mapping,2015,40(7):41-44.
- [11] 梁焕青,范永弘,万惠琼,等.一种运用AKAZE特征的无人机遥感影像拼接方法[J].测绘科学技术学报,2016,33(1):71-75.LIANG Huanqing,FAN Yonghong,WAN Huiqiong,et al.Mosaic algorithm of UAV images based on AKAZE features[J].Journal of Geomatics Science and Technology,2016,33(1):71-75.
- [12] LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision,2004,60(2):91-110.
- [13] 刘立,彭复员,赵坤,等.采用简化SIFT算法实现快速图像匹配[J].红外与激光工程,2008,37 (1):181-184.LIU Li,PENG Fuyuan,ZHAO Kun,et al.Simplified SIFT algorithm for fast image matching[J].Infrared and Laser Engineering,2008,37(1):181-184.
- [14] LUO J,GWUN O.A comparison of SIFT,PCA-SIFT and SURF[J].International Journal of Image Processing,2009,3 (4):143-152.
- [15] 杨博雄,杨雨绮.利用PCA进行深度学习图像特征提取后的降维研究[J].计算机系统应用,2019,28(1):279-283.YANG Boxiong,YANG Yuqi.Applying PCA to dimensionality reduction of image features extracted by deep learning[J].Computer Systems & Applications,2019,28(1):279-283.
- [16] 朱佳文,屈新原,高小伟.基于CSIFT算法的UAV影像配准技术研究[J].首都师范大学学报(自然科学版),2013,34(4):69-74.ZHU Jiawen,QU Xinyuan,GAO Xiaowei.Study on UAV image registration technique based on CSIFT[J].Journal of Capital Normal University (Natural Science Edition),2013,34(4):69-74.
- [17] FISCHLER M A,BOLLES R C.Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography[J].Communications of The ACM,1981,24(6):381-395.
- [18] 李振宇,田源,陈方杰,等.基于改进ORB和PROSAC的无人机航拍图像拼接算法[J].激光与光电子学进展,2019,56(23):91-99.LI Zhenyu,TIAN Yuan,CHEN Fangjie,et al.Aerial image stitching algorithm for unmanned aerial vehicles based on improved ORB and PROSAC[J]Laser & Optoelectronics Progress,2019,56(23):91-99.
- [19] 李静,杨宜民,张学习.一种改进的MLESAC基本矩阵估计算法[J].计算机工程,2012,38(19):214-217.LI Jing,YANG Yimin,ZHANG Xuexi.An improved MLESAC algorithm for estimating fundamental matrix[J].computer engineering,2012,38(19):214-217.
- [20] 魏若岩,金雅素.抽样一致性及其改进算法综述[J].智能计算机与应用,2019,9(5):17-24.WEI Ruoyan,JIN Yasu.Overview of the RANSAC and its improvement algorithm[J].Intelligent Computer and Applications,2019,9(5):17-24.
- [21] SHOJAEDINI E,MAJD M,SAFABAKHSH R.Novel adaptive genetic algorithm sample consensus[J].Applied Soft Computing,2019,77:635-642.
- [22] 徐晓伟.无人机影像匹配算法研究[D].西安:长安大学,2019.XU Xiaowei.Research on UAV Image Matching Algorithm[D].Xian:Changan University,2019.
- [23] RASHID M,KHAN M A,SHARIF M,et al.Object detection and classification:a joint selection and fusion strategy of deep convolutional neural network and SIFT point features[J].Multimedia Tools and Applications,2019,78(12):15751-15777.
- [24] 李学亮,王维.基于CNN和SIFT特征的遥感图像变化检测[J].电子测量技术,2019,42(21):87-91.LI Xueliang,WANG Wei.Remote sensing image change detection based on CNN and SIFT features[J].Electronic Measurement Technology.,2019,42(21):87-91.
- [25] ACHARYA K A,VENKATESH BABU R,VADHIYAR S S.A real-time implementation of SIFT using GPU[J].Journal of Real-Time Image Processing,2018,14(2):267-277.
- [26] 王洪光,黄北生,王学生.基于CUDA的二叉树图像拼接算法研究[J].地理空间信息,2019,17(12):103-105+109+11.WANG Hongguang,HUANG Beisheng,WANG Xuesheng.Research on binary tree image mosaic algorithm based on CUDA[J].Geospatial Information,2019,17(12):103-105+109+11.
- [27] RAMKUMAR B,LABER R,BOJINOV H,et al.GPU acceleration of the KAZE image feature extraction algorithm[J].Journal of Real-Time Image Processing,2020,17(5):1169-1182.
- [28] 胡晓彤,任辉,刘楠.尺度与特征强度自适应的SURF特征点匹配算法[J].天津科技大学学报,2019,34(2):72-76.HU Xiaotong,REN Hui,LIU Nan.Adaptive SURF feature points matching algorithm based on scale and feature intensity[J].Journal of Tianjin University of Science & Technology,2019,34(2):72-76.
- [29] 潘建平,郝建明,赵继萍.基于SURF的图像配准改进算法[J].国土资源遥感,2017,29(1):110-115.PAN Jianping,HAO Jianming,ZHAO Jiping.Improved algorithm based on SURF for image registration[J].Remote Sensing for Land & Resources,2017,29(1):110-115.
- [30] 刘金硕,曾秋梅,邹斌,等.快速鲁棒特征算法的CUDA加速优化[J].计算机科学,2014,41(4):24-27.LIU Jinshuo,ZENG Qiumei,ZOU Bin,et al.Speed-up robust feature image registration algorithm based on CUDA[J].Computer Science,2014,41(4):24-27.