结合投影误差校正的快速SIFT图像拼接

赵岩; 陈月; 王世刚

doi:doi:10.3788/ope.20172506.1645

光学精密工程, 2017, 25 (6): 1645, 网络出版: 2017-07-10

结合投影误差校正的快速SIFT图像拼接

Corrected fast SIFT image stitching method by combining projection error

论文大纲

赵岩陈月王世刚

作者单位

吉林大学通信工程学院, 吉林长春 130012

图像拼接尺度不变特征变换(SIFT) 投影误差校正质量评价 Image stitching Scale Invariant Feature Transform (SIFT) correction for projection error quality evaluation

摘要

针对现有图像拼接方法实时性受限的问题, 提出了一种通过对图像拼接中重叠区域部分图像特征检测和投影误差校正两部分相结合的快速图像拼接方法。首先, 该方法特征检测范围仅集中在待拼接图像重叠区域的部分图像块, 从中获取尺度不变特征变换(SIFT)的特征点信息。然后, 在特征匹配后应用投影误差校正方法, 达到充分利用有限匹配点对计算出高精度投影变换矩阵的目的,避免了不必要的特征检测和匹配搜索, 继而大大加快了图像拼接速度。最后, 结合图像拼接的质量评价方法对图像拼接结果做出质量分析, 以反映改进方法的性能。实验结果表明: 对比文献所提出的快速图像拼接方法, 本文方法在保证图像拼接质量的前提下显著降低了拼接时间; 在所给的3组实验图像中, 拼接速度平均提升了54%左右, 证明了本文方法的可行性和有效性。

Abstract

Aiming at the problems of limited instantaneity in current image stitching methods, a fast image stitching method through combining feature points detection on part of image with correction of projection error in the overlapping area in the process of image stitching was proposed. Firstly, the scope of the feature detection for the method only focused on part of image blocks in the overlapping area of the image which were needed to be stitched for obtaining information of feature points for Scale Invariant Feature Transform (SIFT). Secondly, after the feature matching, the correction method was used for projection error to make full use of limited matching points to figure out high-precision projection transformation matrix, in order to avoid unnecessary feature detections and matching searching for greatly accelerating the speed to stitch images. Finally, combining with quality evaluation method for image stitching, quality analysis was made on image stitching result for reflecting the performance of the improved method. The result of the experiment shows: compared with the fast image stitching method mentioned in references, on the premise of maintaining the stitching quality of the image, the method in the thesis significantly reduces the time for the stitching process. Among three experimental images, the average stitching speed is increased approximately by 54%, which shows the feasibility and effectiveness of the proposed method.

参考文献

[1] 张宝龙, 李洪蕊, 李丹, 等. 一种针对车载全景系统的图像拼接算法的仿真［J］. 电子与信息学报, 2015, 37(5): 1149-1153.

ZHANG B L, LI H R, LI D, et al.. A simulation of image mosaic algorithm based on vehicle panorama system ［J］. Journal of Electronics & Information Technology, 2015, 37(5): 1149-1153. (in Chinese)

[2] 余淮, 杨文. 一种无人机航拍影像快速特征提取与匹配算法［J］. 电子与信息学报, 2016, 38(3): 509-516.

YU H, YANG W. A fast feature extraction and matching algorithm for unmanned aerial vehicle images ［J］. Journal of Electronics & Information Technology, 2016, 38(3): 509-516. (in Chinese)

[3] 杨磊, 任龙, 刘庆, 等. 基于FPGA 的大视场图像实时拼接技术的研究与实现［J］. 红外与激光工程, 2015, 44(6): 1929-1935.

YANG L, REN L, LIU Q, et al.. Research and implementation of large field image real-time mosaic technology based on FPGA ［J］. Infrared and Laser Engineering, 2015, 44(6): 1929-1935. (in Chinese)

[4] ANNIS F, KARTHIK R, VAIDEHI V. Image stitching with combined moment invariants and SIFT features ［J］. Procedia Computer Science, 2013, 19: 420-427.

[5] 杨磊, 曹剑中, 唐利孬, 等. 全景图像自动拼接算法的优化设计［J］. 红外与激光工程, 2015, 44(3): 985-990.

YANG L, CAO J Z, TANG L N, et al.. Optimized design of automatic panoramic images mosaic ［J］. Infrared and Laser Engineering, 2015, 44(3): 985-990. (in Chinese)

[6] LOWE D G. Distinctive image features from scale-invariant keypoints ［J］. International Journal of Computer Vision, 2004, 60(2): 91–110.

[7] BROWN M, LOWE D G. Automatic panoramic image stitching using invariant features ［J］. International Journal of Computer Vision, 2007, 74(1): 59-73.

[8] 曾峦, 王元钦, 谭久彬. 改进的SIFT 特征提取和匹配算法［J］. 光学精密工程, 2011, 19(6): 1391-1397．

ZENG L, WANG Y Q, TAN J B. Improved algorithm for SIFT feature extraction and matching ［J］．Opt. Precision Eng., 2011, 19(6): 1391-1397．(in Chinese)

[9] 刘洋, 韩广良, 史春蕾. 基于SIFT 算法的多表情人脸识别［J］. 液晶与显示, 2016,31(12): 1156-1160.

LIU Y, HAN G L, SHI C L. Recognition of expression-variant faces based on SIFT method ［J］. Chinese Journal of Liquid Crystals and Displays, 2016, 31(12): 1156-1160. (in Chinese)

[10] 王睿, 朱正丹. 融合全局颜色信息的尺度不变特征变换［J］. 光学精密工程, 2015, 23( 1) : 295-301．

WANG R, ZHU ZH D. SIFT matching with color invariant characteristics and global context ［J］. Opt. Precision Eng., 2015, 23(1): 295-301. (in Chinese)

[11] 何宾, 陶丹, 彭勃.高实时性F-SIFT图像拼接算法［J］. 红外与激光工程, 2013, 42(S2): 440-444.

HE B, TAO D, PENG B. High real F-SIFT image stitching algorithm ［J］. Infrared and Laser Engineering, 2013, 42(S2): 440-444. (in Chinese)

[12] YANG X, CHENG K T. Local difference binary for ultrafast and distinctive feature description ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(1): 188-194.

[13] 李丹,孙海涛,王海莉.一种改进的SIFT图像立体匹配算法［J］. 西南交通大学学报, 2015,50(3): 490-495.

LI D, SUN H T, WANG H L. An improved SIFT algorithm for image stereo matching ［J］. Journal of Southwest Jiao tong University, 2015, 50(3): 490-495. (in Chinese)

[14] 赵爱罡, 王宏力, 杨小冈, 等. 融合几何特征的压缩感知SIFT 描述子［J］. 红外与激光工程, 2015, 44(3): 1085-1091.

ZHAO A G, WANG H L, YANG X G, et al.. Compressed sense SIFT descriptor mixed with geometrical feature ［J］. Infrared and Laser Engineering, 2015, 44(3): 1085-1091. (in Chinese)

[15] DELLINGER F, DELON J, GOUSSEAU Y, et al.．SAR-SIFT: a SIFT-like algorithm for SAR image ［J］．IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(1): 453-466．

[16] 李玉峰,李广泽,谷绍湖,等. 基于区域分块与尺度不变特征变换的图像拼接算法［J］. 光学精密工程, 2016,24(5): 1197-1205.

LI Y F, LI G Z, GU S H, et al.. Image mosaic algorithm based on area blocking and SIFT ［J］. Opt. Precision Eng., 2016, 24(5): 1197-1205. (in Chinese)

[17] 陈月,赵岩,王世刚. 图像局部特征自适应的快速SIFT图像拼接方法［J］. 中国光学, 2016,9(4): 415-422.

CHEN Y, ZHAO Y, WANG S G. Fast image stitching method based on SIFT with adaptive local image feature ［J］. Chinese Optics, 2016, 9(4): 415-422. (in Chinese)

[18] 郭汉洲, 郭立红, 吕游. 结合MSER 与HSOG 的目标局部特征提取［J］. 液晶与显示, 2016,31(11): 1070-1078.

GUO H Z, GUO L H, LV Y. Target local feature extraction combined MSER and HSOG ［J］. Chinese Journal of Liquid Crystals and Displays, 2016, 31(11): 1070-1078. (in Chinese)

[19] CHEN Y, SHANG L. Improved SIFT image registration algorithm on characteristic statistical distributions and consistency constraint ［J］. Optik-International Journal for Light and Electron Optics, 2016, 127(2): 900-911.

[20] PENG G, CAI Y L, HONG W. An Improvement of image registration based on phase correlation ［J］. Optik-International Journal for Light and Electron Optics, 2014, 125(22): 6709-6712.

[21] 万国挺, 王俊平, 李锦, 等. 图像拼接质量评价方法［J］. 通信学报, 2013,34(8): 76-81.

WAN G T, WANG J P, LI J, et al.. Method for quality assessment of image mosaic ［J］. Journal on Communications, 2013, 34(8): 76-81. (in Chinese)

赵岩, 陈月, 王世刚. 结合投影误差校正的快速SIFT图像拼接[J]. 光学精密工程, 2017, 25(6): 1645. ZHAO Yan, CHEN Yue, WANG Shi-gang. Corrected fast SIFT image stitching method by combining projection error[J]. Optics and Precision Engineering, 2017, 25(6): 1645.

结合投影误差校正的快速SIFT图像拼接

关于本站 Cookie 的使用提示

全站搜索

结合投影误差校正的快速SIFT图像拼接

相关论文

相关资讯

关于本站 Cookie 的使用提示

全站搜索