红外与激光工程, 2018, 47 (9): 0926003, 网络出版: 2018-10-06  

改进模型估计的无人机侦察视频快速拼接方法

Fast mosaic method of unmanned aerial vehicle reconnaissance video based on improvement model fitting
作者单位
陆军工程大学 无人机工程系, 河北 石家庄 050003
摘要
针对提高无人机侦察视频的拼接速度与效果的问题, 提出一种改进模型估计的无人机侦察视频快速拼接方法。首先, 基于自适应鲁棒性尺度不变的特征检测子对视频各帧进行基于点的特征匹配。其次, 提出改进的随机抽样一致性算法进行模型估计, 并去除误匹配点。最后, 提出侦察影像快速拼接算法, 计算各影像变换到正射拼接图的单应性矩阵, 完成视频序列拼接。实验结果表明: 改进的随机抽样一致性算法在保证鲁棒性的同时, 提高了执行速度; 侦察影像快速拼接算法提高了拼接速度, 同时改善了拼接效果。
Abstract
In order to improve the speed and quality of video mosaic, Fast Mosaic of Unmanned Aerial Vehicle Video based on Improvement Model Fitting (FMUAVRVIMF) was proposed. Firstly, Fast Adaptive Robust Invariant Scalable Feature Detector (FARISFD) was used for video frames registration. Then, the improved Random Sample Consensus(RANSAC) algorithm was proposed for model fitting, and false matching points were removed. Finally, Fast Mosaic of Reconnaissance Frames algorithm was proposed to calculate homography matrix which transformed frames to orthophoto mosaic image, the video sequence mosaic was compeleted. The experiment results show that Improved Random Sample Consensus ensures the robustness, and the mosaic speed was increased, and the mosaic effect was improved.
参考文献

[1] 余淮, 杨文. 一种无人机航拍影像快速特征提取与匹配算法[J]. 电子与信息学报, 2016, 38(3): 509-516.

    Yu Huai, Yang Wen. A fast feature extraction and matching algorithm for unmanned aerial vehicle images [J]. Journal of Electronics and Information Technology, 2016, 38(3): 509-516. (in Chinese)

[2] 缪君, 储珺, 张桂梅. 少量交互的多视角图像目标分割算法[J]. 计算机辅助设计与图形学学报, 2017, 29(1): 115-123.

    Liao Jun, Chu Jun, Zhang Guimei. Object segmentation from multi-views images with a few interactions [J]. Journal of Computer-Aided Design & Computer Graphics, 2017, 29(1): 115-123. (in Chinese)

[3] 梁焕青, 范永弘, 万惠琼, 等. 一种运用AKAZE特征的无人机遥感影像拼接法[J]. 测绘科学技术学报, 2016, 33(1): 71-75.

    Liang Huanqing, Fan Yonghong, Wan Huiqiong, et al. Mosaic algorithm of UAV images based on AKAZE feature [J]. Journal of Geomatics Science and Technology, 2016, 33(1): 71-75. (in Chinese)

[4] Fischler M, Bolles R. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography [J]. Communication of the ACM, 1981, 24(6): 381-395.

[5] Matas J, Chum O. Randomized RANSAC with sequential probability ratio test [C]//Proceedings of the 10th IEEE International Conference on Computer Vision, 2005: 1727-1732.

[6] 陈付幸, 王润生. 基于预检验的快速随机抽样一致性算法 [J]. 软件学报, 2005, 16(8): 1431-1437.

    Chen Fuxing, Wang Runsheng. Fast RANSAC with preview model parameters evaluation [J]. Journal of Software, 2005, 16(8): 1431-1437. (in Chinese)

[7] 田文, 王宏远, 徐帆, 等. RANSAC算法的自适应Tc, d预检验 [J]. 中国图象图形学报, 2009, 14(5): 973-977.

    Tian Wen, Wang Hongyuan, Xu Fan, et al. Enhanced RANSAC with Adaptive Pre-verification [J]. Journal of Image and Graphics, 2009, 14(5): 973-977. (in Chinese)

[8] Zhou G. Geo-referencing of video flow from small low-cost civilian UAV [J]. IEEE Transactions on Auto-mation Science and Engineering, 2010, 7(1): 156-166. (in Chinese)

[9] 程咏梅, 张绍武, 花永强, 等. 基于SIFT联合描述子的航拍视频图像镶嵌[J]. 西北工业大学学报, 2010, 28(1): 51-56.

    Cheng Yongmei, Zhang Shaowu, Hua Yongqiang, et al. A better aerial video image mosaic algorithm using SIFT combined descriptors [J]. Journal of North-western Polytechnical University, 2010, 28(1): 51-56. (in Chinese)

[10] 刘善磊, 王光辉, 石善球, 等. 一种无人机视频帧自动拼接方法 [J]. 测绘科学, 2013, 38(5): 78-80.

    Liu Shanlei, Wang Guanghui, Shi Shanqiu, et al. A method for automatic stitching of UAV video frames [J]. Science of Surveying and Mapping, 2013, 38(5): 78-80. (in Chinese)

[11] 郑晖, 黎晓东, 渠永平. 无人机视频流倾斜影像快速拼接方法 [J]. 科学技术与工程, 2016, 16(32): 263-268.

    Zheng Hui, Li Xiaodong, Qu Yongping. Oblique video flow mosaic based on unmanned aerial vehicle [J]. Science Technology and Engineering, 2016, 16(32): 263-268. (in Chinese)

[12] 杨涛, 张艳宁, 张秀伟, 等. 基于场景复杂度与不变特征的航拍视频实时配准算法[J]. 电子学报, 2010, 38(5): 1069-1077.

    Yang Tao, Zhang Yanning, Zhang Xiuwei, et al. Scene complexity and invariant feature based real-time aerial video registration algorithm[J]. Acta Electronicasinica, 2010, 38(5): 1069-1077. (in Chinese)

[13] 张岩, 李建增, 李德良, 等. 快速自适应鲁棒性尺度不变的特征检测子 [J]. 系统工程与电子技术, 2017, 39(6): 1406-1413.

    Zhang Yan, Li Jianzeng, Li Deliang, et al. Fast adaptive robust invariant scalable feature detector[J]. Systems Engineering and Electronics, 2017, 39(6): 1406-1413. (in Chinese)

[14] Pablo F, Pablo F, Adrien B, et al. KAZE features [C]//Proceedings of the 12th European Conference on Computer Vision, Florence, 2012: 214-227.

[15] Mikolajczyk K, Tuytelaars T, Schmid C, et al. A comparison of affine region detectors [J]. International Journal of Computer Vision, 2005, 65(1-2): 43-72.

[16] Pablo F, Jesus N, Adrien B. Fast explicit diffusion for accelerated features in nonlinear scale spaces [C]//Proceedings of the British Machine Vision Conference, 2013: 2157-2163.

孙世宇, 张岩, 胡永江, 李建增. 改进模型估计的无人机侦察视频快速拼接方法[J]. 红外与激光工程, 2018, 47(9): 0926003. Sun Shiyu, Zhang Yan, Hu Yongjiang, Li Jianzeng. Fast mosaic method of unmanned aerial vehicle reconnaissance video based on improvement model fitting[J]. Infrared and Laser Engineering, 2018, 47(9): 0926003.

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!