应用光学, 2018, 39 (1): 45, 网络出版: 2018-03-15  

基于优化估计的深度图像修复与误差补偿方法研究

Repair and error compensation method for depth image based on optimization estimation
作者单位
西安应用光学研究所,陕西 西安 710065
摘要
针对Kinect传感器在获取深度图像时存在深度值随机跳变的不准确性问题,基于最优估计的思想,提出卡尔曼滤波与多帧平均法相结合的图像修复方法。首先利用卡尔曼滤波对多幅深度图像进行修复处理,实现Kinect传感器在采集信息过程中随着时间递推,深度值的跳变逐渐趋于平稳的效果;然后基于多幅图像平均法确定最终的深度图像,解决了Kinect获取深度值存在误差导致的不精确问题。实验结果表明,该算法的均方根误差为38.102 5,平均梯度为0.471 3,信息熵为6.191 8,与单幅图像修复效果相比,得到的深度图像边缘更加清晰。
Abstract
The depth value of Kinect sensor changes randomly when the depth image is obtained.In order to solve this problem,this paper presents an image repairing method combined with Kalman filtering and multiple frames averaging based on the idea of optimal estimation.Firstly,Kalman filter is used for repairing multiple depth images.The depth value tends to be stable with time recursion in the process of information capture by Kinect sensor.Secondly,multiple frames averaging method is used to determine the final depth image,in order to solve the problem of inaccurate depth value due to the error of Kinect sensor.The experimental results show that,the root mean square error of the algorithm is 38.102 5,the average gradient is 0.471 3,the information entropy is 6.191 8,the edge of depth image of this algorithm is more clearly when compared with the single image restoration.
参考文献

[1] ZHU Hao,LIU Yebin,FAN Jingtao,et al.Video-based outdoor Human reconstruction[J].IEEE Transactions on Circuits and Systems for Video Technology,2017,27(4):760-770.

[2] EISERT P,LIU Yebin,LEE K M,et al.Introduction to the special section on augmented video[J].IEEE Signal Processing Letters ,2017,27(4):713-715.

[3] BONDI E,PALA P,BERRETTI S,et al.Reconstructing high-resolution face models from Kinect depth sequences[J].IEEE Transactions on Information Forensics and Security,2016,11(12):2843-2853.

[4] 张翼飞,李良福,王娇颖,等.基于超分辨率重建的图像增强算法研究[J].应用光学,2011,32 (2):250-255.

    ZHANG Yifei,LI Liangfu,WANG Jiaoying,et al.An image enhancement algorithm base on super resolution reconstruction[J].Journal of Applied Optics,2011,32(2):250-255.

[5] 郭连朋,陈向宁,刘彬,等.基于Kinect传感器多深度图像融合的物体三维重建[J].应用光学,2014,35 (5):811-816.

    GUO Lianpeng,CHEN Xiangning,LIU Bin,et al.3D object reconstruction based on fusion of depth images by Kinect sensor[J].Journal of Applied Optics,2014,35(5):811-816.

[6] LIU Zhiguang,ZHOU Liuyang,LEUN H,et al.Kinect posture reconstruction based on a local mixture of Gaussian process models[J].IEEE Transactions on Visualization and Computer Graphics,2016,22(11):2437-2450.

[7] LI M,MOURIKIS A.High-precision,consistent EKF-based visual-inertial odometry[J].International Journal of Robotics Research,2013,32:690-711.

[8] PIERRE F,AUJOL J F,BUGEAU A,et al.Variational contrast enhancement of gray-scale and RGB images[J].Journal of Mathematical Imaging and Vision,2017,57(1):99-116.

[9] WANG Anzhi,WANG Minghui.RGB-D salient object detection via minimum barrier distance transform and saliency fusion[J].IEEE Signal Processing Letters,2017,24(5):663-667.

[10] YANG Qingxiong,YANG Ruigang,DAVIS J,et al.Spatial-depth super resolution for range images[C].New York:IEEE Conference on Computer Vision and Pattern Recognition,2007:1-8.

[11] GWAK S H,PARK E B,Kim H J.Ultrasound image enhancement using Markov random field model[J].ASTL,2013,23:96-99.

[12] TOROK M M,GOLPARVAR-FARD M,KOCHERSBERGER K B.Image-based automated 3D crack detection for post-disaster building assessment[J].Journal of Computing in Civil Engineering,2014,28:1-13.

[13] KLINGBEIL L,NIEUWENHUISEN M,SCHNEIDER J,et al.Towards autonomous navigation of an UAV-based mobile mapping system[C]//4th International Conference on Machine Control & Guidance,2014.Braunschweig,Germany:ResearchGate,2014:1-12.

[14] LATTANZI D,MILLER G R.3D scene reconstruction for Robotic bridge inspection[J].Journal of Infrastructure Systems,2014,20(3):1-12.

[15] ENGEL J,SCHOPS T,Cremers D.LSD-SLAM:large-scale direct monocular SLAM[J].European Conference on Computer Vision,2014,8690:834-849.

[16] LA H M,LIM R S,BASILY B B,et al.Mechatronic systems design for an autonomous Robotic system for high-efficiency bridge deck inspection and evaluation[J].IEEE Transactions on Mechatronics,2013,18(6):1655-1664.

[17] HENRY P,KRAININ M,Herbst E,et al.RGB-D mapping:using depth cameras for dense 3D modeling of indoor environments[J].Springer Tracts in Advanced Robotics,2014,79:477-491.

李良福, 邹彬, 周国良, 王超, 贺峻峰. 基于优化估计的深度图像修复与误差补偿方法研究[J]. 应用光学, 2018, 39(1): 45. Li Liangfu, Zou Bin, Zhou Guoliang, Wang Chao, He Junfeng. Repair and error compensation method for depth image based on optimization estimation[J]. Journal of Applied Optics, 2018, 39(1): 45.

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!