红外与激光工程, 2018, 47 (9): 0917009, 网络出版: 2018-10-06  

点特征柔性物体三维运动恢复方法

Method for 3D motion recovery of non-rigid object with point features
作者单位
江苏科技大学 计算机学院, 江苏 镇江 212003
摘要
为了使用两台标定的高速相机获取点特征柔性物体的三维运动轨迹, 提出了一种实用的点特征柔性物体三维运动恢复方法, 包括图像空间重建、时间序列重建等步骤。其中空间和时间序列重建是三维运动恢复的核心部分, 在空间重建方面, 使用椭圆拟合得到图像上点的坐标, 并根据马氏距离寻找匹配点, 然后利用三角测量法计算空间三维点; 在时间序列重建方面, 利用搜索方法匹配点前后图像坐标, 从而实现运动过程的三维恢复。然后利用重建结果计算运动柔性物体的速度、加速度、曲率变化等重要参数。实验结果表明, 该三维运动恢复方法提高了空间序列匹配的速度和准确度, 有效地实现了时间序列的匹配, 减少了整个重建过程的时间。通过对目标的重建, 准确地获得了物体的三维运动数据。
Abstract
In order to obtain 3D moving trajectory of non-rigid object with point feature, two calibrated high-speed cameras were used. A practical 3D motion recovery method of non-rigid object with point feature was proposed. The method included image spatial reconstruction, temporal series reconstruction and other steps. The spatial reconstruction and temporal series reconstruction were the core of 3D motion recovery. In spatial reconstruction, the coordinates of the points on the image were obtained by using ellipse fitting method, and the matching points were searched according to the Mahalanobis distance. Then, triangulation was used to calculate the 3D points. In the aspect of temporal series reconstruction, the searching method was used to match the coordinates of the points between sequential images. So, the 3D motion recovery of the movement process was realized. Then, the reconstruction result was used to calculate the parameters, such as speed, acceleration and curvature change of the non-rigid object. The experimental result shows that the method improves the speed and accuracy of the spatial matching and realizes the temporal series matching simply and effectively. What′s more, the time of the whole reconstruction process is reduced. Through the reconstruction of the target, the 3D motion data of the object is obtained accurately.
参考文献

[1] Jia Tong, Zhou Zhongxuan, Gao Haihong, et al. Depth measurement based on infrared coded structured light[J]. Infrared and Laser Engineering, 2015, 44(5): 1628-1632. (in Chinese)

[2] Cui Y, Schuon S, Chan D, et al. 3D shape scanning with a time-of-flight camera[C]//Computer Vision and Pattern Recognition, IEEE, 2010: 1173-1180.

[3] Bai Suqin, Shi Jinlong, Qian Qiang, et al. 3D scanning and reconstruction of large objects based on PLC[J]. Optics and Precision Engineering, 2017, 25(4): 1044-1050. (in Chinese)

[4] Lv Yuanzhi, Sun Qiang, Bi Guoling. Recognition and repairing of surface hole in three dimensional laser scanning system[J]. Chinese Optics, 2016, 9(1): 114-121. (in Chinese)

[5] Wei Q, Xu Z, Wang J. Research and implementation of 3D reconstruction technique based on images[C]//International Conference on Information Science and Control Engineering,IEEE, 2015: 408-411.

[6] Sun Y, Jian M, Wang S, et al. 3D reconstruction from single texture image based on patch matching and optimization[C]// Asia-Pacific Signal and Information Processing Association Summit and Conference, IEEE, 2015: 821-824.

[7] Wu Q, Zhang B, Huang J, et al. Flexible 3D reconstruction method based on phase-matching in multi-sensor system[J]. Optics Express, 2016, 24(7): 7299.

[8] Shi Jinlong, Liu Qinghua. Research and realization of 3D reconstruction method for dynamic deformable surface[J]. Application Research of Computers, 2011, 28(12): 4770-4772. (in Chinese)

[9] Zhang Chunsen. Motion-stereo double matching restriction in 3D movement analysis[J]. Optics and Precision Engineering, 2007, 15(6): 945-950. (in Chinese)

[10] Min Q, Huang Y. Moving object detection based on combined stereovision and optical flow[J]. Optical Technique, 2016, 42(1): 28-33.

[11] Fu Y, Liu Y, Dai Q. Dynamic shape capture via periodical-illumination optical flow estimation and multi-view photometric stereo [C]//IEEE Computer Society, 2011: 17-24.

[12] Zhang Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2000, 22(11): 1330-1334.

[13] Agrawal A, Mangalraj P, Bisherwal M A. Target detection in SAR images using SIFT [C]//IEEE, 2016: 90-94.

[14] Yang S, Li B, Zeng K. SBRISK: speed-up binary robust invariant scalable keypoints[J]. Journal of Real-Time Image Processing, 2016, 12(3): 583-591.

[15] Wang Canjin, Sun Tao, Chen Juan. New fast local invariant feature algorithm[J]. Infrared and Laser Engineering, 2014, 43(6): 2013-2020. (in Chinese)

[16] Tu Dawei, Jiang Jiliang. Improved algorithm for motion image analysis based on opticalflow andits application[J]. Optics and Precision Engineering, 2011, 19(5): 1159-1164. (in Chinese)

[17] Li Xiuzhi, Yang Ailin, Qin Baoling, et al. Monocular camera three dimensional reconstruction based on optical flow feedback[J]. Acta Optica Sinica, 2015, 35(5): 0515001. (in Chinese)

[18] Zeng J, Yu S, Fu X, et al. A line segments matching method based on epipolar-line constraint and line segment features[J]. Journal of Software, 2011, 6(9): 1746-1754.

[19] Cui Fayi. Color face recognition using adaptive feature fusion based on chroma mahalanobis distance map and gray map[J]. Infrared and Laser Engineering, 2015, 44(4): 1382-1389. (in Chinese)

龚肖, 史金龙, 廖芳. 点特征柔性物体三维运动恢复方法[J]. 红外与激光工程, 2018, 47(9): 0917009. Gong Xiao, Shi Jinlong, Liao Fang. Method for 3D motion recovery of non-rigid object with point features[J]. Infrared and Laser Engineering, 2018, 47(9): 0917009.

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!