光学学报, 2020, 40 (2): 0215001, 网络出版: 2020-01-02   

融合多尺度局部特征与深度特征的双目立体匹配 下载: 1623次

Binocular Stereo Matching by Combining Multiscale Local and Deep Features
作者单位
1 重庆大学光电技术及系统教育部重点实验室, 重庆 400040
2 重庆大学光电工程学院, 重庆 400040
3 重庆师范大学计算机与信息科学学院, 重庆 401331
摘要
针对立体匹配中不适定区域难以找到精确匹配点的问题,提出一种融合多尺度局部特征与深度特征的立体匹配方法。特征融合阶段包括两部分,其一是融合不同尺度下Log-Gabor特征和局部二值模式特征组合的浅层次特征,其二是将多尺度浅层融合特征和卷积神经网络提取的深度特征进行级联,形成既包含语义信息又包含结构化信息的特征图像。通过在极线垂直方向添加不同强度的噪声来构造正负样本,减小图像中极线对齐欠准带来的误差。将该方法与两种变体方法(改变或舍弃部分模块)在KITTI数据集进行对比实验,结果表明各模块设置具有合理性;与一些经典方法相比,所提方法取得了有竞争力的匹配性能。
Abstract
In this study, a method is proposed based on multiscale local and deep features to address the difficulty associated with finding exactly matching pixels from the ill-posed regions in stereo matching. The feature fusion stage comprises two parts. First, the shallow features with different scales, including the Log-Gabor features and the local binary pattern features, are fused. The second part integrates the multiscale shallow fused features and deep features via a convolutional neural network and forms the final feature image, which contains both the semantic and structural information. Further, a positive and negative sample construction method is proposed by adding some noise in the vertical direction to reduce the error that can be attributed to imprecise epipolar alignment in an image. The proposed method is compared with two variant methods (changing or discarding of some modules) with respect to the KITTI datasets. The experimental results validate the effectiveness of the module settings with respect to the proposed method. This method also achieves competitive matching results when compared with those achieved using some classical methods.

王旭初, 刘辉煌, 牛彦敏. 融合多尺度局部特征与深度特征的双目立体匹配[J]. 光学学报, 2020, 40(2): 0215001. Xuchu Wang, Huihuang Liu, Yanmin Niu. Binocular Stereo Matching by Combining Multiscale Local and Deep Features[J]. Acta Optica Sinica, 2020, 40(2): 0215001.

本文已被 6 篇论文引用
被引统计数据来源于中国光学期刊网
引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!