中国光学, 2017, 10 (5): 681, 网络出版: 2017-11-24   

折反射周视系统研究进展与展望

Research progress and prospect of catadioptric panoramic system
作者单位
1 北京理工大学 光电学院 光电成像技术与系统教育部重点实验室,北京市混合现实与新型显示工程技术研究中心,北京 100081
2 中国兵器科学研究院,北京 100089
3 云南北方驰宏光电有限公司,昆明 650217
引用该论文

贺宇, 王岭雪, 蔡毅, 周星光, 薛唯, 姜杰, 刘福平, 李洪兵, 陈骥, 罗永芳, 李茂忠. 折反射周视系统研究进展与展望[J]. 中国光学, 2017, 10(5): 681.

HE Yu, WANG Ling-xue, CAI Yi, ZHOU Xing-guang, XUE Wei, JIANG Jie, LIU Fu-ping, LI Hong-bing, CHEN Ji, LUO Yong-fang, LI Mao-zhong. Research progress and prospect of catadioptric panoramic system[J]. Chinese Optics, 2017, 10(5): 681.

参考文献

[1] US Army. Panoramic television viewing system:America,US,3505465 A[P].1970-04-07.

[2] YAMAZAWA K,YAGI Y,YACHIDA M. Omnidirectional imaging with hyperboloidal projection[C]. 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems,Tokyo,Japan,1993:1029-1034.

[3] PEGARD C,MOUADDIB E M. A mobile robot using a panorama view[C]. IEEE International Conference on Robotics and Automation,IEEE,1996:89-94.

[4] NAYAR S K. Catadioptric omnidirectional camera[C]. IEEE Conference on Computer Vision and Pattern Recognition,IEEE,1997:482-488.

[5] CHAHL J S,SRINIVASAN M V. Reflective surfaces for panoramic imaging[J]. Applied Optics,1997,36(31):8275-8285.

[6] CONROY T,MOORE J T. Resolution invariant surfaces for panoramic vision systems[C]. 7th IEEE International Conference on Computer Vision,IEEE,1999:392.

[7] HICKS R A,BAJCSY R. Reflective surfaces as computational sensors[J]. Image and Vision Computing,1999,19(11):773-777.

[8] GACHTER S. Mirror design for an omnidirectional camera with a uniform cylindrical projection when using the SVAVISCA sensor[R]. Research reports of CMP,OMNIVIEWS Project,Czech Technical University in Prague,2001.

[9] BAKER S,NAYAR S K. A theory of catadioptric image formation[C]. 6th IEEE International Conference on Computer Vision,IEEE,1998:35-42.

[10] BAKER S,NAYAR S K. A theory of single-viewpoint catadioptric image formation[J]. Int. J. Comput. Vis.,1999,35(2):175-196.

[11] 贺宇,王岭雪,周星光,等.单视点红外折反射全向成像系统参数设计[J].光学学报,2016,36(1):0111002.

    HE Y,WANG L X,ZHOU X G,et al.. Parameters design for single viewpoint infrared omnidirectional view sensors[J]. Acta Optica Sinica,2016,36(1):0111002.(in Chinese)

[12] NAGAHARA H,YOSHIDA K,YACHIDA M. An omnidirectional vision sensor with single view and constant resolution[C]. IEEE International Conference on Computer Vision,IEEE,2007:1-8.

[13] HICKS R A,MILLSTONE M,DANIILIDIIS K. Realizing any central projection with a mirror pair[J]. Applied Optics,2006,45(28):7205-7210.

[14] STURZL W,SRINIVASAN M V. Omnidirectional imaging system with constant elevational gain and single viewpoint[C]. 10th Workshop on Omnidirectional Vision,CameraNetworks and Non-classical Cameras,Zaragoa,Spain,2010:1-7.

[15] SWAMINATHAN R,GROSSBERG M D,NAYAR S K. Non-single viewpoint catadioptric cameras: geometry and analysis[J]. Int. J. Comput. Vis.,2006,66(3):211-229.

[16] SWAMINATHAN R,GROSSBERG M D,NAYAR S K. Caustics of catadioptric cameras[C]. IEEE International Conference on Computer Vision,IEEE,2001:2-9 .

[17] SWAMINATHAN R,GROSSBERG M D,NAYAR S K. A perspective on distortions[C]. IEEE Computer Vision and Pattern Recognition,IEEE,2003:594-601.

[18] YU J Y,MCMILLAN L. Modelling reflections via multiperspective imaging[J]. IEEE Computer Vision and Pattern Recognition,2005,1:117-124.

[19] YU J Y,MCMILLAN L. General linear cameras[C]. 8th European. Conf. on Computer vision(ECCV 2004),Prague,Czech,2004:14-27.

[20] GEYER C,DANIILIDIS K. A unifying theory for central panoramic systems and practical applications[C]. 6th European. Conf. on Computer vision(ECCV 2000) ,Antibes,France,2000:445-461.

[21] GEYER C,DANIILIDIS K. Mirrors in motion: Epipolar geometry and motion estimation[J]. Int. J. Comput. Vis.,2003,2:766-773.

[22] GEYER C M. Catadioptric projective geometry:theory and applications[D]. Philadelphia:University of Pennsylvania,2003.

[23] ALIAGA D G. Accurate catadioptric calibration for real-time pose estimation in room-size environments[C]. 8th IEEE International Conference on Computer Vision,IEEE,2001:127-134.

[24] PUIG L,BASTANLAR Y,STURM P,et al.. Calibration of central catadioptric cameras using a dlt-like approach[J]. Int. J. Comput. Vis.,2011,93(1):101-114.

[25] THIRTHALA S R,POLLEFEYS M. Radial multi-focal tensors[J]. Int. J. Comput. Vis.,2012,96(2):195-211.

[26] WU Y H,HU Z Y. Geometric invariants and applications under catadioptric camera model[C]. IEEE International Conference on Computer Vision,IEEE,2005:1547-1554.

[27] GEYER C,DANIILIDIS K. Paracatadioptric camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2002,24(5):687-695.

[28] VANDEPORTAELE B,CATTOEN M,MARTHON P,et al. A new linear calibration method for paracatadioptric cameras[C]. 18th IEEE International Conference on Pattern Recognition,IEEE,2006:647-651.

[29] VASSEUR P,MOUADDIB E M. Central catadioptric line detection[C]. In British Machine Vision Conference,London,UK,2004:doi:10.52441C,18.8.

[30] CAGLIOTI V,TADDEI P,BORACCH I ,et al.. Singleimage calibration of off-axis catadioptric cameras using lines[C]. 11th IEEE International Conference on Computer Vision,IEEE,2007:1-6.

[31] YING X H,HU Z Y. Catadioptric camera calibration using geometric invariants[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2004,26(10):1260-1271.

[32] WU Y H,LI Y F,HU Z Y. Easy calibration for para-catadioptric-like camera[C]. IEEE/RSJ International Conference on Intelligent Robots and Systems,IEEE,2006:5719-5724.

[33] YING X H,ZHA H B. Simultaneously calibrating catadioptric camera and detecting line features using hough transform[C]. IEEE/RSJ International Conference on Intelligent Robots and Systems,IEEE,2005:412-417.

[34] YING X H,ZHA H B. Identical projective geometric properties of central catadioptric line images and sphere images with applications to calibration[J]. Int. J. Comput. Vis.,2008,78(1):89-105.

[35] WU F C,DUAN F Q,HU Z Y,et al. A new linear algorithm for calibrating central catadioptric cameras[J]. Pattern Recognition,2008,41(10):3166-3172.

[36] SCARAMUZZA D,MARTINELLI A,SIEGWART R. A flexible technique for accurate omnidirectional camera calibration and structure from motion[C]. IEEE International Conference on Computer Vision Systems,IEEE,2006:45.

[37] MEI C,RIVES P. Single view point omnidirectional camera calibration from planar grids[C]. IEEE International Conference on Robotics and Automation,IEEE,2007:3945-3950.

[38] GASPARINI S,STURM P,BARRETO J P. Plane-based calibration of central catadioptric cameras[C]. 12th IEEE International Conference on Computer Vision,IEEE,2009:1195-1202.

[39] DENG X M,WU F C,WU Y H. An easy calibration method for central catadioptric cameras[J]. Acta Automatica Sinica,2007,33(8):801-808.

[40] KANG S B. Catadioptric self-calibration[C]. IEEE Conference on Computer Vision and Pattern Recognition,IEEE,2000:201-207.

[41] RAMALINGAM S,STURM P,LODHA S K. Generic self-calibration of central cameras[J]. Computer Vision and Image Understanding,2010,114(2):210-219.

[42] ESPUNY F,BURGOS GIL J I. Generic self-calibration of central cameras from two rotational ows[J]. Int. J. Comput. Vis.,2011,91(2):131-145.

[43] GASPAR J,SANTOS-VICTOR J. Visual path following with a catadioptric panoramic camera[C]. International Symposium on Intelligent Robotic Systems,IEEE,1999:139-147.

[44] J.MAYBANK S,IENG S,BENOSMAN R. A fisher-rao metric for paracatadioptric images of lines[J]. Int. J. Comput. Vis.,2012,99(2):147-165.

[45] TANG Y Z,LI Y F,LUO J. Parametric distortion-adaptive neighborhood for omnidirectional camera[J]. Applied Optics,2015,54(23):6969-6978.

[46] 曾吉勇,苏显渝.水平场景无畸变折反射周视成像系统透镜畸变的消除[J].光学学报,2004,24(6):730-734.

    ZENG J Y,SU X Y. Elimination of the lens distortion in catadioptric omnidirectional distortionless imaging system for horizontal scene[J]. Acta Optica Sinica,2004,24(6):730-734.(in Chinese)

[47] 肖潇,杨国光,白剑.基于球面透视投影约束的周视环形透镜畸变校正[J].光学学报,2008,28(4):675-680.

    XIAO X,YANG G G,BAI J. Panoramic-Annular-Lens distortion correction based on spherical perspective projection constraint[J]. Acta Optica Sinica,2008,28(4):675-680.(in Chinese)

[48] WU Y H,HU Z Y,LI Y F. Radial distortion invariants and lens evaluation under a single-optical-axis omnidirectional camera[J]. Computer Vision and Image Understanding,2014,126(2):11-27.

[49] SWAMINATHAN R. Focus in catadioptric imaging systems[C]. IEEE 11th International Conference on Computer Vision,IEEE,2007:1-7.

[50] LI W M,LI Y F. An analytical solution to optimal focal distance in catadioptric imaging systems[C]. IEEE International Conference on Robotics and Automation,IEEE,2011:6300-6305.

[51] LI W M,LI Y F. Overall well-focused catadioptric image acquisition with multifocal images:a model-based method[J]. IEEE Transactions on Image Processing,2012,21(8):3697-3706.

[52] 李永乐,张茂军,娄静涛,等.去散焦模糊的折反射全向成像系统设计[J].光学学报,2012,32(9):0911001.

    LI Y L,ZHANG M J,LOU J T,et al.. Design of catadioptric omnidirectional imaging system for defocus deblurring[J]. Acta Optica Sinica,2012,32(9):0911001.(in Chinese)

[53] LIU Y,LI H F,LI Y L,et al. Coded aperture enhanced catadioptric optical system for omnidirectional image deblurring[J]. Optik,2014,125(1):11-17.

[54] LI Y L,LOU J T,XU Y C. Defocus deblurring for catadioptric omnidirectional imaging based on coded aperture and omni-total variation[J]. Advanced Robotics,2015,29(16):1-13.

[55] LIU Y,LI Y L,LOU J T,et al.. Omni-total variation algorithm for the restoration of all-focused catadioptric image[J]. Optik,2014,125(14):3685-3689.

[56] 白瑜,廖志远,廖胜,等.共孔径消热差红外双波段光学系统[J].光学 精密工程,2016,24(2):268-277.

    BAI Y,LIAO Z Y,LIAO SH,et al.. Infrared dual band a thermal optical system with common aperture[J]. Opt. Precision Eng.,2016,24(2):268-277.(in Chinese)

[57] WILLETT R M,MARCIA R F,NICHOLS J M. Compressed sensing for practical optical imaging systems: a tutorial[J]. Optical Engineering,2011,50(7):072601.

[58] ABURMAD S. Panoramic thermal imaging: challenges and tradeoffs[J]. SPIE,2014,9070:90700W.

[59] NICHOLS J M,WATERMAN J R,BAYYA S,et al.. Influence of spinel head window thickness on the performance characteristics of a submarine, panoramic, infrared imaging system[J]. SPIE,2011,8012:90122C.

[60] NICHOLS J M,WATERMAN J R,MENON R,et al.. Modeling and analysis of a high-performance midwave infrared panoramic periscope[J]. Optical Engineering,2010,49(11):113202.

[61] FURXHI O,DRIGGERS R G,HOLST G,et al.. Performance analysis of panoramic infrared systems[J]. SPIE,2014,9071:907112.

[62] TANG Y Z,LI Y F. Contour coding based rotating adaptive model for human detection and tracking in thermal catadioptric omnidirectional vision[J]. Applied Optics,2012,51(27):6641-6652.

[63] TANG Y Z,LI Y F,BAI T X,et al.. Rotating adaptive Haar wavelet transform for human tracking in thermal omnidirectional vision[C]. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems,IEEE,2012:324-329.

[64] TANG Y Z,LUO J,LI Y F,et al.. Rotational kinematics model based adaptive particle filter for robust human tracking in thermal omnidirectional vision[J]. Mathematical Problems in Engineering,2015:347497.

[65] TANG Y Z,LI Y F,BAI T X,et al.. A rotating adaptive model for human tracking in thermal catadioptric omnidirectional vision[C]. IEEE International Conference on Robotics and Biomimetics,IEEE,2011:2435-2440.

[66] RemoteReality. Strix360 camera system[EB/OL].[2015-01-11].http://www.remotereality.com.

[67] BJORK C,WAN W. Mid-wave infrared(MWIR) panoramic sensor for various applications[J]. SPIE,2010,7660:76600B.

[68] 周星光,贺宇,王岭雪,等.单视点双曲面折反射红外全景成像系统设计与分析[J].红外与激光工程,2016,45(9):197-205.

    ZHOU X G,HE Y,WANG L X,et al.. Hyperbolicsingle-viewpoint infrared catadioptric panoramic imaging system[J]. Infrared and Laser Engineering,2016,45(9):197-205.(in Chinese)

[69] 贺宇,王岭雪,蔡毅,等.恒等探测距离折反射周视红外成像系统设计及分析[J].光学学报,2017,37(4):0422002.

    HE Y,WANG L X,CAI Y,et al.. Design and analysis for catadioptric omnidirectional view Infrared imaging system with constant detection range[J]. Acta Optica Sinica,2017,37(4):0422002.(in Chinese)

[70] SCHARSTEIN D,SZELISKI R. http://vision.middlebury.edu/stereo/eval/[EB/OL].[2016-07-06].

[71] SCHARSTEIN D,SZELISKI R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms[J]. Int. J. Comput. Vis.,2002,47(1):7-42.

[72] HIRSCHMULLER H. Stereo vision in structured environments by consistent semi-global matching[C]. 21rd IEEE Conference on Computer Vision and Pattern Recognition(CVPR),IEEE,2006:2386-2393.

[73] TOMBARI F,MATTOCCIA S,STEFANO L D,et al.. Near real-time stereo based on effective cost aggregation[C]. 22rd IEEE Conference on Computer Vision and Pattern Recognition(CVPR),IEEE,2008:1-4.

[74] MATTOCCIA S,GIARDINO S,GAMBINI A. Accurate and efficient cost aggregation strategy for stereo correspondence based on approximated joint bilateral filtering[C]. Asian Conference on Computer Vision,Queenstown,New Zealand,2010,5995:371-380.

[75] MATTOCCIA S. A locally global approach to stereo correspondence[C]. IEEE International Conference on Computer Vision Workshops,IEEE,2009:1763-1770.

[76] MATTOCCIA S. Improving the accuracy of fast dense stereo correspondence algorithms by enforcing local consistency of disparity fields[C]. 3D Data Processing,Visualization,and Transmission,Paris,Frame,2010:17-20.

[77] MATTOCCIA S. Fast locally consistent dense stereo on multicore[C]. 6th IEEE Embedded Computer Vision Workshop(ECVW2010),CVPR workshop,IEEE,2010:69-76.

[78] MATTOCCIA S. Accurate dense stereo by constraining local consistency on superpixels[C]. 20th International Conference on Pattern Recognition,Istambul,Turkey,2010:1832-1835.

[79] ZHANG C ,LI Z W ,CHENG Y H,et al.. MeshStereo:a global stereo model with mesh alignment regularization for view interpolation[C]. 15th IEEE International Conference on Computer Vision(ICCV),IEEE,2015:2057-2065.

[80] 宋涛,熊文莉,侯培国,等.基于极曲线几何和支持邻域的鱼眼图像立体匹配[J].光学 精密工程,2016,24(8):2050-2058.

    SONG T,XIONG W L,HOU P G,et al.. Stereo matching for fish-eye images based on epipolar geometry and support neighborhood[J]. Opt. Precision Eng.,2016,24(8):2050-2058.(in Chinese)

[81] 王晓燕,王世刚,姜秀红,等.亮度优化立体视频视觉舒适度评价[J].中国光学,2015,8(3):394-400.

    WANG X Y,WANG SH G,JIANG X H,et al. Evaluation of stereo video visual comfort based on luminance optimization[J]. Chinese Optics,2015,8(3):394-400.(in Chinese)

[82] 高礼圳,刘书桂,韩振华.零件的角点提取及匹配定位[J].中国光学,2016,9(4):397-404.

    GAO L ZH,LIU SH G,HAN ZH H. Corner extraction and matching location of parts[J]. Chinese Optics,2016,9(4):397-404.(in Chinese)

[83] GLUCKMAN J,NAYAR S K,THORESZ K J. Real-time omnidirectional and panoramic stereo[C]. 1998 DARPA Image Understanding Workshop,California,USA,1998:299-303.

[84] KOYASU H S,MIURA J ,SHIRAI Y. Recognizing moving obstacles for robot navigation using real-time omnidirectional stereo vision[J]. J. Robotics and Mechatronics,2002,14(2):147-156.

[85] CABRAL E L L,SOUZA J J C,HUNOLD M C. Omnidirectional stereo vision with a hyperbolic double lobed mirror[C]. 17th International Conference on Pattern Recognition ,IEEE,2004:1-9.

[86] JANG G,KIM S,KWEON I. Single-camera panoramic stereo system with single-viewpoint optics[J]. Optics Letters,2006,31(1):41-43.

[87] SU L C,ZHU F. Design of a novel omnidirectional stereo vision system[J]. Acta Automatica Sinica,2006,32(1):67-72.

[88] LI W M,LI Y F. Single-camera panoramic stereo imaging system with a fisheye lens and aconvex mirror[J]. Optics Express,2011,19(7):5855-5867.

[89] HUANG Z,BAI J,HOU X Y. Design of panoramic stereo imaging with single optical system[J]. Optics Express,2012,20(6):6085-6096.

[90] 黄治.单传感器全景立体环带成像光学系统的研究[D].杭州:浙江大学,2014.

    HUANG ZH. Study of panoramic stereo imaging with single optical system[D]. Hangzhou:Zhejiang University,2014.(in Chinese)

[91] HE Y,WANG L X,CAI Y,et al.. Monocular catadioptric panoramic depth estimation via caustics-based virtual scene transition[J]. J. Optical Society of America A,2016,33(9):1872-1879.

[92] CARUSO D,ENGEL J,CREMERS D. Large-scale direct SLAM for omnidirectional cameras[C]. IEEE International Conference on Intelligent Robort & Systems,IEEE,2015:141-148.

贺宇, 王岭雪, 蔡毅, 周星光, 薛唯, 姜杰, 刘福平, 李洪兵, 陈骥, 罗永芳, 李茂忠. 折反射周视系统研究进展与展望[J]. 中国光学, 2017, 10(5): 681. HE Yu, WANG Ling-xue, CAI Yi, ZHOU Xing-guang, XUE Wei, JIANG Jie, LIU Fu-ping, LI Hong-bing, CHEN Ji, LUO Yong-fang, LI Mao-zhong. Research progress and prospect of catadioptric panoramic system[J]. Chinese Optics, 2017, 10(5): 681.

本文已被 8 篇论文引用
被引统计数据来源于中国光学期刊网
引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!