首页 > 论文 > 液晶与显示 > 34卷 > 9期(pp:862-870)

4K裸眼立体显示系统设计

Design of 4K bare-eye stereoscopic display system

  • 摘要
  • 论文信息
  • 参考文献
  • 被引情况
  • PDF全文
分享:

摘要

随着医疗显示技术的进步, 医疗内窥镜摄像系统已经由主流的2D(Two Dimensions)显示向3D(Three Dimensions)显示发展, 图像清晰度也从高清(High Definition, HD)向超高清(Ultra High Definition, UHD)转变。因此, 本文设计开发了一种基于FPGA的4K(3 840×2 160)裸眼立体显示系统。首先, 系统对双路3G-SDI图像采集并进行YUV到RGB的格式转换。其次, 使用Xilinx提供的VPSS核实现图像的缩放, 同时解决高速图像数据带宽与DDR3存储器带宽间的匹配问题。最后, 通过SBS(Side by Side)的拼接方式, 将满足立体图像输出格式的视频源通过立体显示器输出。该系统从前端立体图像的采集到后端立体图像的输出, 需要经过格式变换、缩放、缓存、同步以及拼接等多个处理过程。实验结果表明, 采用参考时钟为148.5 MHz的双路SDI输入, 经FPGA的实时处理后可实现分辨率为3 840×2 160、刷新率为60 Hz的SBS拼接格式图像, 该图像可直接驱动裸眼立体显示器。

Abstract

With the development of medical display technology, medical endoscope camera system has developed from the mainstream 2D (Two Dimensions) display to 3D (Three Dimensions) display, and image definition has also changed from high definition (HD) to ultra high definition (UHD). Therefore, this paper designed and developed a 4K medical stereo display system based on FPGA. Firstly, the system carried on dual 3G-SDI image acquisition and YUV to RGB format conversion. Secondly, the VPSS core provided by Xilinx was used to realize image scaling, and the matching problem between high-speed image data bandwidth and DDR3 memory bandwidth was solved. Finally, the video source satisfying the stereo image output format was output by the stereo display through the splicing mode of SBS (Side by Side). The system from the front end stereo image acquisition to the back end stereo image output, needed to go through format transformation, scaling, caching, synchronization and Mosaic and other processes. Experimental results show that the dual-channel SDI input with a reference clock of 148.5 MHz and real-time processing by FPGA can achieve a SBS Mosaic image with a resolution of 3 840×2 160 and a refresh rate of 60 Hz, which can directly drive the naked eye stereo display.

广告组1 - 空间光调制器+DMD
补充资料

中图分类号:TN391

DOI:10.3788/yjyxs20193409.0862

所属栏目:材料与器件

基金项目:国家自然科学基金(No.61605083, No.61701244); 江苏省自然科学基金(No.BK20150903); 江苏省高校自然科学基金(No.16KJB510023)

收稿日期:2019-04-22

修改稿日期:2019-05-15

网络出版日期:--

作者单位    点击查看

严 飞:南京信息工程大学 自动化学院, 江苏 南京 21004江苏省大气环境与装备技术协同创新中心, 江苏 南京 210044
宋振声:南京信息工程大学 自动化学院, 江苏 南京 21004
刘银萍:南京信息工程大学 大气物理学院, 江苏 南京 210044
刘卿卿:南京信息工程大学 自动化学院, 江苏 南京 21004江苏省大气环境与装备技术协同创新中心, 江苏 南京 210044
蔡静怡:南京信息工程大学 自动化学院, 江苏 南京 21004

联系人作者:严飞(fyan@nuist.edu.cn)

备注:严飞(1983-), 男, 江苏南京人, 博士, 讲师, 2014年于中国科学院大学获得博士学位, 主要从事信息显示技术方面的研究。

【1】王嘉祺.基于CUDA的虚拟人视觉感知与记忆模型及其在路径规划中的应用[D].武汉: 华中科技大学, 2016.
WANG J Q. Virtual human visual perception and memory model based on CUDA and its application in path panning [D]. Wuhan: Huazhong University of Science and Technology, 2016. (in Chinese)

【2】李超.基于双目立体视觉裸眼3D显示技术研究[D].南京: 南京航空航天大学, 2015.
LI C. Research on technology of naked-eye 3D display based on binocular stereo vision [D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2015. (in Chinese)

【3】MCLACHLANG. From 2D to 3D: the future of surgery? [J]. The Lancet, 2011, 378(9800): 1368-1368.

【4】ALARAIMI B, EL BAKBAK W, SARKER S, et al. A randomized prospective study comparing acquisition of laparoscopic skills in three-dimensional (3D) vs. two-dimensional (2D) laparoscopy [J]. World Journal of Surgery, 2014, 38(11): 2746-2752.

【5】STORZ P, BUESS G F, KUNERTW, et al. 3D HD versus 2D HD: surgical task efficiency in standardised phantom tasks [J]. Surgical Endoscopy, 2012, 26(5): 1454-1460.

【6】SINHA R, SUNDARAM M, RAJE S, et al. 3D laparoscopy: technique and initial experience in 451 cases [J]. Gynecological Surgery, 2013, 10(2): 123-128.

【7】ZENBUTSU S, IGARASHI T, NAKAMURA R, et al. 3D ultrasound assisted laparoscopic liver surgery by visualization of blood vessels [C]//Proceedings of 2013 IEEE International Ultrasonics Symposium. Prague, Czech Republic: IEEE, 2014: 840-843.

【8】GHEDI A, DONARINI E, LAMERA R, et al. 3D vs 2D laparoscopic systems: development of a performance quantitative validation model [C]//Proceedings of 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Milan, Italy: IEEE, 2015: 6884-6887.

【9】MURALI A, SEN S, KEHOE B, et al. Learning by observation for surgical subtasks: multilateral cutting of 3D viscoelastic and 2D orthotropic tissue phantoms [C]//Proceedings of 2015 IEEE International Conference on Robotics and Automation. Seattle, WA, USA: IEEE, 2015: 1202-1209.

【10】KONG S H, OH B M, YOON H, et al. Comparison of two- and three-dimensional camera systems in laparoscopic performance: a novel 3D system with one camera [J]. Surgical Endoscopy, 2010, 24(5): 1132-1143.

【11】胡雅洁.北京协和医院成功实施国内首例3D腹腔镜肾盂旁囊肿切除术[J].首都医药, 2013, 20(7): 40.
HU Y J. Beijing union medical college hospital successfully carried out the first domestic 3D laparoscopic nephropyelectomy [J]. Capital Medical, 2013, 20(7): 40. (in Chinese)

【12】蒋堃, 梁朝朝, 周骏, 等.3D腹腔镜与传统腹腔镜技术治疗肾上腺肿瘤的疗效比较[J].中华腔镜泌尿外科杂志(电子版), 2013, 7(6): 3-6.
JIANG K, LIANG C Z, ZHOU J, et al. Comparison of 3D and 2D laparoscopic adrenalectomy for adrenal neoplasm [J]. Chinese Journal of Endourology (Electronic Version), 2013, 7(6): 3-6. (in Chinese)

【13】李汉忠, 张玉石, 张学斌, 等.3D腹腔镜系统在泌尿外科手术中的应用[J].中华泌尿外科杂志, 2013, 34(5): 325-328.
LI H Z, ZHANG Y S, ZHANG X B, et al. Application of 3D video techniques in urological laparoscopic surgery [J]. Chinese Journal of Urology, 2013, 34(5): 325-328. (in Chinese)

【14】刘皓, 林天歆, 许可慰, 等.3D腹腔镜下根治性膀胱前列腺切除术的初步经验[J].中华泌尿外科杂志, 2013, 34(10): 767-770.
LIU H, LIN T X, XU K W, et al. Preliminary experience of laparoscopic radical cystectomy and prostatectomy with three-dimensional laparoscopy [J]. Chinese Journal of Urology, 2013, 34(10): 767-770. (in Chinese)

【15】鲁青.国内首次在神经外科手术中启用3D内镜切除脑垂体瘤[J].健康博览, 2017(1): 12.
LU Q.Three-dimensional endoscopic resection of pituitary adenoma was used in neurosurgery for the first time in China [J]. Health Expo., 2017(1): 12. (in Chinese)

【16】LIU X, LI L. FPGA-based three-dimensional endoscope system using a single CCD camera [C]//Proceedings of 2015 IEEE International Conference on Information and Automation. Lijiang: IEEE, 2015: 614-618.

【17】OH J, KIM K. Accurate 3D reconstruction for less overlapped laparoscopic sequential images [C]//Proceedings of 2017 International Conference on Bio-engineering for Smart Technologies. Paris, France: IEEE, 2017: 1-4.

【18】LEE P Y, YAN S L, HU M H, et al. A computed stereoscopic method for laparoscopic surgery by using feature tracking [C]//Proceedings of 2015 IEEE International Conference on Consumer Electronics - Taiwan. Taipei, China: IEEE, 2015: 9-10.

【19】ZHAO Y, WEI Y T, CUI X Y, et al. 3D display technology in medical imaging field [C]//Proceedings of 2013 IEEE International Conference on Medical Imaging Physics and Engineering. Shenyang: IEEE, 2013: 210-214.

引用该论文

YAN Fei,SONG Zhen-sheng1,LIU Yin-ping2,LIU Qing-qing1,CAI Jing-yi. Design of 4K bare-eye stereoscopic display system[J]. Chinese Journal of Liquid Crystals and Displays, 2019, 34(9): 862-870

严 飞,宋振声,刘银萍,刘卿卿,蔡静怡. 4K裸眼立体显示系统设计[J]. 液晶与显示, 2019, 34(9): 862-870

您的浏览器不支持PDF插件,请使用最新的(Chrome/Fire Fox等)浏览器.或者您还可以点击此处下载该论文PDF