基于U-Net卷积神经网络的纳米颗粒分割
Nanoparticle Segmentation Based on U-Net Convolutional Neural Network
摘要
为了准确测量纳米颗粒的尺寸,依据透射电子显微镜拍摄的纳米颗粒图像,提出了一种基于U-Net卷积神经网络的颗粒自动分割方法。将U-Net部分网络结构与批量归一化层相结合,减弱了网络对初始化的依赖,提升了训练速度。对纳米颗粒图像进行半隐式偏微分方程滤波以增强图像边缘信息,利用改进的U-Net网络训练纳米颗粒个体分割模型,得到了分割结果。研究结果表明,所提方法能准确分割出图像中的纳米颗粒,对边缘模糊和强度不均的纳米颗粒的分割效果提升显著。
Abstract
In order to accurately measure the size of nanoparticles, an automatic particle segmentation method based on U-Net convolutional neural network is proposed according to the nanoparticle images captured by the transmission electron microscopy. Combined with the Batch Normalization (BN) layer, it reduces the dependence of networks on initialization and thus speeds up training. The nanoparticle image is filtered by the semi-implicit partial differential equation to enhance the image edge information. The improved U-Net network is used to train the nanoparticle individual segmentation model and the segmentation result is obtained. The research results show that the proposed method can accurately segment the nanoparticles in the image, and the segmentation effect is especially obvious for the nanoparticles with edge blurs and uneven intensities.
中图分类号:TP391
所属栏目:图像处理
基金项目:国家自然科学基金(61601325)、天津市科技重大专项(17ZXSCSY00060)、天津市高等学校创新团队培养计划(TD13-5034)
收稿日期:2018-09-18
修改稿日期:2018-09-28
网络出版日期:2018-10-17
作者单位 点击查看
吴玥:天津工业大学电子与信息工程学院, 天津 300387
肖志涛:天津工业大学电子与信息工程学院, 天津 300387天津市光电检测技术与系统重点实验室, 天津 300387
耿磊:天津工业大学电子与信息工程学院, 天津 300387天津市光电检测技术与系统重点实验室, 天津 300387
吴骏:天津工业大学电子与信息工程学院, 天津 300387天津市光电检测技术与系统重点实验室, 天津 300387
刘彦北:天津工业大学电子与信息工程学院, 天津 300387天津市光电检测技术与系统重点实验室, 天津 300387
王雯:天津工业大学电子与信息工程学院, 天津 300387天津市光电检测技术与系统重点实验室, 天津 300387
【3】Fang J X. Study based on the variational level set methods for image segmentation[D]. Shanghai: Shanghai Jiao Tong University, 2012: 20-28.
方江雄. 基于变分水平集的图像分割方法研究[D]. 上海: 上海交通大学, 2012: 20-28.
【4】Liu X B. The study on the segmentation of circle-like particle images[D]. Changsha: Hunan University, 2006.
刘相滨. 类圆性颗粒图像分割技术研究[D]. 长沙: 湖南大学, 2006.
【6】Li C M, Kao C Y, Gore J C, et al. Minimization of region-scalable fitting energy for image segmentation[J]. IEEE Transactions on Image Processing, 2008, 17(10): 1940-1949.
【8】Wang Y, Chen J, Wang G. Particle seed images segmentation method based on the improved fuzzy C-means clustering algorithm[J]. Journal of North University of China(Natural Science Edition), 2018, 39(2): 177-182.
王宇, 陈婧, 王高. 基于改进的模糊C均值聚类算法的颗粒种子图像分割方法[J]. 中北大学学报(自然科学版), 2018, 39(2): 177-182.
【9】Lü J C, Wang L P, Zhang Q Q. Research on the background segmentation method based on nano-particles images[J]. Journal of Baicheng Normal University, 2017, 31(12): 1-6.
吕镜潺, 王丽萍, 张倩倩. 基于纳米颗粒图像的背景分割方法探究[J]. 白城师范学院学报, 2017, 31(12): 1-6.
【10】Shelhamer E, Long J, Darrell T. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(4): 640-651.
【11】Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(12): 2481-2495.
【12】Bansal A, Chen X L, Russell B, et al. PixelNet: representation of the pixels, by the pixels, and for the pixels[EB/OL]. (2017-02-27)[2018-11-23]. https:∥arxiv.org/abs/1702.06506
【13】Ronneberger O, Fischer P, Brox T.U-Net: Convolutional networks for biomedical image segmentation[C]∥International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2015), October 5-9, Munich, Germany. Switzerland: Springer, 2015: 234-241.
【14】Xiao Z T, Yuan Q, Zhang F, et al. The oriented partial differential equation based on the discontinuities measure for electronic speckle pattern interferometry[J]. Journal of Electronics & Information Technology, 2014, 36(11): 2600-2606.
肖志涛, 袁泉, 张芳, 等. 结合非连续性测度的方向偏微分方程在电子散斑干涉中的应用[J]. 电子与信息学报, 2014, 36(11): 2600-2606.
【15】Weickert J, Scharr H. A scheme for coherence-enhancing diffusion filtering with optimized rotation invariance[J]. Journal of Visual Communication and Image Representation, 2002, 13(1/2): 103-118.
【17】Gao W, Zhou Z H. Dropout Rademacher complexity of deep neural networks[J]. Science China Information Sciences, 2016, 59(7): 072104.
引用该论文
Zhang Fang,Wu Yue,Xiao Zhitao,Geng Lei,Wu Jun,Liu Yanbei,Wang Wen. Nanoparticle Segmentation Based on U-Net Convolutional Neural Network[J]. Laser & Optoelectronics Progress, 2019, 56(6): 061005
张芳,吴玥,肖志涛,耿磊,吴骏,刘彦北,王雯. 基于U-Net卷积神经网络的纳米颗粒分割[J]. 激光与光电子学进展, 2019, 56(6): 061005