Yu Bai, Yan Wang, Dayuan Qiang, Xin Yuan, Jiehui Wu, Weilong Chen, Sai Zhang, Yanru Zhang, George Chen
{"title":"基于语义分割的扫描电镜图像中纳米复合材料团聚体识别","authors":"Yu Bai, Yan Wang, Dayuan Qiang, Xin Yuan, Jiehui Wu, Weilong Chen, Sai Zhang, Yanru Zhang, George Chen","doi":"10.1049/nde2.12034","DOIUrl":null,"url":null,"abstract":"<p>The agglomeration causes a significant challenge to nanodielectrics. Identification of agglomerates in scanning electron microscopy (SEM) images is an important step of solving this issue. Motivated by the fast development of image recognition in computer vision, we propose a new approach for agglomerates identification in SEM images of nanodielectrics by semantic segmentation, which is more efficient and accurate than traditional methods. Three models based on convolutional neural networks are investigated in this work, namely pixel blocks classification network, full convolutional segmentation network employed with data augmentation and unsupervised self-encoding network. All three networks can preliminarily identify agglomerates of spherical silica-based blend polyethylene nanocomposites. The mean intersection over union (mIoU) of pixel blocks classification network is 0.843 and it takes 25 s to process an image. Full convolutional segmentation network only needs 0.059 s to process a sample, with a mIoU of 0.777. Unsupervised self-encoding network can reach a mIoU of 0.747 at a speed of 5.806 s. According to the amount of data sets, and requirements for different speed and accuracy, three kinds of networks can be flexibly selected.</p>","PeriodicalId":36855,"journal":{"name":"IET Nanodielectrics","volume":"5 2","pages":"93-103"},"PeriodicalIF":3.8000,"publicationDate":"2022-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/nde2.12034","citationCount":"0","resultStr":"{\"title\":\"Identification of nanocomposites agglomerates in scanning electron microscopy images based on semantic segmentation\",\"authors\":\"Yu Bai, Yan Wang, Dayuan Qiang, Xin Yuan, Jiehui Wu, Weilong Chen, Sai Zhang, Yanru Zhang, George Chen\",\"doi\":\"10.1049/nde2.12034\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The agglomeration causes a significant challenge to nanodielectrics. Identification of agglomerates in scanning electron microscopy (SEM) images is an important step of solving this issue. Motivated by the fast development of image recognition in computer vision, we propose a new approach for agglomerates identification in SEM images of nanodielectrics by semantic segmentation, which is more efficient and accurate than traditional methods. Three models based on convolutional neural networks are investigated in this work, namely pixel blocks classification network, full convolutional segmentation network employed with data augmentation and unsupervised self-encoding network. All three networks can preliminarily identify agglomerates of spherical silica-based blend polyethylene nanocomposites. The mean intersection over union (mIoU) of pixel blocks classification network is 0.843 and it takes 25 s to process an image. Full convolutional segmentation network only needs 0.059 s to process a sample, with a mIoU of 0.777. Unsupervised self-encoding network can reach a mIoU of 0.747 at a speed of 5.806 s. According to the amount of data sets, and requirements for different speed and accuracy, three kinds of networks can be flexibly selected.</p>\",\"PeriodicalId\":36855,\"journal\":{\"name\":\"IET Nanodielectrics\",\"volume\":\"5 2\",\"pages\":\"93-103\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2022-03-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/nde2.12034\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Nanodielectrics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/nde2.12034\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Nanodielectrics","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/nde2.12034","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Identification of nanocomposites agglomerates in scanning electron microscopy images based on semantic segmentation
The agglomeration causes a significant challenge to nanodielectrics. Identification of agglomerates in scanning electron microscopy (SEM) images is an important step of solving this issue. Motivated by the fast development of image recognition in computer vision, we propose a new approach for agglomerates identification in SEM images of nanodielectrics by semantic segmentation, which is more efficient and accurate than traditional methods. Three models based on convolutional neural networks are investigated in this work, namely pixel blocks classification network, full convolutional segmentation network employed with data augmentation and unsupervised self-encoding network. All three networks can preliminarily identify agglomerates of spherical silica-based blend polyethylene nanocomposites. The mean intersection over union (mIoU) of pixel blocks classification network is 0.843 and it takes 25 s to process an image. Full convolutional segmentation network only needs 0.059 s to process a sample, with a mIoU of 0.777. Unsupervised self-encoding network can reach a mIoU of 0.747 at a speed of 5.806 s. According to the amount of data sets, and requirements for different speed and accuracy, three kinds of networks can be flexibly selected.