A soft scanning electron microscopy for efficient segmentation of alloy microstructures based on a new self-supervised pre-training deep learning network
Jinhan Zhang , Jingtai Yu , Xiaoran Wei , Kun Zhou , Weifei Niu , Yushun Wei , Cong Zhao , Gang Chen , Fengmin Jin , Kai Song
{"title":"A soft scanning electron microscopy for efficient segmentation of alloy microstructures based on a new self-supervised pre-training deep learning network","authors":"Jinhan Zhang , Jingtai Yu , Xiaoran Wei , Kun Zhou , Weifei Niu , Yushun Wei , Cong Zhao , Gang Chen , Fengmin Jin , Kai Song","doi":"10.1016/j.matchar.2024.114532","DOIUrl":null,"url":null,"abstract":"<div><div>To provide an on-site metallographic segmentation using only optical microscopy images, sSEM-Net, a soft scanning electron microscopy network, is developed based on a self-supervised pre-training deep learning framework. During model training, only a sparse collection of SEM images is necessary for annotation assistance. By integrating CNN and Transformer, sSEM-Net efficiently utilizes global context information while mitigating data dependency and computational resource constraints. Using only readily available optical microscopy images as input, sSEM-Net achieves metallographic segmentation comparable to SEM images, catering to rapid and cost-effective industrial needs. This methodology leverages non-destructive inspection attributes, catering to rapid and cost-sensitive industrial requirements. The efficacy of the proposed sSEM-Net is demonstrated through metallographic structure analysis of TC4 titanium alloy, with potential extensions to other alloy types.</div></div>","PeriodicalId":18727,"journal":{"name":"Materials Characterization","volume":"218 ","pages":"Article 114532"},"PeriodicalIF":4.8000,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Materials Characterization","FirstCategoryId":"88","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1044580324009136","RegionNum":2,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATERIALS SCIENCE, CHARACTERIZATION & TESTING","Score":null,"Total":0}
引用次数: 0
Abstract
To provide an on-site metallographic segmentation using only optical microscopy images, sSEM-Net, a soft scanning electron microscopy network, is developed based on a self-supervised pre-training deep learning framework. During model training, only a sparse collection of SEM images is necessary for annotation assistance. By integrating CNN and Transformer, sSEM-Net efficiently utilizes global context information while mitigating data dependency and computational resource constraints. Using only readily available optical microscopy images as input, sSEM-Net achieves metallographic segmentation comparable to SEM images, catering to rapid and cost-effective industrial needs. This methodology leverages non-destructive inspection attributes, catering to rapid and cost-sensitive industrial requirements. The efficacy of the proposed sSEM-Net is demonstrated through metallographic structure analysis of TC4 titanium alloy, with potential extensions to other alloy types.
期刊介绍:
Materials Characterization features original articles and state-of-the-art reviews on theoretical and practical aspects of the structure and behaviour of materials.
The Journal focuses on all characterization techniques, including all forms of microscopy (light, electron, acoustic, etc.,) and analysis (especially microanalysis and surface analytical techniques). Developments in both this wide range of techniques and their application to the quantification of the microstructure of materials are essential facets of the Journal.
The Journal provides the Materials Scientist/Engineer with up-to-date information on many types of materials with an underlying theme of explaining the behavior of materials using novel approaches. Materials covered by the journal include:
Metals & Alloys
Ceramics
Nanomaterials
Biomedical materials
Optical materials
Composites
Natural Materials.