Efficient Phase Segmentation of Light-Optical Microscopy Images of Highly Complex Microstructures Using a Correlative Approach in Combination with Deep Learning Techniques

IF 2.6 3区 材料科学 Q3 MATERIALS SCIENCE, MULTIDISCIPLINARY Metals Pub Date : 2024-09-14 DOI:10.3390/met14091051
Björn-Ivo Bachmann, Martin Müller, Marie Stiefel, Dominik Britz, Thorsten Staudt, Frank Mücklich
{"title":"Efficient Phase Segmentation of Light-Optical Microscopy Images of Highly Complex Microstructures Using a Correlative Approach in Combination with Deep Learning Techniques","authors":"Björn-Ivo Bachmann, Martin Müller, Marie Stiefel, Dominik Britz, Thorsten Staudt, Frank Mücklich","doi":"10.3390/met14091051","DOIUrl":null,"url":null,"abstract":"Reliable microstructure characterization is essential for establishing process–microstructure–property links and effective quality control. Traditional manual microstructure analysis often struggles with objectivity, reproducibility, and scalability, particularly in complex materials. Machine learning methods offer a promising alternative but are hindered by the challenge of assigning an accurate and consistent ground truth, especially for complex microstructures. This paper introduces a methodology that uses correlative microscopy—combining light optical microscopy, scanning electron microscopy, and electron backscatter diffraction (EBSD)—to create objective, reproducible pixel-by-pixel annotations for ML training. In a semi-automated manner, EBSD-based annotations are employed to generate an objective ground truth mask for training a semantic segmentation model for quantifying simple light optical micrographs. The training masks are directly derived from raw EBSD data using modern deep learning methods. By using EBSD-based annotations, which incorporate crystallographic and misorientation data, the correctness and objectivity of the training mask creation can be assured. The final approach is capable of reproducibly and objectively differentiating bainite and martensite in optical micrographs of complex quenched steels. Through the reduction in the microstructural evaluation to light optical micrographs as the simplest and most widely used method, this way of quantifying microstructures is characterized by high efficiency as well as good scalability.","PeriodicalId":18461,"journal":{"name":"Metals","volume":"14 1","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Metals","FirstCategoryId":"88","ListUrlMain":"https://doi.org/10.3390/met14091051","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Reliable microstructure characterization is essential for establishing process–microstructure–property links and effective quality control. Traditional manual microstructure analysis often struggles with objectivity, reproducibility, and scalability, particularly in complex materials. Machine learning methods offer a promising alternative but are hindered by the challenge of assigning an accurate and consistent ground truth, especially for complex microstructures. This paper introduces a methodology that uses correlative microscopy—combining light optical microscopy, scanning electron microscopy, and electron backscatter diffraction (EBSD)—to create objective, reproducible pixel-by-pixel annotations for ML training. In a semi-automated manner, EBSD-based annotations are employed to generate an objective ground truth mask for training a semantic segmentation model for quantifying simple light optical micrographs. The training masks are directly derived from raw EBSD data using modern deep learning methods. By using EBSD-based annotations, which incorporate crystallographic and misorientation data, the correctness and objectivity of the training mask creation can be assured. The final approach is capable of reproducibly and objectively differentiating bainite and martensite in optical micrographs of complex quenched steels. Through the reduction in the microstructural evaluation to light optical micrographs as the simplest and most widely used method, this way of quantifying microstructures is characterized by high efficiency as well as good scalability.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用相关方法结合深度学习技术对高度复杂微结构的光学显微图像进行高效相位分割
可靠的微观结构表征对于建立工艺-微观结构-性能之间的联系和有效的质量控制至关重要。传统的人工微观结构分析通常在客观性、可重复性和可扩展性方面存在困难,尤其是在复杂材料中。机器学习方法提供了一种很有前途的替代方法,但却受到分配准确一致的基本事实这一挑战的阻碍,尤其是对于复杂的微观结构而言。本文介绍了一种使用相关显微镜--结合光学显微镜、扫描电子显微镜和电子反向散射衍射(EBSD)--为机器学习训练创建客观、可重复的逐像素注释的方法。通过半自动化的方式,基于 EBSD 的注释被用于生成客观的基本真实掩膜,以训练用于量化简单光学显微照片的语义分割模型。训练掩模是利用现代深度学习方法从原始 EBSD 数据中直接得出的。通过使用基于 EBSD 的注释(其中包含晶体学和错误取向数据),可以确保训练掩膜创建的正确性和客观性。最终方法能够在复杂淬火钢的光学显微照片中重复、客观地区分贝氏体和马氏体。通过将微观结构评估简化为光学显微照片这种最简单、最广泛使用的方法,这种量化微观结构的方法具有效率高和可扩展性好的特点。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Metals
Metals MATERIALS SCIENCE, MULTIDISCIPLINARY-METALLURGY & METALLURGICAL ENGINEERING
CiteScore
4.90
自引率
13.80%
发文量
1832
审稿时长
1.5 months
期刊介绍: Metals (ISSN 2075-4701) is an open access journal of related scientific research and technology development. It publishes reviews, regular research papers (articles) and short communications. Our aim is to encourage scientists to publish their experimental and theoretical results in as much detail as possible. Therefore, there is no restriction on the length of the papers. The full experimental details must be provided so that the results can be reproduced. Metals provides a forum for publishing papers which advance the in-depth understanding of the relationship between the structure, the properties or the functions of all kinds of metals.
期刊最新文献
Improvement of High Temperature Wear Resistance of Laser-Cladding High-Entropy Alloy Coatings: A Review New Method to Recover Activation Energy: Application to Copper Oxidation Alternatives to Reduce Hot Cracking Susceptibility of IN718 Casting Alloy Laser Beam Welds with a Mushroom Shape A Method of Images to Study Plate-Impact-Induced Cavitation in Aluminum through Molecular Dynamics Simulation Morphological Characteristics of W/Cu Composite Nanoparticles with Complex Phase Structure Synthesized via Reactive Radio Frequency (RF) Thermal Plasma
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1