André Colliard-Granero*, Jenia Jitsev, Michael H. Eikerling, Kourosh Malek and Mohammad J. Eslamibidgoli*,
{"title":"UTILE-Gen: Automated Image Analysis in Nanoscience Using Synthetic Dataset Generator and Deep Learning","authors":"André Colliard-Granero*, Jenia Jitsev, Michael H. Eikerling, Kourosh Malek and Mohammad J. Eslamibidgoli*, ","doi":"10.1021/acsnanoscienceau.3c00020","DOIUrl":null,"url":null,"abstract":"<p >This work presents the development and implementation of a deep learning-based workflow for autonomous image analysis in nanoscience. A versatile, agnostic, and configurable tool was developed to generate instance-segmented imaging datasets of nanoparticles. The synthetic generator tool employs domain randomization to expand the image/mask pairs dataset for training supervised deep learning models. The approach eliminates tedious manual annotation and allows training of high-performance models for microscopy image analysis based on convolutional neural networks. We demonstrate how the expanded training set can significantly improve the performance of the classification and instance segmentation models for a variety of nanoparticle shapes, ranging from spherical-, cubic-, to rod-shaped nanoparticles. Finally, the trained models were deployed in a cloud-based analytics platform for the autonomous particle analysis of microscopy images.</p>","PeriodicalId":29799,"journal":{"name":"ACS Nanoscience Au","volume":"3 5","pages":"398–407"},"PeriodicalIF":4.8000,"publicationDate":"2023-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://pubs.acs.org/doi/epdf/10.1021/acsnanoscienceau.3c00020","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Nanoscience Au","FirstCategoryId":"1085","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acsnanoscienceau.3c00020","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"NANOSCIENCE & NANOTECHNOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
This work presents the development and implementation of a deep learning-based workflow for autonomous image analysis in nanoscience. A versatile, agnostic, and configurable tool was developed to generate instance-segmented imaging datasets of nanoparticles. The synthetic generator tool employs domain randomization to expand the image/mask pairs dataset for training supervised deep learning models. The approach eliminates tedious manual annotation and allows training of high-performance models for microscopy image analysis based on convolutional neural networks. We demonstrate how the expanded training set can significantly improve the performance of the classification and instance segmentation models for a variety of nanoparticle shapes, ranging from spherical-, cubic-, to rod-shaped nanoparticles. Finally, the trained models were deployed in a cloud-based analytics platform for the autonomous particle analysis of microscopy images.
期刊介绍:
ACS Nanoscience Au is an open access journal that publishes original fundamental and applied research on nanoscience and nanotechnology research at the interfaces of chemistry biology medicine materials science physics and engineering.The journal publishes short letters comprehensive articles reviews and perspectives on all aspects of nanoscience and nanotechnology:synthesis assembly characterization theory modeling and simulation of nanostructures nanomaterials and nanoscale devicesdesign fabrication and applications of organic inorganic polymer hybrid and biological nanostructuresexperimental and theoretical studies of nanoscale chemical physical and biological phenomenamethods and tools for nanoscience and nanotechnologyself- and directed-assemblyzero- one- and two-dimensional materialsnanostructures and nano-engineered devices with advanced performancenanobiotechnologynanomedicine and nanotoxicologyACS Nanoscience Au also publishes original experimental and theoretical research of an applied nature that integrates knowledge in the areas of materials engineering physics bioscience and chemistry into important applications of nanomaterials.