High-speed 4-dimensional scanning transmission electron microscopy using compressive sensing techniques

IF 1.5 4区 工程技术 Q3 MICROSCOPY Journal of microscopy Pub Date : 2024-05-06 DOI:10.1111/jmi.13315
Alex W. Robinson, Amirafshar Moshtaghpour, Jack Wells, Daniel Nicholls, Miaofang Chi, Ian MacLaren, Angus I. Kirkland, Nigel D. Browning
{"title":"High-speed 4-dimensional scanning transmission electron microscopy using compressive sensing techniques","authors":"Alex W. Robinson,&nbsp;Amirafshar Moshtaghpour,&nbsp;Jack Wells,&nbsp;Daniel Nicholls,&nbsp;Miaofang Chi,&nbsp;Ian MacLaren,&nbsp;Angus I. Kirkland,&nbsp;Nigel D. Browning","doi":"10.1111/jmi.13315","DOIUrl":null,"url":null,"abstract":"<p>Here we show that compressive sensing allows 4-dimensional (4-D) STEM data to be obtained and accurately reconstructed with both high-speed and reduced electron fluence. The methodology needed to achieve these results compared to conventional 4-D approaches requires only that a random subset of probe locations is acquired from the typical regular scanning grid, which immediately generates both higher speed and the lower fluence experimentally. We also consider downsampling of the detector, showing that oversampling is inherent within convergent beam electron diffraction (CBED) patterns and that detector downsampling does not reduce precision but allows faster experimental data acquisition. Analysis of an experimental atomic resolution yttrium silicide dataset shows that it is possible to recover over 25 dB peak signal-to-noise ratio in the recovered phase using 0.3% of the total data.</p><p><b>Lay abstract</b>: Four-dimensional scanning transmission electron microscopy (4-D STEM) is a powerful technique for characterizing complex nanoscale structures. In this method, a convergent beam electron diffraction pattern (CBED) is acquired at each probe location during the scan of the sample. This means that a 2-dimensional signal is acquired at each 2-D probe location, equating to a 4-D dataset.</p><p>Despite the recent development of fast direct electron detectors, some capable of 100kHz frame rates, the limiting factor for 4-D STEM is acquisition times in the majority of cases, where cameras will typically operate on the order of 2kHz. This means that a raster scan containing 256^2 probe locations can take on the order of 30s, approximately 100-1000 times longer than a conventional STEM imaging technique using monolithic radial detectors. As a result, 4-D STEM acquisitions can be subject to adverse effects such as drift, beam damage, and sample contamination.</p><p>Recent advances in computational imaging techniques for STEM have allowed for faster acquisition speeds by way of acquiring only a random subset of probe locations from the field of view. By doing this, the acquisition time is significantly reduced, in some cases by a factor of 10-100 times. The acquired data is then processed to fill-in or inpaint the missing data, taking advantage of the inherently low-complex signals which can be linearly combined to recover the information.</p><p>In this work, similar methods are demonstrated for the acquisition of 4-D STEM data, where only a random subset of CBED patterns are acquired over the raster scan. We simulate the compressive sensing acquisition method for 4-D STEM and present our findings for a variety of analysis techniques such as ptychography and differential phase contrast. Our results show that acquisition times can be significantly reduced on the order of 100-300 times, therefore improving existing frame rates, as well as further reducing the electron fluence beyond just using a faster camera.</p>","PeriodicalId":16484,"journal":{"name":"Journal of microscopy","volume":null,"pages":null},"PeriodicalIF":1.5000,"publicationDate":"2024-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jmi.13315","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of microscopy","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jmi.13315","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MICROSCOPY","Score":null,"Total":0}
引用次数: 0

Abstract

Here we show that compressive sensing allows 4-dimensional (4-D) STEM data to be obtained and accurately reconstructed with both high-speed and reduced electron fluence. The methodology needed to achieve these results compared to conventional 4-D approaches requires only that a random subset of probe locations is acquired from the typical regular scanning grid, which immediately generates both higher speed and the lower fluence experimentally. We also consider downsampling of the detector, showing that oversampling is inherent within convergent beam electron diffraction (CBED) patterns and that detector downsampling does not reduce precision but allows faster experimental data acquisition. Analysis of an experimental atomic resolution yttrium silicide dataset shows that it is possible to recover over 25 dB peak signal-to-noise ratio in the recovered phase using 0.3% of the total data.

Lay abstract: Four-dimensional scanning transmission electron microscopy (4-D STEM) is a powerful technique for characterizing complex nanoscale structures. In this method, a convergent beam electron diffraction pattern (CBED) is acquired at each probe location during the scan of the sample. This means that a 2-dimensional signal is acquired at each 2-D probe location, equating to a 4-D dataset.

Despite the recent development of fast direct electron detectors, some capable of 100kHz frame rates, the limiting factor for 4-D STEM is acquisition times in the majority of cases, where cameras will typically operate on the order of 2kHz. This means that a raster scan containing 256^2 probe locations can take on the order of 30s, approximately 100-1000 times longer than a conventional STEM imaging technique using monolithic radial detectors. As a result, 4-D STEM acquisitions can be subject to adverse effects such as drift, beam damage, and sample contamination.

Recent advances in computational imaging techniques for STEM have allowed for faster acquisition speeds by way of acquiring only a random subset of probe locations from the field of view. By doing this, the acquisition time is significantly reduced, in some cases by a factor of 10-100 times. The acquired data is then processed to fill-in or inpaint the missing data, taking advantage of the inherently low-complex signals which can be linearly combined to recover the information.

In this work, similar methods are demonstrated for the acquisition of 4-D STEM data, where only a random subset of CBED patterns are acquired over the raster scan. We simulate the compressive sensing acquisition method for 4-D STEM and present our findings for a variety of analysis techniques such as ptychography and differential phase contrast. Our results show that acquisition times can be significantly reduced on the order of 100-300 times, therefore improving existing frame rates, as well as further reducing the electron fluence beyond just using a faster camera.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
使用压缩传感技术的高速四维扫描透射电子显微镜。
在这里,我们展示了压缩传感技术可以在高速和低电子通量的条件下获得并精确重建四维(4-D)STEM 数据。与传统的四维方法相比,获得这些结果所需的方法只需要从典型的规则扫描网格中随机获取探针位置子集,这样就能立即在实验中获得更高的速度和更低的电子流。我们还考虑了探测器的下采样,结果表明过采样是会聚束电子衍射(CBED)模式的固有特性,探测器的下采样不会降低精度,反而能加快实验数据的采集。对原子分辨率硅化钇实验数据集的分析表明,只需使用总数据的 0.3%,就可以在恢复相中恢复超过 25 dB 的峰值信噪比。论文摘要:四维扫描透射电子显微镜(4-D STEM)是一种表征复杂纳米级结构的强大技术。在这种方法中,在扫描样品的过程中,每个探针位置都会获得一个会聚束电子衍射图(CBED)。这意味着在每个二维探针位置都能获得一个二维信号,相当于一个四维数据集。尽管最近开发出了快速直接电子探测器,有些探测器的帧频可达 100kHz,但在大多数情况下,4-D STEM 的限制因素是采集时间,摄像机的工作频率通常在 2kHz 左右。这意味着包含 256^2 个探针位置的光栅扫描需要 30 秒左右的时间,比使用单片径向探测器的传统 STEM 成像技术大约长 100-1000 倍。因此,4-D STEM 采集可能会受到漂移、光束损坏和样品污染等不利影响。STEM 计算成像技术的最新进展是,只采集视场中探针位置的随机子集,从而加快了采集速度。通过这种方法,采集时间大大缩短,在某些情况下可缩短 10-100 倍。然后对采集到的数据进行处理,利用固有的低复杂度信号,对缺失的数据进行填充或涂抹,这些信号可以通过线性组合来恢复信息。在这项工作中,我们展示了类似的四维 STEM 数据采集方法,即在光栅扫描中只采集 CBED 图案的随机子集。我们模拟了用于 4-D STEM 的压缩传感采集方法,并介绍了我们对各种分析技术(如层析成像和差分相衬)的研究结果。我们的结果表明,采集时间可以显著缩短 100-300 倍,从而提高现有帧频,并进一步降低电子通量,而不仅仅是使用更快的相机。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of microscopy
Journal of microscopy 工程技术-显微镜技术
CiteScore
4.30
自引率
5.00%
发文量
83
审稿时长
1 months
期刊介绍: The Journal of Microscopy is the oldest journal dedicated to the science of microscopy and the only peer-reviewed publication of the Royal Microscopical Society. It publishes papers that report on the very latest developments in microscopy such as advances in microscopy techniques or novel areas of application. The Journal does not seek to publish routine applications of microscopy or specimen preparation even though the submission may otherwise have a high scientific merit. The scope covers research in the physical and biological sciences and covers imaging methods using light, electrons, X-rays and other radiations as well as atomic force and near field techniques. Interdisciplinary research is welcome. Papers pertaining to microscopy are also welcomed on optical theory, spectroscopy, novel specimen preparation and manipulation methods and image recording, processing and analysis including dynamic analysis of living specimens. Publication types include full papers, hot topic fast tracked communications and review articles. Authors considering submitting a review article should contact the editorial office first.
期刊最新文献
TOC - Issue Information Use of Melinex film for flat embedding tissue sections in LR White. Setting up an institutional OMERO environment for bioimage data: Perspectives from both facility staff and users The mutual influence of microtubules and the cortical ER on their coordinated organisation. Correction to “Image quality evaluation for FIB-SEM images”
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1