首页 > 最新文献

Advanced Structural and Chemical Imaging最新文献

英文 中文
Applying compressive sensing to TEM video: a substantial frame rate increase on any camera 将压缩感知应用于TEM视频:在任何摄像机上大幅提高帧率
IF 3.56 Q1 Medicine Pub Date : 2015-08-13 DOI: 10.1186/s40679-015-0009-3
Andrew Stevens, Libor Kovarik, Patricia Abellan, Xin Yuan, Lawrence Carin, Nigel D. Browning

One of the main limitations of imaging at high spatial and temporal resolution during in-situ transmission electron microscopy (TEM) experiments is the frame rate of the camera being used to image the dynamic process. While the recent development of direct detectors has provided the hardware to achieve frame rates approaching 0.1 ms, the cameras are expensive and must replace existing detectors. In this paper, we examine the use of coded aperture compressive sensing (CS) methods to increase the frame rate of any camera with simple, low-cost hardware modifications. The coded aperture approach allows multiple sub-frames to be coded and integrated into a single camera frame during the acquisition process, and then extracted upon readout using statistical CS inversion. Here we describe the background of CS and statistical methods in depth and simulate the frame rates and efficiencies for in-situ TEM experiments. Depending on the resolution and signal/noise of the image, it should be possible to increase the speed of any camera by more than an order of magnitude using this approach.

Mathematics Subject Classification: (2010) 94A08 · 78A15

在原位透射电子显微镜(TEM)实验中,高时空分辨率成像的主要限制之一是使用相机的帧速率来成像动态过程。虽然最近发展的直接探测器已经提供了硬件来实现接近0.1 ms的帧速率,但相机价格昂贵,必须取代现有的探测器。在本文中,我们研究了使用编码孔径压缩感知(CS)方法,通过简单,低成本的硬件修改来提高任何相机的帧率。编码孔径方法允许在采集过程中对多个子帧进行编码并集成到单个相机帧中,然后在读取时使用统计CS反演进行提取。本文深入介绍了CS的研究背景和统计方法,并对原位TEM实验的帧率和效率进行了仿真。根据图像的分辨率和信号/噪声,使用这种方法应该可以将任何相机的速度提高一个数量级以上。数学学科分类:(2010)94A08·78A15
{"title":"Applying compressive sensing to TEM video: a substantial frame rate increase on any camera","authors":"Andrew Stevens,&nbsp;Libor Kovarik,&nbsp;Patricia Abellan,&nbsp;Xin Yuan,&nbsp;Lawrence Carin,&nbsp;Nigel D. Browning","doi":"10.1186/s40679-015-0009-3","DOIUrl":"https://doi.org/10.1186/s40679-015-0009-3","url":null,"abstract":"<p>One of the main limitations of imaging at high spatial and temporal resolution during <i>in-situ</i> transmission electron microscopy (TEM) experiments is the frame rate of the camera being used to image the dynamic process. While the recent development of direct detectors has provided the hardware to achieve frame rates approaching 0.1 ms, the cameras are expensive and must replace existing detectors. In this paper, we examine the use of coded aperture compressive sensing (CS) methods to increase the frame rate of any camera with simple, low-cost hardware modifications. The coded aperture approach allows multiple sub-frames to be coded and integrated into a single camera frame during the acquisition process, and then extracted upon readout using statistical CS inversion. Here we describe the background of CS and statistical methods in depth and simulate the frame rates and efficiencies for <i>in-situ</i> TEM experiments. Depending on the resolution and signal/noise of the image, it should be possible to increase the speed of any camera by more than an order of magnitude using this approach.</p><p>\u0000\t\t\t\t <b>Mathematics Subject Classification:</b> (2010) 94A08 · 78A15</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-015-0009-3","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"4527192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 71
Machine learning as a tool for classifying electron tomographic reconstructions 机器学习作为分类电子层析重建的工具
IF 3.56 Q1 Medicine Pub Date : 2015-08-05 DOI: 10.1186/s40679-015-0010-x
Lech Staniewicz, Paul A. Midgley

Electron tomographic reconstructions often contain artefacts from sources such as noise in the projections and a “missing wedge” of projection angles which can hamper quantitative analysis. We present a machine-learning approach using freely available software for analysing imperfect reconstructions to be used in place of the more traditional thresholding based on grey-level technique and show that a properly trained image classifier can achieve manual levels of accuracy even on heavily artefacted data, though if multiple reconstructions are being processed, a separate classifier will need to be trained on each reconstruction for maximum accuracy.

电子层析重建通常包含来自投影中的噪声和投影角度的“缺失楔”等来源的伪影,这可能会妨碍定量分析。我们提出了一种机器学习方法,使用免费的软件来分析不完美的重建,以取代基于灰度技术的更传统的阈值,并表明经过适当训练的图像分类器即使在大量人工数据上也可以达到人工水平的准确性,尽管如果正在处理多个重建,则需要对每个重建进行单独的分类器训练以获得最大的准确性。
{"title":"Machine learning as a tool for classifying electron tomographic reconstructions","authors":"Lech Staniewicz,&nbsp;Paul A. Midgley","doi":"10.1186/s40679-015-0010-x","DOIUrl":"https://doi.org/10.1186/s40679-015-0010-x","url":null,"abstract":"<p>Electron tomographic reconstructions often contain artefacts from sources such as noise in the projections and a “missing wedge” of projection angles which can hamper quantitative analysis. We present a machine-learning approach using freely available software for analysing imperfect reconstructions to be used in place of the more traditional thresholding based on grey-level technique and show that a properly trained image classifier can achieve manual levels of accuracy even on heavily artefacted data, though if multiple reconstructions are being processed, a separate classifier will need to be trained on each reconstruction for maximum accuracy.</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-015-0010-x","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"4199202","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
Smart Align—a new tool for robust non-rigid registration of scanning microscope data 智能校准是一种新的扫描显微镜数据鲁棒非刚性配准工具
IF 3.56 Q1 Medicine Pub Date : 2015-07-10 DOI: 10.1186/s40679-015-0008-4
Lewys Jones, Hao Yang, Timothy J. Pennycook, Matthew S. J. Marshall, Sandra Van Aert, Nigel D. Browning, Martin R. Castell, Peter D. Nellist

Many microscopic investigations of materials may benefit from the recording of multiple successive images. This can include techniques common to several types of microscopy such as frame averaging to improve signal-to-noise ratios (SNR) or time series to study dynamic processes or more specific applications. In the scanning transmission electron microscope, this might include focal series for optical sectioning or aberration measurement, beam damage studies or camera-length series to study the effects of strain; whilst in the scanning tunnelling microscope, this might include bias-voltage series to probe local electronic structure. Whatever the application, such investigations must begin with the careful alignment of these data stacks, an operation that is not always trivial. In addition, the presence of low-frequency scanning distortions can introduce intra-image shifts to the data. Here, we describe an improved automated method of performing non-rigid registration customised for the challenges unique to scanned microscope data specifically addressing the issues of low-SNR data, images containing a large proportion of crystalline material and/or local features of interest such as dislocations or edges. Careful attention has been paid to artefact testing of the non-rigid registration method used, and the importance of this registration for the quantitative interpretation of feature intensities and positions is evaluated.

许多材料的显微研究可能受益于多个连续图像的记录。这可以包括常见的几种类型的显微镜技术,如帧平均,以提高信噪比(SNR)或时间序列,以研究动态过程或更具体的应用。在扫描透射电子显微镜中,这可能包括用于光学切片或像差测量的焦系列,光束损伤研究或用于研究应变影响的相机长度系列;而在扫描隧道显微镜中,这可能包括偏压系列来探测局部电子结构。无论应用程序是什么,此类调查都必须从仔细对齐这些数据堆栈开始,这一操作并不总是微不足道的。此外,低频扫描畸变的存在会给数据带来图像内偏移。在这里,我们描述了一种改进的执行非刚性配准的自动化方法,该方法是为扫描显微镜数据所特有的挑战而定制的,专门解决低信噪比数据、包含大量晶体材料的图像和/或感兴趣的局部特征(如位错或边缘)的问题。对所使用的非刚性配准方法的伪影测试进行了仔细的关注,并评估了这种配准对特征强度和位置的定量解释的重要性。
{"title":"Smart Align—a new tool for robust non-rigid registration of scanning microscope data","authors":"Lewys Jones,&nbsp;Hao Yang,&nbsp;Timothy J. Pennycook,&nbsp;Matthew S. J. Marshall,&nbsp;Sandra Van Aert,&nbsp;Nigel D. Browning,&nbsp;Martin R. Castell,&nbsp;Peter D. Nellist","doi":"10.1186/s40679-015-0008-4","DOIUrl":"https://doi.org/10.1186/s40679-015-0008-4","url":null,"abstract":"<p>Many microscopic investigations of materials may benefit from the recording of multiple successive images. This can include techniques common to several types of microscopy such as frame averaging to improve signal-to-noise ratios (SNR) or time series to study dynamic processes or more specific applications. In the scanning transmission electron microscope, this might include focal series for optical sectioning or aberration measurement, beam damage studies or camera-length series to study the effects of strain; whilst in the scanning tunnelling microscope, this might include bias-voltage series to probe local electronic structure. Whatever the application, such investigations must begin with the careful alignment of these data stacks, an operation that is not always trivial. In addition, the presence of low-frequency scanning distortions can introduce intra-image shifts to the data. Here, we describe an improved automated method of performing non-rigid registration customised for the challenges unique to scanned microscope data specifically addressing the issues of low-SNR data, images containing a large proportion of crystalline material and/or local features of interest such as dislocations or edges. Careful attention has been paid to artefact testing of the non-rigid registration method used, and the importance of this registration for the quantitative interpretation of feature intensities and positions is evaluated.</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-015-0008-4","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"4422674","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 314
Reduced-dose and high-speed acquisition strategies for multi-dimensional electron microscopy 多维电子显微镜的低剂量和高速采集策略
IF 3.56 Q1 Medicine Pub Date : 2015-05-13 DOI: 10.1186/s40679-015-0007-5
Zineb Saghi, Martin Benning, Rowan Leary, Manuel Macias-Montero, Ana Borras, Paul A Midgley

Multi-dimensional electron microscopy has recently gained considerable interest thanks to the advent of microscopes with unprecedented analytical and in situ capabilities. These information-rich imaging modes, though, are often subject to long acquisition times and large data generation. In this paper, we explore novel acquisition strategies and reconstruction algorithms to retrieve reliable reconstructions from datasets that are limited in terms of both per image and tilt series angular sampling. We show that inpainting techniques are capable of restoring scanning transmission electron microscopy images in which a very restricted number of pixels are scanned, while compressed sensing tomographic reconstruction is capable of minimising artefacts due to angular subsampling. An example of robust reconstruction from data constituting a dose reduction of 10× is presented, using an organic/inorganic core-shell nanowire as a test sample. The combination of these novel acquisition schemes and image recovery strategies provides new avenues to reduced-dose and high-speed imaging.

由于具有前所未有的分析和原位能力的显微镜的出现,多维电子显微镜最近获得了相当大的兴趣。然而,这些信息丰富的成像模式往往需要较长的采集时间和大量的数据生成。在本文中,我们探索了新的采集策略和重建算法,以从数据集中检索可靠的重建,这些数据集在每张图像和倾斜序列角度采样方面都是有限的。我们表明,图像修复技术能够恢复扫描透射电子显微镜图像,其中扫描的像素数量非常有限,而压缩感知层析成像重建能够最大限度地减少由于角次采样造成的伪影。本文提出了一个使用有机/无机核壳纳米线作为测试样本,从构成剂量减少10倍的数据进行鲁棒重建的例子。这些新的采集方案和图像恢复策略的结合为低剂量和高速成像提供了新的途径。
{"title":"Reduced-dose and high-speed acquisition strategies for multi-dimensional electron microscopy","authors":"Zineb Saghi,&nbsp;Martin Benning,&nbsp;Rowan Leary,&nbsp;Manuel Macias-Montero,&nbsp;Ana Borras,&nbsp;Paul A Midgley","doi":"10.1186/s40679-015-0007-5","DOIUrl":"https://doi.org/10.1186/s40679-015-0007-5","url":null,"abstract":"<p>Multi-dimensional electron microscopy has recently gained considerable interest thanks to the advent of microscopes with unprecedented analytical and <i>in situ</i> capabilities. These information-rich imaging modes, though, are often subject to long acquisition times and large data generation. In this paper, we explore novel acquisition strategies and reconstruction algorithms to retrieve reliable reconstructions from datasets that are limited in terms of both per image and tilt series angular sampling. We show that inpainting techniques are capable of restoring scanning transmission electron microscopy images in which a very restricted number of pixels are scanned, while compressed sensing tomographic reconstruction is capable of minimising artefacts due to angular subsampling. An example of robust reconstruction from data constituting a dose reduction of 10× is presented, using an organic/inorganic core-shell nanowire as a test sample. The combination of these novel acquisition schemes and image recovery strategies provides new avenues to reduced-dose and high-speed imaging.</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-015-0007-5","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"4550458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 41
Big data and deep data in scanning and electron microscopies: deriving functionality from multidimensional data sets 扫描和电子显微镜中的大数据和深度数据:从多维数据集派生功能
IF 3.56 Q1 Medicine Pub Date : 2015-05-13 DOI: 10.1186/s40679-015-0006-6
Alex Belianinov, Rama Vasudevan, Evgheni Strelcov, Chad Steed, Sang Mo Yang, Alexander Tselev, Stephen Jesse, Michael Biegalski, Galen Shipman, Christopher Symons, Albina Borisevich, Rick Archibald, Sergei Kalinin

The development of electron and scanning probe microscopies in the second half of the twentieth century has produced spectacular images of the internal structure and composition of matter with nanometer, molecular, and atomic resolution. Largely, this progress was enabled by computer-assisted methods of microscope operation, data acquisition, and analysis. Advances in imaging technology in the beginning of the twenty-first century have opened the proverbial floodgates on the availability of high-veracity information on structure and functionality. From the hardware perspective, high-resolution imaging methods now routinely resolve atomic positions with approximately picometer precision, allowing for quantitative measurements of individual bond lengths and angles. Similarly, functional imaging often leads to multidimensional data sets containing partial or full information on properties of interest, acquired as a function of multiple parameters (time, temperature, or other external stimuli). Here, we review several recent applications of the big and deep data analysis methods to visualize, compress, and translate this multidimensional structural and functional data into physically and chemically relevant information.

二十世纪下半叶电子探针显微镜和扫描探针显微镜的发展,产生了具有纳米、分子和原子分辨率的物质内部结构和组成的壮观图像。在很大程度上,这一进步是由计算机辅助的显微镜操作、数据采集和分析方法实现的。21世纪初成像技术的进步打开了关于结构和功能的高准确性信息的可用性的闸门。从硬件的角度来看,高分辨率成像方法现在通常以大约皮米的精度解析原子位置,允许定量测量单个键的长度和角度。类似地,功能成像通常会导致多维数据集,其中包含有关感兴趣属性的部分或全部信息,这些信息是作为多个参数(时间、温度或其他外部刺激)的函数获得的。在这里,我们回顾了最近一些大数据和深度数据分析方法的应用,这些方法将这些多维结构和功能数据可视化、压缩并转化为物理和化学相关信息。
{"title":"Big data and deep data in scanning and electron microscopies: deriving functionality from multidimensional data sets","authors":"Alex Belianinov,&nbsp;Rama Vasudevan,&nbsp;Evgheni Strelcov,&nbsp;Chad Steed,&nbsp;Sang Mo Yang,&nbsp;Alexander Tselev,&nbsp;Stephen Jesse,&nbsp;Michael Biegalski,&nbsp;Galen Shipman,&nbsp;Christopher Symons,&nbsp;Albina Borisevich,&nbsp;Rick Archibald,&nbsp;Sergei Kalinin","doi":"10.1186/s40679-015-0006-6","DOIUrl":"https://doi.org/10.1186/s40679-015-0006-6","url":null,"abstract":"<p>The development of electron and scanning probe microscopies in the second half of the twentieth century has produced spectacular images of the internal structure and composition of matter with nanometer, molecular, and atomic resolution. Largely, this progress was enabled by computer-assisted methods of microscope operation, data acquisition, and analysis. Advances in imaging technology in the beginning of the twenty-first century have opened the proverbial floodgates on the availability of high-veracity information on structure and functionality. From the hardware perspective, high-resolution imaging methods now routinely resolve atomic positions with approximately picometer precision, allowing for quantitative measurements of individual bond lengths and angles. Similarly, functional imaging often leads to multidimensional data sets containing partial or full information on properties of interest, acquired as a function of multiple parameters (time, temperature, or other external stimuli). Here, we review several recent applications of the big and deep data analysis methods to visualize, compress, and translate this multidimensional structural and functional data into physically and chemically relevant information.</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-015-0006-6","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"4550050","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 92
Physically motivated global alignment method for electron tomography 电子断层扫描的物理驱动全局对准方法
IF 3.56 Q1 Medicine Pub Date : 2015-04-08 DOI: 10.1186/s40679-015-0005-7
Toby Sanders, Micah Prange, Cem Akatay, Peter Binev

Electron tomography is widely used for nanoscale determination of 3-D structures in many areas of science. Determining the 3-D structure of a sample from electron tomography involves three major steps: acquisition of sequence of 2-D projection images of the sample with the electron microscope, alignment of the images to a common coordinate system, and 3-D reconstruction and segmentation of the sample from the aligned image data. The resolution of the 3-D reconstruction is directly influenced by the accuracy of the alignment, and therefore, it is crucial to have a robust and dependable alignment method. In this paper, we develop a new alignment method which avoids the use of markers and instead traces the computed paths of many identifiable ‘local’ center-of-mass points as the sample is rotated. Compared with traditional correlation schemes, the alignment method presented here is resistant to cumulative error observed from correlation techniques, has very rigorous mathematical justification, and is very robust since many points and paths are used, all of which inevitably improves the quality of the reconstruction and confidence in the scientific results.

电子断层扫描在许多科学领域被广泛用于纳米尺度的三维结构测定。从电子断层扫描中确定样品的三维结构包括三个主要步骤:用电子显微镜获取样品的二维投影图像序列,将图像对齐到一个共同的坐标系,以及从对齐的图像数据中对样品进行三维重建和分割。对准精度直接影响到三维重建的分辨率,因此,一种鲁棒可靠的对准方法至关重要。在本文中,我们开发了一种新的对齐方法,该方法避免了使用标记,而是在样本旋转时跟踪许多可识别的“局部”质心点的计算路径。与传统的相关方法相比,本文提出的对准方法能够抵抗相关技术观测到的累积误差,具有非常严格的数学证明,并且由于使用了许多点和路径,因此具有很强的鲁棒性,这些都不可避免地提高了重建的质量和对科学结果的信心。
{"title":"Physically motivated global alignment method for electron tomography","authors":"Toby Sanders,&nbsp;Micah Prange,&nbsp;Cem Akatay,&nbsp;Peter Binev","doi":"10.1186/s40679-015-0005-7","DOIUrl":"https://doi.org/10.1186/s40679-015-0005-7","url":null,"abstract":"<p>Electron tomography is widely used for nanoscale determination of 3-D structures in many areas of science. Determining the 3-D structure of a sample from electron tomography involves three major steps: acquisition of sequence of 2-D projection images of the sample with the electron microscope, alignment of the images to a common coordinate system, and 3-D reconstruction and segmentation of the sample from the aligned image data. The resolution of the 3-D reconstruction is directly influenced by the accuracy of the alignment, and therefore, it is crucial to have a robust and dependable alignment method. In this paper, we develop a new alignment method which avoids the use of markers and instead traces the computed paths of many identifiable ‘local’ center-of-mass points as the sample is rotated. Compared with traditional correlation schemes, the alignment method presented here is resistant to cumulative error observed from correlation techniques, has very rigorous mathematical justification, and is very robust since many points and paths are used, all of which inevitably improves the quality of the reconstruction and confidence in the scientific results.</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-015-0005-7","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"4326917","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Poisson noise removal from high-resolution STEM images based on periodic block matching 基于周期块匹配的高分辨率STEM图像泊松噪声去除
IF 3.56 Q1 Medicine Pub Date : 2015-03-25 DOI: 10.1186/s40679-015-0004-8
Niklas Mevenkamp, Peter Binev, Wolfgang Dahmen, Paul M Voyles, Andrew B Yankovich, Benjamin Berkels

Scanning transmission electron microscopy (STEM) provides sub-?ngstrom, atomic resolution images of crystalline structures. However, in many applications, the ability to extract information such as atom positions, from such electron micrographs, is severely obstructed by low signal-to-noise ratios of the acquired images resulting from necessary limitations to the electron dose. We present a denoising strategy tailored to the special features of atomic-resolution electron micrographs of crystals limited by Poisson noise based on the block-matching and 3D-filtering (BM3D) algorithm by Dabov et al. We also present an economized block-matching strategy that exploits the periodic structure of the observed crystals. On simulated single-shot STEM images of inorganic materials, with incident electron doses below 4 C/cm 2, our new method achieves precisions of 7 to 15 pm and an increase in peak signal-to-noise ratio (PSNR) of 15 to 20 dB compared to noisy images and 2 to 4 dB compared to images denoised with the original BM3D.

扫描透射电子显微镜(STEM)提供亚?晶体结构的原子分辨率图像。然而,在许多应用中,从这样的电子显微照片中提取诸如原子位置等信息的能力,由于电子剂量的必要限制所获得的图像的低信噪比而受到严重阻碍。我们提出了一种基于Dabov等人的块匹配和3d滤波(BM3D)算法的去噪策略,以适应受泊松噪声限制的原子分辨率晶体电子显微图的特殊特征。我们还提出了一种利用所观察晶体的周期性结构的节约型块匹配策略。在模拟无机材料的单次STEM图像上,当入射电子剂量低于4 C/ cm2时,我们的新方法实现了7至15 pm的精度,与噪声图像相比,峰值信噪比(PSNR)提高了15至20 dB,与原始BM3D去噪图像相比,峰值信噪比提高了2至4 dB。
{"title":"Poisson noise removal from high-resolution STEM images based on periodic block matching","authors":"Niklas Mevenkamp,&nbsp;Peter Binev,&nbsp;Wolfgang Dahmen,&nbsp;Paul M Voyles,&nbsp;Andrew B Yankovich,&nbsp;Benjamin Berkels","doi":"10.1186/s40679-015-0004-8","DOIUrl":"https://doi.org/10.1186/s40679-015-0004-8","url":null,"abstract":"<p>Scanning transmission electron microscopy (STEM) provides sub-?ngstrom, atomic resolution images of crystalline structures. However, in many applications, the ability to extract information such as atom positions, from such electron micrographs, is severely obstructed by low signal-to-noise ratios of the acquired images resulting from necessary limitations to the electron dose. We present a denoising strategy tailored to the special features of atomic-resolution electron micrographs of crystals limited by Poisson noise based on the block-matching and 3D-filtering (BM3D) algorithm by Dabov et al. We also present an economized block-matching strategy that exploits the periodic structure of the observed crystals. On simulated single-shot STEM images of inorganic materials, with incident electron doses below 4 C/cm <sup>2</sup>, our new method achieves precisions of 7 to 15 pm and an increase in peak signal-to-noise ratio (PSNR) of 15 to 20 dB compared to noisy images and 2 to 4 dB compared to images denoised with the original BM3D.</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-015-0004-8","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"5354042","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 38
High-precision scanning transmission electron microscopy at coarse pixel sampling for reduced electron dose 用于降低电子剂量的粗像素取样的高精度扫描透射电子显微镜
IF 3.56 Q1 Medicine Pub Date : 2015-03-25 DOI: 10.1186/s40679-015-0003-9
Andrew B Yankovich, Benjamin Berkels, Wolfgang Dahmen, Peter Binev, Paul M Voyles

Determining the precise atomic structure of materials’ surfaces, defects, and interfaces is important to help provide the connection between structure and important materials’ properties. Modern scanning transmission electron microscopy (STEM) techniques now allow for atomic resolution STEM images to have down to sub-picometer precision in locating positions of atoms, but these high-precision techniques generally require large electron doses, making them less useful for beam-sensitive materials. Here, we show that 1- to 2-pm image precision is possible by non-rigidly registering and averaging a high-angle dark field image series of a 5- to 6-nm Au nanoparticle even though a very coarsely sampled image and decreased exposure time was used to minimize the electron dose. These imaging conditions minimize the damage to the nanoparticle and capture the whole nanoparticle in the same image. The high-precision STEM image reveals bond length contraction around the entire nanoparticle surface, and no bond length variation along a twin boundary that separates the nanoparticle into two grains. Surface atoms at the edges and corners exhibit larger bond length contraction than atoms near the center of surface facets.

确定材料表面、缺陷和界面的精确原子结构对于帮助提供结构和重要材料性能之间的联系是很重要的。现代扫描透射电子显微镜(STEM)技术现在允许原子分辨率STEM图像在定位原子位置时具有低至亚皮米的精度,但这些高精度技术通常需要大的电子剂量,这使得它们对光束敏感的材料不太有用。在这里,我们表明,即使使用非常粗糙的采样图像和减少曝光时间来最小化电子剂量,通过非刚性配准和平均5至6纳米Au纳米颗粒的高角度暗场图像系列,也可以实现1至2 pm的图像精度。这些成像条件最大限度地减少了对纳米颗粒的损伤,并在同一图像中捕获了整个纳米颗粒。高精度的STEM图像显示,整个纳米颗粒表面的键长收缩,而将纳米颗粒分成两个颗粒的孪晶界上的键长没有变化。边缘和角落的表面原子比表面切面中心的原子表现出更大的键长收缩。
{"title":"High-precision scanning transmission electron microscopy at coarse pixel sampling for reduced electron dose","authors":"Andrew B Yankovich,&nbsp;Benjamin Berkels,&nbsp;Wolfgang Dahmen,&nbsp;Peter Binev,&nbsp;Paul M Voyles","doi":"10.1186/s40679-015-0003-9","DOIUrl":"https://doi.org/10.1186/s40679-015-0003-9","url":null,"abstract":"<p>Determining the precise atomic structure of materials’ surfaces, defects, and interfaces is important to help provide the connection between structure and important materials’ properties. Modern scanning transmission electron microscopy (STEM) techniques now allow for atomic resolution STEM images to have down to sub-picometer precision in locating positions of atoms, but these high-precision techniques generally require large electron doses, making them less useful for beam-sensitive materials. Here, we show that 1- to 2-pm image precision is possible by non-rigidly registering and averaging a high-angle dark field image series of a 5- to 6-nm Au nanoparticle even though a very coarsely sampled image and decreased exposure time was used to minimize the electron dose. These imaging conditions minimize the damage to the nanoparticle and capture the whole nanoparticle in the same image. The high-precision STEM image reveals bond length contraction around the entire nanoparticle surface, and no bond length variation along a twin boundary that separates the nanoparticle into two grains. Surface atoms at the edges and corners exhibit larger bond length contraction than atoms near the center of surface facets.</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-015-0003-9","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"4977861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Using molecular dynamics to quantify the electrical double layer and examine the potential for its direct observation in the in-situ TEM 利用分子动力学方法对双电层进行了定量分析,并对其在原位透射电镜中直接观察的潜力进行了研究
IF 3.56 Q1 Medicine Pub Date : 2015-03-25 DOI: 10.1186/s40679-014-0002-2
David A Welch, B Layla Mehdi, Hannah J Hatchell, Roland Faller, James E Evans, Nigel D Browning

Understanding the fundamental processes taking place at the electrode-electrolyte interface in batteries will play a key role in the development of next generation energy storage technologies. One of the most fundamental aspects of the electrode-electrolyte interface is the electrical double layer (EDL). Given the recent development of high spatial resolution in-situ electrochemical fluid cells for scanning transmission electron microscopy (STEM), there now exists the possibility that we can directly observe the formation and dynamics of the EDL. In this paper we predict electrolyte structure within the EDL using classical models and atomistic Molecular Dynamics (MD) simulations. Classical models are found to greatly differ from MD in predicted concentration profiles. It is thus suggested that MD must be used in order to accurately predict STEM images of the electrode-electrolyte interface. Using MD and image simulation together for a high contrast electrolyte (the high atomic number CsCl electrolyte), it is determined that, for a smooth interface, concentration profiles within the EDL should be visible experimentally. When normal experimental parameters such as rough interfaces and low-Z electrolytes (like those used in Li-ion batteries) are considered, observation of the EDL appears to be more difficult.

了解电池中电极-电解质界面发生的基本过程将在下一代储能技术的发展中发挥关键作用。电极-电解质界面最基本的方面之一是电双层(EDL)。随着扫描透射电镜(STEM)高空间分辨率原位电化学流体电池的发展,我们有可能直接观察EDL的形成和动力学。本文利用经典模型和原子分子动力学(MD)模拟预测了电解液中的电解质结构。发现经典模型在预测浓度分布方面与MD有很大不同。因此,为了准确预测电极-电解质界面的STEM图像,必须使用MD。将MD和图像模拟结合起来用于高对比度电解质(高原子序数CsCl电解质),确定了对于光滑界面,EDL内的浓度分布应该在实验中可见。当考虑到诸如粗糙界面和低z电解质(如锂离子电池中使用的电解质)等正常实验参数时,EDL的观察似乎更加困难。
{"title":"Using molecular dynamics to quantify the electrical double layer and examine the potential for its direct observation in the in-situ TEM","authors":"David A Welch,&nbsp;B Layla Mehdi,&nbsp;Hannah J Hatchell,&nbsp;Roland Faller,&nbsp;James E Evans,&nbsp;Nigel D Browning","doi":"10.1186/s40679-014-0002-2","DOIUrl":"https://doi.org/10.1186/s40679-014-0002-2","url":null,"abstract":"<p>Understanding the fundamental processes taking place at the electrode-electrolyte interface in batteries will play a key role in the development of next generation energy storage technologies. One of the most fundamental aspects of the electrode-electrolyte interface is the electrical double layer (EDL). Given the recent development of high spatial resolution <i>in</i>-<i>situ</i> electrochemical fluid cells for scanning transmission electron microscopy (STEM), there now exists the possibility that we can directly observe the formation and dynamics of the EDL. In this paper we predict electrolyte structure within the EDL using classical models and atomistic Molecular Dynamics (MD) simulations. Classical models are found to greatly differ from MD in predicted concentration profiles. It is thus suggested that MD must be used in order to accurately predict STEM images of the electrode-electrolyte interface. Using MD and image simulation together for a high contrast electrolyte (the high atomic number CsCl electrolyte), it is determined that, for a smooth interface, concentration profiles within the EDL should be visible experimentally. When normal experimental parameters such as rough interfaces and low-Z electrolytes (like those used in Li-ion batteries) are considered, observation of the EDL appears to be more difficult.</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-014-0002-2","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"4977863","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 39
Outrun radiation damage with electrons? 用电子逃离辐射伤害?
IF 3.56 Q1 Medicine Pub Date : 2015-03-25 DOI: 10.1186/s40679-014-0001-3
Ray F Egerton

The diffract-before-destroy method, using 50- to 100-fs x-ray pulses from a free-electron laser, was designed to determine the three-dimensional structure of biological macromolecules in close to their natural state. Here we explore the possibility of using short electron pulses for the same purpose and the related question of whether radiation damage can be outrun with electrons. Major problems include Coulomb repulsion within the incident beam and the need for high lateral coherence, difficulties that are discussed in terms of existing and future electron sources. Using longer pulses of electrons appears to make the attainment of near-atomic resolution more feasible, at least for nanocrystalline particles, whereas obtaining this information from single-molecule particles in an aqueous environment seems a more distant goal. We also consider the possibility of serial crystallography using a liquid jet injector with a continuous electron beam in a transmission electron microscope (TEM).

破坏前衍射法使用来自自由电子激光器的50至100 fs x射线脉冲,旨在确定接近其自然状态的生物大分子的三维结构。在这里,我们探讨了使用短电子脉冲的可能性,以达到同样的目的,并探讨了辐射损伤是否可以用电子来逃逸的相关问题。主要问题包括入射光束中的库仑斥力和对高横向相干性的需要,这些困难在现有和未来的电子源方面进行了讨论。使用更长的电子脉冲似乎使获得近原子分辨率更可行,至少对纳米晶体粒子来说是这样,而从水环境中的单分子粒子中获得这一信息似乎是一个更遥远的目标。我们还考虑了在透射电子显微镜(TEM)中使用连续电子束的液体喷射喷射器进行连续晶体学的可能性。
{"title":"Outrun radiation damage with electrons?","authors":"Ray F Egerton","doi":"10.1186/s40679-014-0001-3","DOIUrl":"https://doi.org/10.1186/s40679-014-0001-3","url":null,"abstract":"<p>The diffract-before-destroy method, using 50- to 100-fs x-ray pulses from a free-electron laser, was designed to determine the three-dimensional structure of biological macromolecules in close to their natural state. Here we explore the possibility of using short electron pulses for the same purpose and the related question of whether radiation damage can be outrun with electrons. Major problems include Coulomb repulsion within the incident beam and the need for high lateral coherence, difficulties that are discussed in terms of existing and future electron sources. Using longer pulses of electrons appears to make the attainment of near-atomic resolution more feasible, at least for nanocrystalline particles, whereas obtaining this information from single-molecule particles in an aqueous environment seems a more distant goal. We also consider the possibility of serial crystallography using a liquid jet injector with a continuous electron beam in a transmission electron microscope (TEM).</p>","PeriodicalId":460,"journal":{"name":"Advanced Structural and Chemical Imaging","volume":null,"pages":null},"PeriodicalIF":3.56,"publicationDate":"2015-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1186/s40679-014-0001-3","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"5354035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 39
期刊
Advanced Structural and Chemical Imaging
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1