Erik Genthe , Sean Miletic , Indira Tekkali , Rory Hennell James , Thomas C. Marlovits , Philipp Heuser
{"title":"PickYOLO:用于低温电子层析图注释的快速深度学习粒子检测器","authors":"Erik Genthe , Sean Miletic , Indira Tekkali , Rory Hennell James , Thomas C. Marlovits , Philipp Heuser","doi":"10.1016/j.jsb.2023.107990","DOIUrl":null,"url":null,"abstract":"<div><p>Particle localization (picking) in digital tomograms is a laborious and time-intensive step in cryogenic electron tomography (cryoET) analysis often requiring considerable user involvement, thus becoming a bottleneck for automated cryoET subtomogram averaging (STA) pipelines. In this paper, we introduce a deep learning framework called PickYOLO to tackle this problem. PickYOLO is a super-fast, universal particle detector based on the deep-learning real-time object recognition system YOLO (You Only Look Once), and tested on single particles, filamentous structures, and membrane-embedded particles. After training with the centre coordinates of a few hundred representative particles, the network automatically detects additional particles with high yield and reliability at a rate of 0.24–3.75 s per tomogram. PickYOLO can automatically detect number of particles comparable to those manually selected by experienced microscopists. This makes PickYOLO a valuable tool to substantially reduce the time and manual effort needed to analyse cryoET data for STA, greatly aiding in high-resolution cryoET structure determination.</p></div>","PeriodicalId":17074,"journal":{"name":"Journal of structural biology","volume":null,"pages":null},"PeriodicalIF":3.0000,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"PickYOLO: Fast deep learning particle detector for annotation of cryo electron tomograms\",\"authors\":\"Erik Genthe , Sean Miletic , Indira Tekkali , Rory Hennell James , Thomas C. Marlovits , Philipp Heuser\",\"doi\":\"10.1016/j.jsb.2023.107990\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Particle localization (picking) in digital tomograms is a laborious and time-intensive step in cryogenic electron tomography (cryoET) analysis often requiring considerable user involvement, thus becoming a bottleneck for automated cryoET subtomogram averaging (STA) pipelines. In this paper, we introduce a deep learning framework called PickYOLO to tackle this problem. PickYOLO is a super-fast, universal particle detector based on the deep-learning real-time object recognition system YOLO (You Only Look Once), and tested on single particles, filamentous structures, and membrane-embedded particles. After training with the centre coordinates of a few hundred representative particles, the network automatically detects additional particles with high yield and reliability at a rate of 0.24–3.75 s per tomogram. PickYOLO can automatically detect number of particles comparable to those manually selected by experienced microscopists. This makes PickYOLO a valuable tool to substantially reduce the time and manual effort needed to analyse cryoET data for STA, greatly aiding in high-resolution cryoET structure determination.</p></div>\",\"PeriodicalId\":17074,\"journal\":{\"name\":\"Journal of structural biology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2023-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of structural biology\",\"FirstCategoryId\":\"99\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1047847723000539\",\"RegionNum\":3,\"RegionCategory\":\"生物学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"BIOCHEMISTRY & MOLECULAR BIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of structural biology","FirstCategoryId":"99","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1047847723000539","RegionNum":3,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"BIOCHEMISTRY & MOLECULAR BIOLOGY","Score":null,"Total":0}
引用次数: 0
摘要
在低温电子断层扫描(cryoET)分析中,数字断层扫描中的粒子定位(拾取)是一个费力且耗时的步骤,通常需要大量用户参与,因此成为自动cryoET亚断层扫描平均(STA)管道的瓶颈。在本文中,我们引入了一个名为PickYOLO的深度学习框架来解决这个问题。PickYOLO是一款基于深度学习实时对象识别系统YOLO(You Only Look Once)的超快速通用粒子检测器,在单个粒子、丝状结构和膜嵌入粒子上进行了测试。在使用几百个代表性粒子的中心坐标进行训练后,该网络以0.24–3.75秒/断层图像的速率,以高产量和高可靠性自动检测额外的粒子。PickYOLO可以自动检测与经验丰富的显微镜学家手动选择的粒子数量相当的粒子数量。这使得PickYOLO成为一种有价值的工具,可以大大减少分析STA冷冻ET数据所需的时间和手动工作量,大大有助于高分辨率冷冻ET结构的确定。
PickYOLO: Fast deep learning particle detector for annotation of cryo electron tomograms
Particle localization (picking) in digital tomograms is a laborious and time-intensive step in cryogenic electron tomography (cryoET) analysis often requiring considerable user involvement, thus becoming a bottleneck for automated cryoET subtomogram averaging (STA) pipelines. In this paper, we introduce a deep learning framework called PickYOLO to tackle this problem. PickYOLO is a super-fast, universal particle detector based on the deep-learning real-time object recognition system YOLO (You Only Look Once), and tested on single particles, filamentous structures, and membrane-embedded particles. After training with the centre coordinates of a few hundred representative particles, the network automatically detects additional particles with high yield and reliability at a rate of 0.24–3.75 s per tomogram. PickYOLO can automatically detect number of particles comparable to those manually selected by experienced microscopists. This makes PickYOLO a valuable tool to substantially reduce the time and manual effort needed to analyse cryoET data for STA, greatly aiding in high-resolution cryoET structure determination.
期刊介绍:
Journal of Structural Biology (JSB) has an open access mirror journal, the Journal of Structural Biology: X (JSBX), sharing the same aims and scope, editorial team, submission system and rigorous peer review. Since both journals share the same editorial system, you may submit your manuscript via either journal homepage. You will be prompted during submission (and revision) to choose in which to publish your article. The editors and reviewers are not aware of the choice you made until the article has been published online. JSB and JSBX publish papers dealing with the structural analysis of living material at every level of organization by all methods that lead to an understanding of biological function in terms of molecular and supermolecular structure.
Techniques covered include:
• Light microscopy including confocal microscopy
• All types of electron microscopy
• X-ray diffraction
• Nuclear magnetic resonance
• Scanning force microscopy, scanning probe microscopy, and tunneling microscopy
• Digital image processing
• Computational insights into structure