首页 > 最新文献

medRxiv - Radiology and Imaging最新文献

英文 中文
Diagnostic Accuracy of Vision-Language Models on Japanese Diagnostic Radiology, Nuclear Medicine, and Interventional Radiology Specialty Board Examinations 日本放射诊断学、核医学和介入放射学专业委员会考试中视觉语言模型的诊断准确性
Pub Date : 2024-05-31 DOI: 10.1101/2024.05.31.24308072
Tatsushi Oura, Hiroyuki Tatekawa, Daisuke Horiuchi, Shu Matsushita, Hirotaka Takita, Natsuko Atsukawa, Yasuhito Mitsuyama, Atsushi Yoshida, Kazuki Murai, Rikako Tanaka, Taro Shimono, Akira Yamamoto, Yukio Miki, Daiju Ueda
Purpose The performance of vision-language models (VLMs) with image interpretation capabilities, such as GPT-4 omni (GPT-4o), GPT-4 vision (GPT-4V), and Claude-3, has not been compared and remains unexplored in specialized radiological fields, including nuclear medicine and interventional radiology. This study aimed to evaluate and compare the diagnostic accuracy of various VLMs, including GPT-4 + GPT-4V, GPT-4o, Claude-3 Sonnet, and Claude-3 Opus, using Japanese diagnostic radiology, nuclear medicine, and interventional radiology (JDR, JNM, and JIR, respectively) board certification tests.
目的 具有图像解读功能的视觉语言模型(VLM),如 GPT-4 omni(GPT-4o)、GPT-4 vision(GPT-4V)和 Claude-3 的性能尚未进行过比较,在核医学和介入放射学等专业放射学领域也尚未进行过探索。本研究旨在使用日本放射诊断学、核医学和介入放射学(分别为 JDR、JNM 和 JIR)委员会认证测试,评估和比较各种 VLM(包括 GPT-4 + GPT-4V、GPT-4o、Claude-3 Sonnet 和 Claude-3 Opus)的诊断准确性。
{"title":"Diagnostic Accuracy of Vision-Language Models on Japanese Diagnostic Radiology, Nuclear Medicine, and Interventional Radiology Specialty Board Examinations","authors":"Tatsushi Oura, Hiroyuki Tatekawa, Daisuke Horiuchi, Shu Matsushita, Hirotaka Takita, Natsuko Atsukawa, Yasuhito Mitsuyama, Atsushi Yoshida, Kazuki Murai, Rikako Tanaka, Taro Shimono, Akira Yamamoto, Yukio Miki, Daiju Ueda","doi":"10.1101/2024.05.31.24308072","DOIUrl":"https://doi.org/10.1101/2024.05.31.24308072","url":null,"abstract":"<strong>Purpose</strong> The performance of vision-language models (VLMs) with image interpretation capabilities, such as GPT-4 omni (GPT-4o), GPT-4 vision (GPT-4V), and Claude-3, has not been compared and remains unexplored in specialized radiological fields, including nuclear medicine and interventional radiology. This study aimed to evaluate and compare the diagnostic accuracy of various VLMs, including GPT-4 + GPT-4V, GPT-4o, Claude-3 Sonnet, and Claude-3 Opus, using Japanese diagnostic radiology, nuclear medicine, and interventional radiology (JDR, JNM, and JIR, respectively) board certification tests.","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"8 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141253548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing the Diagnostic Utility of ASL Imaging in Temporal Lobe Epilepsy through FlowGAN: An ASL to PET Image Translation Framework 通过FlowGAN:ASL到PET图像转换框架提高颞叶癫痫的ASL成像诊断效用
Pub Date : 2024-05-30 DOI: 10.1101/2024.05.28.24308027
Alfredo Lucas, Chetan Vadali, Sofia Mouchtaris, T. Campbell Arnold, James J Gugger, Catherine V. Kulick-Soper, Mariam Josyula, Nina Petillo, Sandhitsu Das, Jacob Dubroff, John A. Detre, Joel M. Stein, Kathryn A. Davis
Background and Significance: Positron Emission Tomography (PET) using fluorodeoxyglucose (FDG-PET) is a standard imaging modality for detecting areas of hypometabolism associated with the seizure onset zone (SOZ) in temporal lobe epilepsy (TLE). However, FDG-PET is costly and involves the use of a radioactive tracer. Arterial Spin Labeling (ASL) offers an MRI-based quantification of cerebral blood flow (CBF) that could also help localize the SOZ, but its performance in doing so, relative to FDG-PET, is limited. In this study, we seek to improve ASL's diagnostic performance by developing a deep learning framework for synthesizing FDG-PET-like images from ASL and structural MRI inputs. Methods: We included 68 epilepsy patients, out of which 36 had well lateralized TLE. We compared the coupling between FDG-PET and ASL CBF values in different brain regions, as well as the asymmetry of these values across the brain. We additionally assessed each modality's ability to lateralize the SOZ across brain regions. Using our paired PET-ASL data, we developed FlowGAN, a generative adversarial neural network (GAN) that synthesizes PET-like images from ASL and T1-weighted MRI inputs. We tested our synthetic PET images against the actual PET images of subjects to assess their ability to reproduce clinically meaningful hypometabolism and asymmetries in TLE. Results: We found variable coupling between PET and ASL CBF values across brain regions. PET and ASL had high coupling in neocortical temporal and frontal brain regions (Spearman's r > 0.30, p < 0.05) but low coupling in mesial temporal structures (Spearman's r < 0.30, p > 0.05). Both whole brain PET and ASL CBF asymmetry values provided good separability between left and right TLE subjects, but PET (AUC = 0.96, 95% CI: [0.88, 1.00]) outperformed ASL (AUC = 0.81; 95% CI: [0.65, 0.96]). FlowGAN-generated images demonstrated high structural similarity to actual PET images (SSIM = 0.85). Globally, asymmetry values were better correlated between synthetic PET and original PET than between ASL CBF and original PET, with a mean correlation increase of 0.15 (95% CI: [0.07, 0.24], p<0.001, Cohen's d = 0.91). Furthermore, regions that had poor ASL-PET correlation (e.g. mesial temporal structures) showed the greatest improvement with synthetic PET images. Conclusions: FlowGAN improves ASL's diagnostic performance, generating synthetic PET images that closely mimic actual FDG-PET in depicting hypometabolism associated with TLE. This approach could improve non-invasive SOZ localization, offering a promising tool for epilepsy presurgical assessment. It potentially broadens the applicability of ASL in clinical practice and could reduce reliance on FDG-PET for epilepsy and other neurological disorders.
背景和意义:使用氟脱氧葡萄糖的正电子发射断层扫描(PET)(FDG-PET)是检测颞叶癫痫(TLE)发作起始区(SOZ)相关代谢低下区域的标准成像模式。然而,FDG-PET 费用昂贵,而且需要使用放射性示踪剂。动脉自旋标记(ASL)提供了一种基于核磁共振成像的脑血流(CBF)量化方法,也能帮助定位 SOZ,但相对于 FDG-PET 而言,ASL 的性能有限。在本研究中,我们试图通过开发一种深度学习框架,从 ASL 和结构 MRI 输入中合成类似 FDG-PET 的图像,从而提高 ASL 的诊断性能。研究方法我们纳入了 68 名癫痫患者,其中 36 人患有侧位性良好的 TLE。我们比较了不同脑区的 FDG-PET 和 ASL CBF 值之间的耦合,以及这些值在整个大脑中的不对称性。此外,我们还评估了每种模式在不同脑区侧化 SOZ 的能力。利用成对的 PET-ASL 数据,我们开发了一种生成对抗神经网络 (GAN)--FlowGAN,它能根据 ASL 和 T1 加权 MRI 输入合成类似 PET 的图像。我们将合成的 PET 图像与受试者的实际 PET 图像进行了对比测试,以评估其再现临床上有意义的 TLE 低代谢和不对称性的能力。结果:我们发现 PET 和 ASL CBF 值在不同脑区的耦合度各不相同。PET 和 ASL 在新皮层颞叶和额叶脑区的耦合度较高(Spearman's r > 0.30, p <0.05),但在中颞叶结构的耦合度较低(Spearman's r < 0.30, p >0.05)。全脑 PET 和 ASL CBF 不对称值都能很好地区分左右 TLE 受试者,但 PET(AUC = 0.96,95% CI:[0.88, 1.00])优于 ASL(AUC = 0.81;95% CI:[0.65, 0.96])。FlowGAN 生成的图像与实际 PET 图像具有很高的结构相似性(SSIM = 0.85)。总体而言,合成 PET 与原始 PET 之间的不对称值相关性要好于 ASL CBF 与原始 PET 之间的不对称值相关性,平均相关性增加了 0.15(95% CI:[0.07, 0.24],p<0.001,Cohen's d = 0.91)。此外,ASL-PET 相关性较差的区域(如颞中叶结构)在使用合成 PET 图像后改善最大。结论:FlowGANFlowGAN提高了ASL的诊断性能,生成的合成PET图像与实际的FDG-PET图像非常相似,能够描述与TLE相关的代谢低下。这种方法可以改善非侵入性 SOZ 定位,为癫痫术前评估提供了一种前景广阔的工具。它有可能拓宽 ASL 在临床实践中的应用范围,减少癫痫和其他神经系统疾病对 FDG-PET 的依赖。
{"title":"Enhancing the Diagnostic Utility of ASL Imaging in Temporal Lobe Epilepsy through FlowGAN: An ASL to PET Image Translation Framework","authors":"Alfredo Lucas, Chetan Vadali, Sofia Mouchtaris, T. Campbell Arnold, James J Gugger, Catherine V. Kulick-Soper, Mariam Josyula, Nina Petillo, Sandhitsu Das, Jacob Dubroff, John A. Detre, Joel M. Stein, Kathryn A. Davis","doi":"10.1101/2024.05.28.24308027","DOIUrl":"https://doi.org/10.1101/2024.05.28.24308027","url":null,"abstract":"Background and Significance: Positron Emission Tomography (PET) using fluorodeoxyglucose (FDG-PET) is a standard imaging modality for detecting areas of hypometabolism associated with the seizure onset zone (SOZ) in temporal lobe epilepsy (TLE). However, FDG-PET is costly and involves the use of a radioactive tracer. Arterial Spin Labeling (ASL) offers an MRI-based quantification of cerebral blood flow (CBF) that could also help localize the SOZ, but its performance in doing so, relative to FDG-PET, is limited. In this study, we seek to improve ASL's diagnostic performance by developing a deep learning framework for synthesizing FDG-PET-like images from ASL and structural MRI inputs. Methods: We included 68 epilepsy patients, out of which 36 had well lateralized TLE. We compared the coupling between FDG-PET and ASL CBF values in different brain regions, as well as the asymmetry of these values across the brain. We additionally assessed each modality's ability to lateralize the SOZ across brain regions. Using our paired PET-ASL data, we developed FlowGAN, a generative adversarial neural network (GAN) that synthesizes PET-like images from ASL and T1-weighted MRI inputs. We tested our synthetic PET images against the actual PET images of subjects to assess their ability to reproduce clinically meaningful hypometabolism and asymmetries in TLE. Results: We found variable coupling between PET and ASL CBF values across brain regions. PET and ASL had high coupling in neocortical temporal and frontal brain regions (Spearman's r &gt; 0.30, p &lt; 0.05) but low coupling in mesial temporal structures (Spearman's r &lt; 0.30, p &gt; 0.05). Both whole brain PET and ASL CBF asymmetry values provided good separability between left and right TLE subjects, but PET (AUC = 0.96, 95% CI: [0.88, 1.00]) outperformed ASL (AUC = 0.81; 95% CI: [0.65, 0.96]). FlowGAN-generated images demonstrated high structural similarity to actual PET images (SSIM = 0.85). Globally, asymmetry values were better correlated between synthetic PET and original PET than between ASL CBF and original PET, with a mean correlation increase of 0.15 (95% CI: [0.07, 0.24], p&lt;0.001, Cohen's d = 0.91). Furthermore, regions that had poor ASL-PET correlation (e.g. mesial temporal structures) showed the greatest improvement with synthetic PET images. Conclusions: FlowGAN improves ASL's diagnostic performance, generating synthetic PET images that closely mimic actual FDG-PET in depicting hypometabolism associated with TLE. This approach could improve non-invasive SOZ localization, offering a promising tool for epilepsy presurgical assessment. It potentially broadens the applicability of ASL in clinical practice and could reduce reliance on FDG-PET for epilepsy and other neurological disorders.","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"118 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141193099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Accuracy of Combined Deep Learning Algorithms in Detecting Spontaneous Intracranial Hemorrhage on Emergent Head CT Scans 组合深度学习算法在急诊头部 CT 扫描中检测自发性颅内出血的准确性
Pub Date : 2024-05-29 DOI: 10.1101/2024.05.28.24308084
Takala Juuso, Peura Heikki, Riku Pirinen, Väätäinen Katri, Sergei Terjajev, Ziyuan Lin, Rahul Raj, Korja Miikka
Background Spontaneous intracranial hemorrhages are life-threatening conditions that require fast and accurate diagnosis. We hypothesized that deep learning (DL) could be utilized to detect these hemorrhages with a high accuracy.
背景自发性颅内出血是一种危及生命的疾病,需要快速准确的诊断。我们假设可以利用深度学习(DL)来高精度地检测这些出血。
{"title":"Accuracy of Combined Deep Learning Algorithms in Detecting Spontaneous Intracranial Hemorrhage on Emergent Head CT Scans","authors":"Takala Juuso, Peura Heikki, Riku Pirinen, Väätäinen Katri, Sergei Terjajev, Ziyuan Lin, Rahul Raj, Korja Miikka","doi":"10.1101/2024.05.28.24308084","DOIUrl":"https://doi.org/10.1101/2024.05.28.24308084","url":null,"abstract":"<strong>Background</strong> Spontaneous intracranial hemorrhages are life-threatening conditions that require fast and accurate diagnosis. We hypothesized that deep learning (DL) could be utilized to detect these hemorrhages with a high accuracy.","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"61 8 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141193180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A surgery-informed precision approach to determining brain targets for real-time fMRI neurofeedback modulation in chronic pain 以手术为依据的精确方法确定大脑目标,用于对慢性疼痛进行实时 fMRI 神经反馈调节
Pub Date : 2024-05-27 DOI: 10.1101/2024.05.24.24307873
Dan Liu, Yiqi Mi, Menghan Li, Anna Nigri, Marina Grisoli, Keith M Kendrick, Benjamin Becker, Stefania Ferraro
Objective Despite the promising results of neurofeedback with real-time functional magnetic resonance imaging (rt-fMRI-NF) in the treatment of various psychiatric and neurological disorders, few studies have investigated its effects in acute and chronic pain and with mixed results. The lack of clear neuromodulation targets, rooted in the still poorly understood neurophysiopathology of chronic pain, has probably contributed to these inconsistent findings. In contrast, functional neurosurgery (funcSurg) approaches targeting specific brain regions have been shown to reduce pain in a considerable number of patients with chronic pain, however, their invasiveness limits their use to patients in critical situations. In this work, we sought to redefine, in an unbiased manner, rt-fMRI-NF future targets informed by the long tradition of funcSurg approaches.
尽管神经反馈与实时功能磁共振成像(rt-fMRI-NF)在治疗各种精神和神经疾病方面取得了可喜的成果,但很少有研究对其在急性和慢性疼痛方面的效果进行调查,且结果不一。由于人们对慢性疼痛的神经生理病理仍知之甚少,因此缺乏明确的神经调控目标,这可能是导致研究结果不一致的原因之一。与此相反,针对特定脑区的功能神经外科(funcSurg)方法已被证明能减轻相当多慢性疼痛患者的疼痛,但其侵入性限制了其在危急情况下对患者的使用。在这项工作中,我们试图以无偏见的方式重新定义 rt-fMRI-NF 的未来目标,并借鉴功能神经外科方法的悠久传统。
{"title":"A surgery-informed precision approach to determining brain targets for real-time fMRI neurofeedback modulation in chronic pain","authors":"Dan Liu, Yiqi Mi, Menghan Li, Anna Nigri, Marina Grisoli, Keith M Kendrick, Benjamin Becker, Stefania Ferraro","doi":"10.1101/2024.05.24.24307873","DOIUrl":"https://doi.org/10.1101/2024.05.24.24307873","url":null,"abstract":"<strong>Objective</strong> Despite the promising results of neurofeedback with real-time functional magnetic resonance imaging (rt-fMRI-NF) in the treatment of various psychiatric and neurological disorders, few studies have investigated its effects in acute and chronic pain and with mixed results. The lack of clear neuromodulation targets, rooted in the still poorly understood neurophysiopathology of chronic pain, has probably contributed to these inconsistent findings. In contrast, functional neurosurgery (funcSurg) approaches targeting specific brain regions have been shown to reduce pain in a considerable number of patients with chronic pain, however, their invasiveness limits their use to patients in critical situations. In this work, we sought to redefine, in an unbiased manner, rt-fMRI-NF future targets informed by the long tradition of funcSurg approaches.","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"7 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141165748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Diagnostic Performances of GPT-4o, Claude 3 Opus, and Gemini 1.5 Pro in “Diagnosis Please” Cases GPT-4o、Claude 3 Opus 和 Gemini 1.5 Pro 在 "请诊断 "病例中的诊断性能
Pub Date : 2024-05-27 DOI: 10.1101/2024.05.26.24307915
Yuki Sonoda, Ryo Kurokawa, Yuta Nakamura, Jun Kanzawa, Mariko Kurokawa, Yuji Ohizumi, Wataru Gonoi, Osamu Abe
Backgrounds Large language models (LLMs) are rapidly advancing and demonstrating high performance in understanding textual information, suggesting potential applications in interpreting patient histories and documented imaging findings. LLMs are advancing rapidly and an improvement in their diagnostic ability is expected. Furthermore, there has been a lack of comprehensive comparisons between LLMs from various manufacturers.
背景大语言模型(LLMs)发展迅速,在理解文本信息方面表现出很高的性能,这表明它有可能应用于解释病人病史和记录的成像结果。LLMs 发展迅速,其诊断能力有望得到提高。此外,目前还缺乏对不同制造商生产的 LLM 进行全面的比较。
{"title":"Diagnostic Performances of GPT-4o, Claude 3 Opus, and Gemini 1.5 Pro in “Diagnosis Please” Cases","authors":"Yuki Sonoda, Ryo Kurokawa, Yuta Nakamura, Jun Kanzawa, Mariko Kurokawa, Yuji Ohizumi, Wataru Gonoi, Osamu Abe","doi":"10.1101/2024.05.26.24307915","DOIUrl":"https://doi.org/10.1101/2024.05.26.24307915","url":null,"abstract":"<strong>Backgrounds</strong> Large language models (LLMs) are rapidly advancing and demonstrating high performance in understanding textual information, suggesting potential applications in interpreting patient histories and documented imaging findings. LLMs are advancing rapidly and an improvement in their diagnostic ability is expected. Furthermore, there has been a lack of comprehensive comparisons between LLMs from various manufacturers.","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"20 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141165746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generating intermediate slices with U-nets in craniofacial CT images 在颅面部 CT 图像中使用 U 型网生成中间切片
Pub Date : 2024-05-09 DOI: 10.1101/2024.05.08.24307089
Soh Nishimoto, Kenichiro Kawai, Koyo Nakajima, Hisako Ishise, Masao Kakibuchi
Aim The Computer Tomography (CT) imaging equipment varies across facilities, leading to inconsistent image conditions. This poses challenges for deep learning analysis using collected CT images. To standardize the shape of the matrix, the creation of intermediate slice images with the same width is necessary. This study aimed to generate inter-slice images from two existing CT images.
目的 不同设施的计算机断层扫描(CT)成像设备各不相同,导致图像条件不一致。这给利用收集到的 CT 图像进行深度学习分析带来了挑战。为了使矩阵的形状标准化,有必要创建具有相同宽度的中间切片图像。本研究旨在从两张现有的 CT 图像中生成中间切片图像。
{"title":"Generating intermediate slices with U-nets in craniofacial CT images","authors":"Soh Nishimoto, Kenichiro Kawai, Koyo Nakajima, Hisako Ishise, Masao Kakibuchi","doi":"10.1101/2024.05.08.24307089","DOIUrl":"https://doi.org/10.1101/2024.05.08.24307089","url":null,"abstract":"<strong>Aim</strong> The Computer Tomography (CT) imaging equipment varies across facilities, leading to inconsistent image conditions. This poses challenges for deep learning analysis using collected CT images. To standardize the shape of the matrix, the creation of intermediate slice images with the same width is necessary. This study aimed to generate inter-slice images from two existing CT images.","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140935931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automatic Lymph Nodes Segmentation and Histological Status Classification on Computed Tomography Scans Using Convolutional Neural Network 利用卷积神经网络对计算机断层扫描图像进行淋巴结自动分割和组织学状态分类
Pub Date : 2024-05-09 DOI: 10.1101/2024.05.07.24304092
Alexey Shevtsov, Iaroslav Tominin, Vladislav Tominin, Vsevolod Malevanniy, Yury Esakov, Zurab Tukvadze, Andrey Nefedov, Piotr Yablonskii, Pavel Gavrilov, Vadim Kozlov, Mariya Blokhina, Elena Nalivkina, Victor Gombolevskiy, Yuriy Vasilev, Mariya Dugova, Valeria Chernina, Olga Omelyanskaya, Roman Reshetnikov, Ivan Blokhin, Mikhail Belyaev
Lung cancer is the second most common type of cancer worldwide, making up about 20% of all cancer deaths with less than 10% 5-year survival rate for the very late stage. The recent guidelines for the most common non-small-cell lung cancer (NSCLC) type recommend performing staging based on the 8th edition of TNM classification, where the mediastinal lymph node involvement plays a key role. However, most of the non-invasive methods have a very limited level of sensitivity and are relatively accurate, but invasive methods can be contradicted for some patients. Current advances in Deep Learning show great potential in solving such problems. Still, most of these works focus on the algorithmic side of the problem, not the clinical relevance. Moreover, none of them addressed individual lymph node malignancy classification problem, restricting the indirect analysis of the whole study, and limiting the interpretability of the result without giving an option for cliniciansto validate the result. This work mitigates these gaps, proposing a multi-step algorithm for each visible mediastinal lymph node segmentation and assessing the probability of its involvement in themetastatic process, using the results of histological verification on training. The developed pipelineshows 0.74 ± 0.01 average Recall with 0.53 ± 0.26 object Dice Score for the clinically relevant lymph nodes segmentation task and 0.73 ROC AUC for patient’s N-stage prediction, outperformingtraditional size-based criteria.
肺癌是全球第二大常见癌症,约占癌症死亡总数的 20%,晚期患者的 5 年生存率不到 10%。针对最常见的非小细胞肺癌(NSCLC)类型,最近的指南建议根据第 8 版 TNM 分类法进行分期,其中纵隔淋巴结受累起着关键作用。然而,大多数非侵入性方法的灵敏度非常有限,准确度相对较高,但侵入性方法对某些患者可能会产生矛盾。目前,深度学习技术的进步显示出解决此类问题的巨大潜力。不过,这些研究大多侧重于问题的算法方面,而非临床相关性。此外,它们都没有解决单个淋巴结恶性分类问题,从而限制了对整个研究的间接分析,并限制了结果的可解释性,没有为临床医生提供验证结果的选项。这项工作弥补了这些不足,提出了一种多步骤算法,利用训练中的组织学验证结果,对每个可见纵隔淋巴结进行分割,并评估其参与转移过程的概率。所开发的管道在临床相关淋巴结分割任务中显示出 0.74 ± 0.01 的平均 Recall 值和 0.53 ± 0.26 的对象 Dice Score 值,在患者 N 分期预测中显示出 0.73 的 ROC AUC 值,优于传统的基于大小的标准。
{"title":"Automatic Lymph Nodes Segmentation and Histological Status Classification on Computed Tomography Scans Using Convolutional Neural Network","authors":"Alexey Shevtsov, Iaroslav Tominin, Vladislav Tominin, Vsevolod Malevanniy, Yury Esakov, Zurab Tukvadze, Andrey Nefedov, Piotr Yablonskii, Pavel Gavrilov, Vadim Kozlov, Mariya Blokhina, Elena Nalivkina, Victor Gombolevskiy, Yuriy Vasilev, Mariya Dugova, Valeria Chernina, Olga Omelyanskaya, Roman Reshetnikov, Ivan Blokhin, Mikhail Belyaev","doi":"10.1101/2024.05.07.24304092","DOIUrl":"https://doi.org/10.1101/2024.05.07.24304092","url":null,"abstract":"Lung cancer is the second most common type of cancer worldwide, making up about 20% of all cancer deaths with less than 10% 5-year survival rate for the very late stage. The recent guidelines for the most common non-small-cell lung cancer (NSCLC) type recommend performing staging based on the 8th edition of TNM classification, where the mediastinal lymph node involvement plays a key role. However, most of the non-invasive methods have a very limited level of sensitivity and are relatively accurate, but invasive methods can be contradicted for some patients. Current advances in Deep Learning show great potential in solving such problems. Still, most of these works focus on the algorithmic side of the problem, not the clinical relevance. Moreover, none of them addressed individual lymph node malignancy classification problem, restricting the indirect analysis of the whole study, and limiting the interpretability of the result without giving an option for cliniciansto validate the result. This work mitigates these gaps, proposing a multi-step algorithm for each visible mediastinal lymph node segmentation and assessing the probability of its involvement in themetastatic process, using the results of histological verification on training. The developed pipelineshows 0.74 ± 0.01 average Recall with 0.53 ± 0.26 object Dice Score for the clinically relevant lymph nodes segmentation task and 0.73 ROC AUC for patient’s N-stage prediction, outperformingtraditional size-based criteria.","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"42 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140935782","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
K-means clustering of hyperpolarised 13C-MRI identifies intratumoural perfusion/metabolism mismatch in renal cell carcinoma as best predictor of highest grade 超极化 13C-MRI 的 K-means 聚类确定肾细胞癌的瘤内灌注/代谢错配是最高分级的最佳预测指标
Pub Date : 2024-05-08 DOI: 10.1101/2024.05.06.24306829
Ines Horvat-Menih, Alixander S Khan, Mary A McLean, Joao Duarte, Eva Serrao, Stephan Ursprung, Joshua D Kaggie, Andrew B Gill, Andrew N Priest, Mireia Crispin-Ortuzar, Anne Y Warren, Sarah J Welsh, Thomas J Mitchell, Grant D Stewart, Ferdia A Gallagher
Purpose Conventional renal mass biopsy approaches are inaccurate, potentially leading to undergrading. This study explored using hyperpolarised [1-13C]pyruvate MRI (HP 13C-MRI) to identify the most aggressive areas within the tumour of patients with clear cell renal cell carcinoma (ccRCC).
目的 传统的肾脏肿块活检方法并不准确,有可能导致低估病情。本研究探索使用超极化[1-13C]丙酮酸磁共振成像(HP 13C-MRI)来确定透明细胞肾细胞癌(ccRCC)患者肿瘤内最具侵袭性的区域。
{"title":"K-means clustering of hyperpolarised 13C-MRI identifies intratumoural perfusion/metabolism mismatch in renal cell carcinoma as best predictor of highest grade","authors":"Ines Horvat-Menih, Alixander S Khan, Mary A McLean, Joao Duarte, Eva Serrao, Stephan Ursprung, Joshua D Kaggie, Andrew B Gill, Andrew N Priest, Mireia Crispin-Ortuzar, Anne Y Warren, Sarah J Welsh, Thomas J Mitchell, Grant D Stewart, Ferdia A Gallagher","doi":"10.1101/2024.05.06.24306829","DOIUrl":"https://doi.org/10.1101/2024.05.06.24306829","url":null,"abstract":"<strong>Purpose</strong> Conventional renal mass biopsy approaches are inaccurate, potentially leading to undergrading. This study explored using hyperpolarised [1-<sup>13</sup>C]pyruvate MRI (HP <sup>13</sup>C-MRI) to identify the most aggressive areas within the tumour of patients with clear cell renal cell carcinoma (ccRCC).","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"160 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140935851","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Probing intratumoral metabolic compartmentalisation in fumarate hydratase-deficient renal cancer using clinical hyperpolarised 13C-MRI and mass spectrometry imaging 利用临床超极化 13C-MRI 和质谱成像技术探测富马酸氢化酶缺陷型肾癌的瘤内代谢分区
Pub Date : 2024-05-08 DOI: 10.1101/2024.05.06.24306817
Ines Horvat-Menih, Ruth Casey, James Denholm, Gregory Hamm, Heather Hulme, John Gallon, Alixander S Khan, Joshua Kaggie, Andrew B Gill, Andrew N Priest, Joao A G Duarte, Cissy Yong, Cara Brodie, James Whitworth, Simon T Barry, Richard J A Goodwin, Shubha Anand, Marc Dodd, Katherine Honan, Sarah J Welsh, Anne Y Warren, Tevita Aho, Grant D Stewart, Thomas J Mitchell, Mary A McLean, Ferdia A Gallagher
Background Fumarate hydratase-deficient renal cell carcinoma (FHd-RCC) is a rare and aggressive renal cancer subtype characterised by increased fumarate accumulation and upregulated lactate production. Renal tumours demonstrate significant intratumoral metabolic heterogeneity, which may contribute to treatment failure. Emerging non-invasive metabolic imaging techniques have clinical potential to more accurately phenotype tumour metabolism and its heterogeneity.
背景富马酸氢化酶缺陷型肾细胞癌(FHd-RCC)是一种罕见的侵袭性肾癌亚型,其特点是富马酸蓄积增加和乳酸生成上调。肾肿瘤表现出明显的瘤内代谢异质性,这可能会导致治疗失败。新出现的非侵入性代谢成像技术具有临床潜力,能更准确地对肿瘤代谢及其异质性进行表型。
{"title":"Probing intratumoral metabolic compartmentalisation in fumarate hydratase-deficient renal cancer using clinical hyperpolarised 13C-MRI and mass spectrometry imaging","authors":"Ines Horvat-Menih, Ruth Casey, James Denholm, Gregory Hamm, Heather Hulme, John Gallon, Alixander S Khan, Joshua Kaggie, Andrew B Gill, Andrew N Priest, Joao A G Duarte, Cissy Yong, Cara Brodie, James Whitworth, Simon T Barry, Richard J A Goodwin, Shubha Anand, Marc Dodd, Katherine Honan, Sarah J Welsh, Anne Y Warren, Tevita Aho, Grant D Stewart, Thomas J Mitchell, Mary A McLean, Ferdia A Gallagher","doi":"10.1101/2024.05.06.24306817","DOIUrl":"https://doi.org/10.1101/2024.05.06.24306817","url":null,"abstract":"<strong>Background</strong> Fumarate hydratase-deficient renal cell carcinoma (FHd-RCC) is a rare and aggressive renal cancer subtype characterised by increased fumarate accumulation and upregulated lactate production. Renal tumours demonstrate significant intratumoral metabolic heterogeneity, which may contribute to treatment failure. Emerging non-invasive metabolic imaging techniques have clinical potential to more accurately phenotype tumour metabolism and its heterogeneity.","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"66 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140935776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ShapeMed-Knee: A Dataset and Neural Shape Model Benchmark for Modeling 3D Femurs ShapeMed-Knee:用于三维股骨建模的数据集和神经形状模型基准
Pub Date : 2024-05-07 DOI: 10.1101/2024.05.06.24306965
Anthony A. Gatti, Louis Blankemeier, Dave Van Veen, Brian Hargreaves, Scott L. Delp, Garry E. Gold, Feliks Kogan, Akshay S. Chaudhari
Analyzing anatomic shapes of tissues and organs is pivotal for accurate disease diagnostics and clinical decision-making. One prominent disease that depends on anatomic shape analysis is osteoarthritis, which affects 30 million Americans. To advance osteoarthritis diagnostics and prognostics, we introduce ShapeMed-Knee, a 3D shape dataset with 9,376 high-resolution, medical-imaging-based 3D shapes of both femur bone and cartilage. Besides data, ShapeMed-Knee includes two benchmarks for assessing reconstruction accuracy and five clinical prediction tasks that assess the utility of learned shape representations. Leveraging ShapeMed-Knee, we develop and evaluate a novel hybrid explicit-implicit neural shape model which achieves up to 40% better reconstruction accuracy than a statistical shape model and implicit neural shape model. Our hybrid models achieve state-of-the-art performance for preserving cartilage biomarkers; they’re also the first models to successfully predict localized structural features of osteoarthritis, outperforming shape models and convolutional neural networks applied to raw magnetic resonance images and segmentations. The ShapeMed-Knee dataset provides medical evaluations to reconstruct multiple anatomic surfaces and embed meaningful disease-specific information. ShapeMed-Knee reduces barriers to applying 3D modeling in medicine, and our benchmarks highlight that advancements in 3D modeling can enhance the diagnosis and risk stratification for complex diseases. The dataset, code, and benchmarks will be made freely accessible.
分析组织和器官的解剖形状对于准确诊断疾病和临床决策至关重要。骨关节炎是一种依赖解剖形状分析的常见疾病,影响着 3,000 万美国人。为了推进骨关节炎的诊断和预后,我们推出了 ShapeMed-Knee,这是一个三维形状数据集,包含 9376 个基于医学影像的股骨头和软骨的高分辨率三维形状。除数据外,ShapeMed-Knee 还包括两个用于评估重建准确性的基准和五个用于评估所学形状表征效用的临床预测任务。利用 ShapeMed-Knee,我们开发并评估了一种新颖的显式-隐式混合神经形状模型,其重建准确率比统计形状模型和隐式神经形状模型高出 40%。我们的混合模型在保存软骨生物标志物方面达到了最先进的性能;它们也是首个成功预测骨关节炎局部结构特征的模型,性能优于应用于原始磁共振图像和分割的形状模型和卷积神经网络。ShapeMed-Knee 数据集可提供医学评估,以重建多个解剖表面,并嵌入有意义的特定疾病信息。ShapeMed-Knee 减少了在医学中应用三维建模的障碍,我们的基准突出表明,三维建模的进步可以加强复杂疾病的诊断和风险分层。我们将免费提供数据集、代码和基准。
{"title":"ShapeMed-Knee: A Dataset and Neural Shape Model Benchmark for Modeling 3D Femurs","authors":"Anthony A. Gatti, Louis Blankemeier, Dave Van Veen, Brian Hargreaves, Scott L. Delp, Garry E. Gold, Feliks Kogan, Akshay S. Chaudhari","doi":"10.1101/2024.05.06.24306965","DOIUrl":"https://doi.org/10.1101/2024.05.06.24306965","url":null,"abstract":"Analyzing anatomic shapes of tissues and organs is pivotal for accurate disease diagnostics and clinical decision-making. One prominent disease that depends on anatomic shape analysis is osteoarthritis, which affects 30 million Americans. To advance osteoarthritis diagnostics and prognostics, we introduce <em>ShapeMed-Knee</em>, a 3D shape dataset with 9,376 high-resolution, medical-imaging-based 3D shapes of both femur bone and cartilage. Besides data, ShapeMed-Knee includes two benchmarks for assessing reconstruction accuracy and five clinical prediction tasks that assess the utility of learned shape representations. Leveraging ShapeMed-Knee, we develop and evaluate a novel hybrid explicit-implicit neural shape model which achieves up to 40% better reconstruction accuracy than a statistical shape model and implicit neural shape model. Our hybrid models achieve state-of-the-art performance for preserving cartilage biomarkers; they’re also the first models to successfully predict localized structural features of osteoarthritis, outperforming shape models and convolutional neural networks applied to raw magnetic resonance images and segmentations. The ShapeMed-Knee dataset provides medical evaluations to reconstruct multiple anatomic surfaces and embed meaningful disease-specific information. ShapeMed-Knee reduces barriers to applying 3D modeling in medicine, and our benchmarks highlight that advancements in 3D modeling can enhance the diagnosis and risk stratification for complex diseases. The dataset, code, and benchmarks will be made freely accessible.","PeriodicalId":501358,"journal":{"name":"medRxiv - Radiology and Imaging","volume":"72 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140935777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
medRxiv - Radiology and Imaging
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1