首页 > 最新文献

Zeitschrift fur Medizinische Physik最新文献

英文 中文
A body mass index-based method for “MR-only” abdominal MR-guided adaptive radiotherapy 基于体重指数的 "纯磁共振 "腹部磁共振引导自适应放射治疗方法。
IF 2.4 4区 医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-08-01 DOI: 10.1016/j.zemedi.2022.12.001

Purpose

Dose calculation for MR-guided radiotherapy (MRgRT) at the 0.35 T MR-Linac is currently based on deformation of planning CTs (defCT) acquired for each patient. We present a simple and robust bulk density overwrite synthetic CT (sCT) method for abdominal treatments in order to streamline clinical workflows.

Method

Fifty-six abdominal patient treatment plans were retrospectively evaluated. All patients had been treated at the MR-Linac using MR datasets for treatment planning and plan adaption and defCT for dose calculation. Bulk density CTs (4M-sCT) were generated from MR images with four material compartments (bone, lung, air, soft tissue). The relative electron densities (RED) for bone and lung were extracted from contoured CT structure average REDs. For soft tissue, a correlation between BMI and RED was evaluated. Dose was recalculated on 4M-sCT and compared to dose distributions on defCTs assessing dose differences in the PTV and organs at risk (OAR).

Results

Mean RED of bone was 1.17 ± 0.02, mean RED of lung 0.17 ± 0.05. The correlation between BMI and RED for soft tissue was statistically significant (p < 0.01). PTV dose differences between 4M-sCT and defCT were Dmean: −0.4 ± 1.0%, D1%: −0.3 ± 1.1% and D95%: −0.5 ± 1.0%. OARs showed D2%: −0.3 ± 1.9% and Dmean: −0.1 ± 1.4% differences. Local 3D gamma index pass rates (2%/2mm) between dose calculated using 4M-sCT and defCT were 96.8 ± 2.6% (range 89.9–99.6%).

Conclusion

The presented method for sCT generation enables precise dose calculation for MR-only abdominal MRgRT.

目的:目前,在 0.35 T MR-Linac 上进行磁共振引导放疗 (MRgRT) 的剂量计算基于为每位患者获取的计划 CT(defCT)的变形。我们针对腹部治疗提出了一种简单、稳健的体密度覆盖合成 CT(sCT)方法,以简化临床工作流程:方法:我们对 56 例腹部患者的治疗计划进行了回顾性评估。所有患者均在磁共振Linac接受过治疗,治疗计划和计划调整使用磁共振数据集,剂量计算使用defCT。大体密度 CT(4M-sCT)由四个物质区(骨、肺、空气、软组织)的磁共振图像生成。骨和肺的相对电子密度(RED)是从轮廓 CT 结构平均 RED 中提取的。对于软组织,则评估了 BMI 与 RED 之间的相关性。在 4M-sCT 上重新计算剂量,并与 defCT 上的剂量分布进行比较,评估 PTV 和危险器官 (OAR) 的剂量差异:结果:骨的平均 RED 为 1.17 ± 0.02,肺的平均 RED 为 0.17 ± 0.05。体重指数(BMI)与软组织 RED 之间的相关性具有统计学意义(P 平均值:-0.4 ± 1.0):-0.4 ± 1.0%, D1%:-0.3±1.1%,D95%:-0.5 ± 1.0%.OAR 显示 D2%:-0.3 ± 1.9%,D95%:-0.5 ± 1.0%:-0.3 ± 1.9% 和 Dmean:差异为-0.1 ± 1.4%。使用4M-sCT和defCT计算的剂量之间的局部三维伽马指数通过率(2%/2mm)为96.8 ± 2.6%(范围89.9-99.6%):结论:所介绍的 sCT 生成方法可精确计算仅磁共振腹部 MRgRT 的剂量。
{"title":"A body mass index-based method for “MR-only” abdominal MR-guided adaptive radiotherapy","authors":"","doi":"10.1016/j.zemedi.2022.12.001","DOIUrl":"10.1016/j.zemedi.2022.12.001","url":null,"abstract":"<div><h3>Purpose</h3><p>Dose calculation for MR-guided radiotherapy (MRgRT) at the 0.35 T MR-Linac is currently based on deformation of planning CTs (defCT) acquired for each patient. We present a simple and robust bulk density overwrite synthetic CT (sCT) method for abdominal treatments in order to streamline clinical workflows.</p></div><div><h3>Method</h3><p>Fifty-six abdominal patient treatment plans were retrospectively evaluated. All patients had been treated at the MR-Linac using MR datasets for treatment planning and plan adaption and defCT for dose calculation. Bulk density CTs (4M-sCT) were generated from MR images with four material compartments (bone, lung, air, soft tissue). The relative electron densities (RED) for bone and lung were extracted from contoured CT structure average REDs. For soft tissue, a correlation between BMI and RED was evaluated. Dose was recalculated on 4M-sCT and compared to dose distributions on defCTs assessing dose differences in the PTV and organs at risk (OAR).</p></div><div><h3>Results</h3><p>Mean RED of bone was 1.17 ± 0.02, mean RED of lung 0.17 ± 0.05. The correlation between BMI and RED for soft tissue was statistically significant (p &lt; 0.01). PTV dose differences between 4M-sCT and defCT were D<sub>mean</sub>: −0.4 ± 1.0%, D<sub>1%</sub>: −0.3 ± 1.1% and D<sub>95%</sub>: −0.5 ± 1.0%. OARs showed D<sub>2%</sub>: −0.3 ± 1.9% and D<sub>mean</sub>: −0.1 ± 1.4% differences. Local 3D gamma index pass rates (2%/2mm) between dose calculated using 4M-sCT and defCT were 96.8 ± 2.6% (range 89.9–99.6%).</p></div><div><h3>Conclusion</h3><p>The presented method for sCT generation enables precise dose calculation for MR-only abdominal MRgRT.</p></div>","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388922001349/pdfft?md5=96a02bfed77ffd9d1bc9385391487bd1&pid=1-s2.0-S0939388922001349-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10742581","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Re-evaluation of the prospective risk analysis for artificial-intelligence driven cone beam computed tomography-based online adaptive radiotherapy after one year of clinical experience 基于人工智能驱动的锥形束计算机断层扫描在线自适应放射治疗一年后的前瞻性风险分析再评估。
IF 2.4 4区 医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-08-01 DOI: 10.1016/j.zemedi.2024.05.001

Cone-beam computed tomography (CBCT)-based online adaptation is increasingly being introduced into many clinics. Upon implementation of a new treatment technique, a prospective risk analysis is required and enhances workflow safety. We conducted a risk analysis using Failure Mode and Effects Analysis (FMEA) upon the introduction of an online adaptive treatment programme (Wegener et al., Z Med Phys. 2022).

A prospective risk analysis, lacking in-depth clinical experience with a treatment modality or treatment machine, relies on imagination and estimates of the occurrence of different failure modes. Therefore, we systematically documented all irregularities during the first year of online adaptation, namely all cases in which quality assurance detected undesired states potentially leading to negative consequences. Additionally, the quality of automatic contouring was evaluated. Based on those quantitative data, the risk analysis was updated by an interprofessional team. Furthermore, a hypothetical radiation therapist-only workflow during adaptive sessions was included in the prospective analysis, as opposed to the involvement of an interprofessional team performing each adaptive treatment.

A total of 126 irregularities were recorded during the first year. During that time period, many of the previously anticipated failure modes (almost) occurred, indicating that the initial prospective risk analysis captured relevant failure modes. However, some scenarios were not anticipated, emphasizing the limits of a prospective risk analysis. This underscores the need for regular updates to the risk analysis. The most critical failure modes are presented together with possible mitigation strategies. It was further noted that almost half of the reported irregularities applied to the non-adaptive treatments on this treatment machine, primarily due to a manual plan import step implemented in the institution’s workflow.

基于锥形束计算机断层扫描(CBCT)的在线适应技术正越来越多地被引入许多诊所。在实施新的治疗技术时,需要进行前瞻性风险分析,以提高工作流程的安全性。我们采用失效模式及影响分析法(FMEA)对引入在线自适应治疗方案进行了风险分析(Wegener 等人,Z Med Phys.)前瞻性风险分析由于缺乏对治疗模式或治疗设备的深入临床经验,只能依赖于对不同故障模式发生率的想象和估计。因此,我们系统地记录了第一年在线适应期间的所有异常情况,即质量保证检测到可能导致不良后果的不期望状态的所有案例。此外,我们还对自动轮廓绘制的质量进行了评估。根据这些定量数据,跨专业团队对风险分析进行了更新。此外,在前瞻性分析中还包括了适应性治疗过程中仅由放射治疗师参与的假设工作流程,而不是由跨专业团队参与执行每次适应性治疗。第一年共记录了 126 起违规事件。在此期间,许多之前预计的故障模式(几乎)都发生了,这表明最初的前瞻性风险分析捕捉到了相关的故障模式。然而,有些情况是没有预料到的,这强调了前瞻性风险分析的局限性。这强调了定期更新风险分析的必要性。最关键的失效模式与可能的缓解战略一并列出。我们还注意到,在报告的不规范情况中,几乎有一半适用于该治疗机上的非适应性治疗,这主要是由于该机构的工作流程中实施了手动计划导入步骤。
{"title":"Re-evaluation of the prospective risk analysis for artificial-intelligence driven cone beam computed tomography-based online adaptive radiotherapy after one year of clinical experience","authors":"","doi":"10.1016/j.zemedi.2024.05.001","DOIUrl":"10.1016/j.zemedi.2024.05.001","url":null,"abstract":"<div><p>Cone-beam computed tomography (CBCT)-based online adaptation is increasingly being introduced into many clinics. Upon implementation of a new treatment technique, a prospective risk analysis is required and enhances workflow safety. We conducted a risk analysis using Failure Mode and Effects Analysis (FMEA) upon the introduction of an online adaptive treatment programme (Wegener et al., Z Med Phys. 2022).</p><p>A prospective risk analysis, lacking in-depth clinical experience with a treatment modality or treatment machine, relies on imagination and estimates of the occurrence of different failure modes. Therefore, we systematically documented all irregularities during the first year of online adaptation, namely all cases in which quality assurance detected undesired states potentially leading to negative consequences. Additionally, the quality of automatic contouring was evaluated. Based on those quantitative data, the risk analysis was updated by an interprofessional team. Furthermore, a hypothetical radiation therapist-only workflow during adaptive sessions was included in the prospective analysis, as opposed to the involvement of an interprofessional team performing each adaptive treatment.</p><p>A total of 126 irregularities were recorded during the first year. During that time period, many of the previously anticipated failure modes (almost) occurred, indicating that the initial prospective risk analysis captured relevant failure modes. However, some scenarios were not anticipated, emphasizing the limits of a prospective risk analysis. This underscores the need for regular updates to the risk analysis. The most critical failure modes are presented together with possible mitigation strategies. It was further noted that almost half of the reported irregularities applied to the non-adaptive treatments on this treatment machine, primarily due to a manual plan import step implemented in the institution’s workflow.</p></div>","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388924000497/pdfft?md5=45dc81fc3a80f7dc5d71e12b69c8edca&pid=1-s2.0-S0939388924000497-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141294041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Prospective risk analysis of the online-adaptive artificial intelligence-driven workflow using the Ethos treatment system 对使用 Ethos 治疗系统的在线自适应人工智能驱动工作流程进行前瞻性风险分析。
IF 2.4 4区 医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-08-01 DOI: 10.1016/j.zemedi.2022.11.004

Purpose

The recently introduced Varian Ethos system allows adjusting radiotherapy treatment plans to anatomical changes on a daily basis. The system uses artificial intelligence to speed up the process of creating adapted plans, comes with its own software solutions and requires a substantially different workflow. A detailed analysis of possible risks of the associated workflow is presented.

Methods

A prospective risk analysis of the adaptive workflow with the Ethos system was performed using Failure Modes and Effects Analysis (FMEA). An interprofessional team collected possible adverse events and evaluated their severity as well as their chance of occurrence and detectability. Measures to reduce the risks were discussed.

Results

A total of 122 events were identified, and scored. Within the 20 events with the highest-ranked risks, the following were identified: Challenges due to the stand-alone software solution with very limited connectivity to the existing record and verify software and digital patient file, unfamiliarity with the new software and its limitations and the adaption process relying on results obtained by artificial intelligence. The risk analysis led to the implementation of additional quality assurance measures in the workflow.

Conclusions

The thorough analysis of the risks associated with the new treatment technique was the basis for designing details of the workflow. The analysis also revealed challenges to be addressed by both, the vendor and customers. On the vendor side, this includes improving communication between their different software solutions. On the customer side, this especially includes establishing validation strategies to monitor the results of the black box adaption process making use of artificial intelligence.

目的:最近推出的瓦里安 Ethos 系统可以每天根据解剖结构的变化调整放射治疗计划。该系统利用人工智能来加快制定适应性计划的过程,并配有自己的软件解决方案,所需的工作流程也大不相同。本文对相关工作流程可能存在的风险进行了详细分析:方法:使用故障模式和影响分析(FMEA)对使用 Ethos 系统的适应性工作流程进行了前瞻性风险分析。一个跨专业小组收集了可能发生的不良事件,并评估了其严重程度、发生几率和可探测性。讨论了降低风险的措施:共确定了 122 个事件并进行了评分。在风险最高的 20 个事件中,确定了以下几点:由于独立软件解决方案与现有记录和验证软件以及数字病人档案的连接非常有限而带来的挑战,对新软件及其局限性的不熟悉,以及适应过程依赖于人工智能获得的结果。通过风险分析,在工作流程中实施了额外的质量保证措施:对新治疗技术相关风险的全面分析是设计工作流程细节的基础。分析还揭示了供应商和客户需要应对的挑战。在供应商方面,这包括改善不同软件解决方案之间的沟通。在客户方面,这尤其包括制定验证策略,利用人工智能监控黑盒适应过程的结果。
{"title":"Prospective risk analysis of the online-adaptive artificial intelligence-driven workflow using the Ethos treatment system","authors":"","doi":"10.1016/j.zemedi.2022.11.004","DOIUrl":"10.1016/j.zemedi.2022.11.004","url":null,"abstract":"<div><h3>Purpose</h3><p>The recently introduced Varian Ethos system allows adjusting radiotherapy treatment plans to anatomical changes on a daily basis. The system uses artificial intelligence to speed up the process of creating adapted plans, comes with its own software solutions and requires a substantially different workflow. A detailed analysis of possible risks of the associated workflow is presented.</p></div><div><h3>Methods</h3><p>A prospective risk analysis of the adaptive workflow with the Ethos system was performed using Failure Modes and Effects Analysis (FMEA). An interprofessional team collected possible adverse events and evaluated their severity as well as their chance of occurrence and detectability. Measures to reduce the risks were discussed.</p></div><div><h3>Results</h3><p>A total of 122 events were identified, and scored. Within the 20 events with the highest-ranked risks, the following were identified: Challenges due to the stand-alone software solution with very limited connectivity to the existing record and verify software and digital patient file, unfamiliarity with the new software and its limitations and the adaption process relying on results obtained by artificial intelligence. The risk analysis led to the implementation of additional quality assurance measures in the workflow.</p></div><div><h3>Conclusions</h3><p>The thorough analysis of the risks associated with the new treatment technique was the basis for designing details of the workflow. The analysis also revealed challenges to be addressed by both, the vendor and customers. On the vendor side, this includes improving communication between their different software solutions. On the customer side, this especially includes establishing validation strategies to monitor the results of the black box adaption process making use of artificial intelligence.</p></div>","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388922001210/pdfft?md5=8005a35cd84cb01da2103d84e31bf1aa&pid=1-s2.0-S0939388922001210-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10746123","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Editorial Board + Consulting Editorial Board 编辑委员会 + 咨询编辑委员会
IF 2.4 4区 医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-08-01 DOI: 10.1016/S0939-3889(24)00060-6
{"title":"Editorial Board + Consulting Editorial Board","authors":"","doi":"10.1016/S0939-3889(24)00060-6","DOIUrl":"10.1016/S0939-3889(24)00060-6","url":null,"abstract":"","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388924000606/pdfft?md5=863bfbdd09bc5d7c2602ad7969b53faa&pid=1-s2.0-S0939388924000606-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141991020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting disease-related MRI patterns of multiple sclerosis through GAN-based image editing 通过基于 GAN 的图像编辑预测多发性硬化症的疾病相关 MRI 模式
IF 2 4区 医学 Q1 Medicine Pub Date : 2024-05-01 DOI: 10.1016/j.zemedi.2023.12.001
Daniel Güllmar , Wei-Chan Hsu , Jürgen R. Reichenbach

Introduction

Multiple sclerosis (MS) is a complex neurodegenerative disorder that affects the brain and spinal cord. In this study, we applied a deep learning-based approach using the StyleGAN model to explore patterns related to MS and predict disease progression in magnetic resonance images (MRI).

Methods

We trained the StyleGAN model unsupervised using T1-weighted GRE MR images and diffusion-based ADC maps of MS patients and healthy controls. We then used the trained model to resample MR images from real input data and modified them by manipulations in the latent space to simulate MS progression. We analyzed the resulting simulation-related patterns mimicking disease progression by comparing the intensity profiles of the original and manipulated images and determined the brain parenchymal fraction (BPF).

Results

Our results show that MS progression can be simulated by manipulating MR images in the latent space, as evidenced by brain volume loss on both T1-weighted and ADC maps and increasing lesion extent on ADC maps.

Conclusion

Overall, this study demonstrates the potential of the StyleGAN model in medical imaging to study image markers and to shed more light on the relationship between brain atrophy and MS progression through corresponding manipulations in the latent space.

导言多发性硬化症(MS)是一种影响大脑和脊髓的复杂神经退行性疾病。在这项研究中,我们利用 StyleGAN 模型,采用基于深度学习的方法来探索多发性硬化症的相关模式,并预测磁共振图像(MRI)中的疾病进展。然后,我们使用训练有素的模型对真实输入数据中的 MR 图像进行重采样,并通过在潜空间中的操作对其进行修改,以模拟多发性硬化症的进展。结果我们的研究结果表明,多发性硬化症的进展可以通过在潜空间操作磁共振图像来模拟,表现为 T1 加权图和 ADC 图上的脑容量损失,以及 ADC 图上病变范围的扩大。结论总之,本研究证明了 StyleGAN 模型在医学成像中研究图像标记的潜力,并通过在潜空间中的相应操作,进一步阐明了脑萎缩与多发性硬化症进展之间的关系。
{"title":"Predicting disease-related MRI patterns of multiple sclerosis through GAN-based image editing","authors":"Daniel Güllmar ,&nbsp;Wei-Chan Hsu ,&nbsp;Jürgen R. Reichenbach","doi":"10.1016/j.zemedi.2023.12.001","DOIUrl":"10.1016/j.zemedi.2023.12.001","url":null,"abstract":"<div><h3>Introduction</h3><p>Multiple sclerosis (MS) is a complex neurodegenerative disorder that affects the brain and spinal cord. In this study, we applied a deep learning-based approach using the StyleGAN model to explore patterns related to MS and predict disease progression in magnetic resonance images (MRI).</p></div><div><h3>Methods</h3><p>We trained the StyleGAN model unsupervised using T<sub>1</sub>-weighted GRE MR images and diffusion-based ADC maps of MS patients and healthy controls. We then used the trained model to resample MR images from real input data and modified them by manipulations in the latent space to simulate MS progression. We analyzed the resulting simulation-related patterns mimicking disease progression by comparing the intensity profiles of the original and manipulated images and determined the brain parenchymal fraction (BPF).</p></div><div><h3>Results</h3><p>Our results show that MS progression can be simulated by manipulating MR images in the latent space, as evidenced by brain volume loss on both T<sub>1</sub>-weighted and ADC maps and increasing lesion extent on ADC maps.</p></div><div><h3>Conclusion</h3><p>Overall, this study demonstrates the potential of the StyleGAN model in medical imaging to study image markers and to shed more light on the relationship between brain atrophy and MS progression through corresponding manipulations in the latent space.</p></div>","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388923001484/pdfft?md5=41054e941858901ec78e1d44ca3d8f6d&pid=1-s2.0-S0939388923001484-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139030422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The use of deep learning in interventional radiotherapy (brachytherapy): A review with a focus on open source and open data 深度学习在介入放射治疗(近距离放射治疗)中的应用:以开源和开放数据为重点的综述。
IF 2 4区 医学 Q1 Medicine Pub Date : 2024-05-01 DOI: 10.1016/j.zemedi.2022.10.005
Tobias Fechter, Ilias Sachpazidis, Dimos Baltas

Deep learning advanced to one of the most important technologies in almost all medical fields. Especially in areas, related to medical imaging it plays a big role. However, in interventional radiotherapy (brachytherapy) deep learning is still in an early phase. In this review, first, we investigated and scrutinised the role of deep learning in all processes of interventional radiotherapy and directly related fields. Additionally, we summarised the most recent developments. For better understanding, we provide explanations of key terms and approaches to solving common deep learning problems. To reproduce results of deep learning algorithms both source code and training data must be available. Therefore, a second focus of this work is on the analysis of the availability of open source, open data and open models. In our analysis, we were able to show that deep learning plays already a major role in some areas of interventional radiotherapy, but is still hardly present in others. Nevertheless, its impact is increasing with the years, partly self-propelled but also influenced by closely related fields. Open source, data and models are growing in number but are still scarce and unevenly distributed among different research groups. The reluctance in publishing code, data and models limits reproducibility and restricts evaluation to mono-institutional datasets. The conclusion of our analysis is that deep learning can positively change the workflow of interventional radiotherapy but there is still room for improvements when it comes to reproducible results and standardised evaluation methods.

深度学习已发展成为几乎所有医学领域最重要的技术之一。特别是在与医学成像相关的领域,它发挥着重要作用。然而,在介入放射治疗(近距离放射治疗)领域,深度学习仍处于早期阶段。在这篇综述中,我们首先调查并仔细研究了深度学习在介入放射治疗的所有过程以及直接相关领域中的作用。此外,我们还总结了最新进展。为了更好地理解,我们对关键术语和解决常见深度学习问题的方法进行了解释。要重现深度学习算法的结果,必须要有源代码和训练数据。因此,这项工作的第二个重点是分析开放源代码、开放数据和开放模型的可用性。我们的分析表明,深度学习已经在介入放射治疗的某些领域发挥了重要作用,但在其他领域还很难发挥作用。不过,随着时间的推移,深度学习的影响正在不断扩大,这其中有自身的原因,但也受到了密切相关领域的影响。开放源代码、数据和模型的数量在不断增加,但仍然很少,而且在不同研究小组中分布不均。不愿公布代码、数据和模型限制了可重复性,并将评估限制在单一机构数据集上。我们的分析结论是,深度学习可以积极改变介入放射治疗的工作流程,但在结果的可重复性和标准化评估方法方面仍有改进空间。
{"title":"The use of deep learning in interventional radiotherapy (brachytherapy): A review with a focus on open source and open data","authors":"Tobias Fechter,&nbsp;Ilias Sachpazidis,&nbsp;Dimos Baltas","doi":"10.1016/j.zemedi.2022.10.005","DOIUrl":"10.1016/j.zemedi.2022.10.005","url":null,"abstract":"<div><p>Deep learning advanced to one of the most important technologies in almost all medical fields. Especially in areas, related to medical imaging it plays a big role. However, in interventional radiotherapy (brachytherapy) deep learning is still in an early phase. In this review, first, we investigated and scrutinised the role of deep learning in all processes of interventional radiotherapy and directly related fields. Additionally, we summarised the most recent developments. For better understanding, we provide explanations of key terms and approaches to solving common deep learning problems. To reproduce results of deep learning algorithms both source code and training data must be available. Therefore, a second focus of this work is on the analysis of the availability of open source, open data and open models. In our analysis, we were able to show that deep learning plays already a major role in some areas of interventional radiotherapy, but is still hardly present in others. Nevertheless, its impact is increasing with the years, partly self-propelled but also influenced by closely related fields. Open source, data and models are growing in number but are still scarce and unevenly distributed among different research groups. The reluctance in publishing code, data and models limits reproducibility and restricts evaluation to mono-institutional datasets. The conclusion of our analysis is that deep learning can positively change the workflow of interventional radiotherapy but there is still room for improvements when it comes to reproducible results and standardised evaluation methods.</p></div>","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S093938892200099X/pdfft?md5=e09e3f8ecf1904ecf8c422cf71a094c3&pid=1-s2.0-S093938892200099X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40464237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automated prognosis of renal function decline in ADPKD patients using deep learning 利用深度学习自动预测 ADPKD 患者肾功能衰退情况
IF 2 4区 医学 Q1 Medicine Pub Date : 2024-05-01 DOI: 10.1016/j.zemedi.2023.08.001
Anish Raj , Fabian Tollens , Anna Caroli , Dominik Nörenberg , Frank G. Zöllner

An accurate prognosis of renal function decline in Autosomal Dominant Polycystic Kidney Disease (ADPKD) is crucial for early intervention. Current biomarkers used are height-adjusted total kidney volume (HtTKV), estimated glomerular filtration rate (eGFR), and patient age. However, manually measuring kidney volume is time-consuming and subject to observer variability. Additionally, incorporating automatically generated features from kidney MRI images, along with conventional biomarkers, can enhance prognostic improvement. To address these issues, we developed two deep-learning algorithms. Firstly, an automated kidney volume segmentation model accurately calculates HtTKV. Secondly, we utilize segmented kidney volumes, predicted HtTKV, age, and baseline eGFR to predict chronic kidney disease (CKD) stages >=3A, >=3B, and a 30% decline in eGFR after 8 years from the baseline visit. Our approach combines a convolutional neural network (CNN) and a multi-layer perceptron (MLP). Our study included 135 subjects and the AUC scores obtained were 0.96, 0.96, and 0.95 for CKD stages >=3A, >=3B, and a 30% decline in eGFR, respectively. Furthermore, our algorithm achieved a Pearson correlation coefficient of 0.81 between predicted and measured eGFR decline. We extended our approach to predict distinct CKD stages after eight years with an AUC of 0.97. The proposed approach has the potential to enhance monitoring and facilitate prognosis in ADPKD patients, even in the early disease stages.

准确预测常染色体显性多囊肾病(ADPKD)肾功能衰退对早期干预至关重要。目前使用的生物标志物包括身高调整肾脏总体积(HtTKV)、估计肾小球滤过率(eGFR)和患者年龄。然而,手动测量肾脏体积既费时又受观察者差异性的影响。此外,将肾脏核磁共振成像图像自动生成的特征与传统的生物标志物结合起来,可以提高预后效果。为了解决这些问题,我们开发了两种深度学习算法。首先,自动肾脏体积分割模型可精确计算 HtTKV。其次,我们利用分割后的肾脏体积、预测的 HtTKV、年龄和基线 eGFR 预测慢性肾脏病(CKD)分期>=3A、>=3B 和自基线检查起 8 年后 eGFR 下降 30%。我们的方法结合了卷积神经网络(CNN)和多层感知器(MLP)。我们的研究包括 135 名受试者,对于 CKD 阶段>=3A、>=3B 和 eGFR 下降 30% 的受试者,所获得的 AUC 分数分别为 0.96、0.96 和 0.95。此外,我们的算法在预测和测量的 eGFR 下降之间达到了 0.81 的皮尔逊相关系数。我们扩展了我们的方法,以预测八年后不同的 CKD 阶段,AUC 为 0.97。所提出的方法有望加强对 ADPKD 患者的监测并促进其预后,即使是在疾病的早期阶段。
{"title":"Automated prognosis of renal function decline in ADPKD patients using deep learning","authors":"Anish Raj ,&nbsp;Fabian Tollens ,&nbsp;Anna Caroli ,&nbsp;Dominik Nörenberg ,&nbsp;Frank G. Zöllner","doi":"10.1016/j.zemedi.2023.08.001","DOIUrl":"10.1016/j.zemedi.2023.08.001","url":null,"abstract":"<div><p>An accurate prognosis of renal function decline in Autosomal Dominant Polycystic Kidney Disease (ADPKD) is crucial for early intervention. Current biomarkers used are height-adjusted total kidney volume (HtTKV), estimated glomerular filtration rate (eGFR), and patient age. However, manually measuring kidney volume is time-consuming and subject to observer variability. Additionally, incorporating automatically generated features from kidney MRI images, along with conventional biomarkers, can enhance prognostic improvement. To address these issues, we developed two deep-learning algorithms. Firstly, an automated kidney volume segmentation model accurately calculates HtTKV. Secondly, we utilize segmented kidney volumes, predicted HtTKV, age, and baseline eGFR to predict chronic kidney disease (CKD) stages <span><math><mrow><mo>&gt;</mo></mrow></math></span>=3A, <span><math><mrow><mo>&gt;</mo></mrow></math></span>=3B, and a 30% decline in eGFR after 8 years from the baseline visit. Our approach combines a convolutional neural network (CNN) and a multi-layer perceptron (MLP). Our study included 135 subjects and the AUC scores obtained were 0.96, 0.96, and 0.95 for CKD stages <span><math><mrow><mo>&gt;</mo></mrow></math></span>=3A, <span><math><mrow><mo>&gt;</mo></mrow></math></span>=3B, and a 30% decline in eGFR, respectively. Furthermore, our algorithm achieved a Pearson correlation coefficient of 0.81 between predicted and measured eGFR decline. We extended our approach to predict distinct CKD stages after eight years with an AUC of 0.97. The proposed approach has the potential to enhance monitoring and facilitate prognosis in ADPKD patients, even in the early disease stages.</p></div>","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388923000909/pdfft?md5=f7bc065601b8dfd2bfb240a0fa1328c0&pid=1-s2.0-S0939388923000909-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10056256","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A generalization performance study on the boosting radiotherapy dose calculation engine based on super-resolution 基于超分辨率的增强放射治疗剂量计算引擎的通用性能研究。
IF 2 4区 医学 Q1 Medicine Pub Date : 2024-05-01 DOI: 10.1016/j.zemedi.2022.10.006
Yewei Wang , Yaoying Liu , Yanlin Bai , Qichao Zhou , Shouping Xu , Xueying Pang

Purpose

During the radiation treatment planning process, one of the time-consuming procedures is the final high-resolution dose calculation, which obstacles the wide application of the emerging online adaptive radiotherapy techniques (OLART). There is an urgent desire for highly accurate and efficient dose calculation methods. This study aims to develop a dose super resolution-based deep learning model for fast and accurate dose prediction in clinical practice.

Method

A Multi-stage Dose Super-Resolution Network (MDSR Net) architecture with sparse masks module and multi-stage progressive dose distribution restoration method were developed to predict high-resolution dose distribution using low-resolution data. A total of 340 VMAT plans from different disease sites were used, among which 240 randomly selected nasopharyngeal, lung, and cervix cases were used for model training, and the remaining 60 cases from the same sites for model benchmark testing, and additional 40 cases from the unseen site (breast and rectum) was used for model generalizability evaluation. The clinical calculated dose with a grid size of 2 mm was used as baseline dose distribution. The input included the dose distribution with 4 mm grid size and CT images. The model performance was compared with HD U-Net and cubic interpolation methods using Dose-volume histograms (DVH) metrics and global gamma analysis with 1%/1 mm and 10% low dose threshold. The correlation between the prediction error and the dose, dose gradient, and CT values was also evaluated.

Results

The prediction errors of MDSR were 0.06–0.84% of Dmean indices, and the gamma passing rate was 83.1–91.0% on the benchmark testing dataset, and 0.02–1.03% and 71.3–90.3% for the generalization dataset respectively. The model performance was significantly higher than the HD U-Net and interpolation methods (p < 0.05). The mean errors of the MDSR model decreased (monotonously by 0.03–0.004%) with dose and increased (by 0.01–0.73%) with the dose gradient. There was no correlation between prediction errors and the CT values.

Conclusion

The proposed MDSR model achieved good agreement with the baseline high-resolution dose distribution, with small prediction errors for DVH indices and high gamma passing rate for both seen and unseen sites, indicating a robust and generalizable dose prediction model. The model can provide fast and accurate high-resolution dose distribution for clinical dose calculation, particularly for the routine practice of OLART.

目的:在放射治疗规划过程中,耗时的程序之一是最终的高分辨率剂量计算,这阻碍了新兴的在线自适应放射治疗技术(OLART)的广泛应用。人们迫切需要高精度、高效率的剂量计算方法。本研究旨在开发一种基于剂量超分辨率的深度学习模型,用于临床实践中快速准确的剂量预测:方法:开发了一种带有稀疏掩模模块的多级剂量超分辨率网络(MDSR Net)架构和多级渐进剂量分布还原方法,利用低分辨率数据预测高分辨率剂量分布。共使用了 340 份来自不同疾病部位的 VMAT 图,其中 240 份随机选取的鼻咽、肺和宫颈病例用于模型训练,其余 60 份来自相同部位的病例用于模型基准测试,另外 40 份来自未见部位(乳腺和直肠)的病例用于模型普适性评估。临床计算剂量的网格大小为 2 毫米,作为基线剂量分布。输入包括网格尺寸为 4 毫米的剂量分布和 CT 图像。利用剂量-体积直方图(DVH)指标和全局伽玛分析(1%/1 毫米和 10%低剂量阈值),将模型性能与 HD U-Net 和立方插值法进行了比较。此外,还评估了预测误差与剂量、剂量梯度和 CT 值之间的相关性:在基准测试数据集上,MDSR的预测误差为Dmean指数的0.06%-0.84%,伽马通过率为83.1%-91.0%;在泛化数据集上,MDSR的预测误差为0.02%-1.03%,伽马通过率为71.3%-90.3%。该模型的性能明显高于 HD U-Net 和插值法(p 结论):所提出的 MDSR 模型与基线高分辨率剂量分布具有良好的一致性,DVH 指数的预测误差小,可见和未可见部位的伽马通过率高,表明该模型是一个稳健且可泛化的剂量预测模型。该模型可为临床剂量计算提供快速、准确的高分辨率剂量分布,尤其适用于 OLART 的常规应用。
{"title":"A generalization performance study on the boosting radiotherapy dose calculation engine based on super-resolution","authors":"Yewei Wang ,&nbsp;Yaoying Liu ,&nbsp;Yanlin Bai ,&nbsp;Qichao Zhou ,&nbsp;Shouping Xu ,&nbsp;Xueying Pang","doi":"10.1016/j.zemedi.2022.10.006","DOIUrl":"10.1016/j.zemedi.2022.10.006","url":null,"abstract":"<div><h3>Purpose</h3><p>During the radiation treatment planning process, one of the time-consuming procedures is the final high-resolution dose calculation, which obstacles the wide application of the emerging online adaptive radiotherapy techniques (OLART). There is an urgent desire for highly accurate and efficient dose calculation methods. This study aims to develop a dose super resolution-based deep learning model for fast and accurate dose prediction in clinical practice.</p></div><div><h3>Method</h3><p>A Multi-stage Dose Super-Resolution Network (MDSR Net) architecture with sparse masks module and multi-stage progressive dose distribution restoration method were developed to predict high-resolution dose distribution using low-resolution data. A total of 340 VMAT plans from different disease sites were used, among which 240 randomly selected nasopharyngeal, lung, and cervix cases were used for model training, and the remaining 60 cases from the same sites for model benchmark testing, and additional 40 cases from the unseen site (breast and rectum) was used for model generalizability evaluation. The clinical calculated dose with a grid size of 2 mm was used as baseline dose distribution. The input included the dose distribution with 4 mm grid size and CT images. The model performance was compared with HD U-Net and cubic interpolation methods using Dose-volume histograms (DVH) metrics and global gamma analysis with 1%/1 mm and 10% low dose threshold. The correlation between the prediction error and the dose, dose gradient, and CT values was also evaluated.</p></div><div><h3>Results</h3><p>The prediction errors of MDSR were 0.06–0.84% of D<sub>mean</sub> indices, and the gamma passing rate was 83.1–91.0% on the benchmark testing dataset, and 0.02–1.03% and 71.3–90.3% for the generalization dataset respectively. The model performance was significantly higher than the HD U-Net and interpolation methods (<em>p</em> &lt; 0.05). The mean errors of the MDSR model decreased (monotonously by 0.03–0.004%) with dose and increased (by 0.01–0.73%) with the dose gradient. There was no correlation between prediction errors and the CT values.</p></div><div><h3>Conclusion</h3><p>The proposed MDSR model achieved good agreement with the baseline high-resolution dose distribution, with small prediction errors for DVH indices and high gamma passing rate for both seen and unseen sites, indicating a robust and generalizable dose prediction model. The model can provide fast and accurate high-resolution dose distribution for clinical dose calculation, particularly for the routine practice of OLART.</p></div>","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388922001003/pdfft?md5=5beaf64e5d3600c18adc8f8420659d04&pid=1-s2.0-S0939388922001003-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10511675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Machine learning-based approach reveals essential features for simplified TSPO PET quantification in ischemic stroke patients 基于机器学习的方法揭示了简化缺血性中风患者 TSPO PET 定量的基本特征。
IF 2 4区 医学 Q1 Medicine Pub Date : 2024-05-01 DOI: 10.1016/j.zemedi.2022.11.008
Artem Zatcepin , Anna Kopczak , Adrien Holzgreve , Sandra Hein , Andreas Schindler , Marco Duering , Lena Kaiser , Simon Lindner , Martin Schidlowski , Peter Bartenstein , Nathalie Albert , Matthias Brendel , Sibylle I. Ziegler

Introduction

Neuroinflammation evaluation after acute ischemic stroke is a promising option for selecting an appropriate post-stroke treatment strategy. To assess neuroinflammation in vivo, translocator protein PET (TSPO PET) can be used. However, the gold standard TSPO PET quantification method includes a 90 min scan and continuous arterial blood sampling, which is challenging to perform on a routine basis. In this work, we determine what information is required for a simplified quantification approach using a machine learning algorithm.

Materials and Methods

We analyzed data from 18 patients with ischemic stroke who received 0–90 min [18F]GE-180 PET as well as T1-weigted (T1w), FLAIR, and arterial spin labeling (ASL) MRI scans. During PET scans, five manual venous blood samples at 5, 15, 30, 60, and 85 min post injection (p.i.) were drawn, and plasma activity concentration was measured. Total distribution volume (VT) was calculated using Logan plot with the full dynamic PET and an image-derived input function (IDIF) from the carotid arteries. IDIF was scaled by a calibration factor derived from all the measured plasma activity concentrations. The calculated VT values were used for training a random forest regressor. As input features for the model, we used three late PET frames (60–70, 70–80, and 80–90 min p.i.), the ASL image reflecting perfusion, the voxel coordinates, the lesion mask, and the five plasma activity concentrations. The algorithm was validated with the leave-one-out approach. To estimate the impact of the individual features on the algorithm’s performance, we used Shapley Additive Explanations (SHAP). Having determined that the three late PET frames and the plasma activity concentrations were the most important features, we tested a simplified quantification approach consisting of dividing a late PET frame by a plasma activity concentration. All the combinations of frames/samples were compared by means of concordance correlation coefficient and Bland-Altman plots.

Results

When using all the input features, the algorithm predicted VT values with high accuracy (87.8 ± 8.3%) for both lesion and non-lesion voxels. The SHAP values demonstrated high impact of the late PET frames (60–70, 70–80, and 80–90 min p.i.) and plasma activity concentrations on the VT prediction, while the influence of the ASL-derived perfusion, voxel coordinates, and the lesion mask was low. Among all the combinations of the late PET frames and plasma activity concentrations, the 70–80 min p.i. frame divided by the 30 min p.i. plasma sample produced the closest VT estimate in the ischemic lesion.

Conclusion

Reliable TSPO PET quantification is achievable by using a single late PET frame divided by a late blood sample activity concentration.

简介急性缺血性中风后的神经炎症评估是选择适当的中风后治疗策略的一个很有前景的选择。要评估体内的神经炎症,可以使用转运蛋白 PET(TSPO PET)。然而,金标准 TSPO PET 定量方法包括 90 分钟扫描和连续动脉血采样,这对常规操作具有挑战性。在这项工作中,我们利用机器学习算法确定了简化量化方法所需的信息:我们分析了 18 位缺血性中风患者的数据,这些患者接受了 0-90 分钟[18F]GE-180 PET 以及 T1 权衡 (T1w)、FLAIR 和动脉自旋标记 (ASL) MRI 扫描。在 PET 扫描期间,分别在注射后 5、15、30、60 和 85 分钟(p.i.)手动抽取五份静脉血样本,并测量血浆活性浓度。总分布容积(VT)是通过全动态 PET Logan 图和颈动脉图像输入函数(IDIF)计算得出的。IDIF 根据所有测量的血浆活性浓度得出的校准因子进行缩放。计算出的 VT 值用于训练随机森林回归器。作为模型的输入特征,我们使用了三个晚期 PET 帧(60-70、70-80 和 80-90 分钟 p.i.)、反映灌注的 ASL 图像、体素坐标、病灶掩膜和五个血浆活性浓度。该算法通过 "留一弃一 "方法进行了验证。为了估计各个特征对算法性能的影响,我们使用了夏普利相加解释(SHAP)。在确定三个晚期 PET 帧和血浆活性浓度是最重要的特征后,我们测试了一种简化的量化方法,即用晚期 PET 帧除以血浆活性浓度。我们通过一致性相关系数和布兰-阿尔特曼图对所有帧/样本组合进行了比较:结果:当使用所有输入特征时,该算法预测病变和非病变体素的 VT 值的准确率都很高(87.8 ± 8.3%)。SHAP值显示晚期PET帧(60-70、70-80和80-90分钟p.i.)和血浆活性浓度对VT预测的影响较大,而ASL衍生灌注、体素坐标和病变掩膜的影响较小。在PET晚期帧和血浆活动浓度的所有组合中,70-80分钟p.i.帧除以30分钟p.i.血浆样本得出的缺血性病变VT估计值最接近:结论:通过使用单个晚期 PET 帧除以晚期血样活性浓度,可以实现可靠的 TSPO PET 定量。
{"title":"Machine learning-based approach reveals essential features for simplified TSPO PET quantification in ischemic stroke patients","authors":"Artem Zatcepin ,&nbsp;Anna Kopczak ,&nbsp;Adrien Holzgreve ,&nbsp;Sandra Hein ,&nbsp;Andreas Schindler ,&nbsp;Marco Duering ,&nbsp;Lena Kaiser ,&nbsp;Simon Lindner ,&nbsp;Martin Schidlowski ,&nbsp;Peter Bartenstein ,&nbsp;Nathalie Albert ,&nbsp;Matthias Brendel ,&nbsp;Sibylle I. Ziegler","doi":"10.1016/j.zemedi.2022.11.008","DOIUrl":"10.1016/j.zemedi.2022.11.008","url":null,"abstract":"<div><h3>Introduction</h3><p>Neuroinflammation evaluation after acute ischemic stroke is a promising option for selecting an appropriate post-stroke treatment strategy. To assess neuroinflammation <em>in vivo</em>, translocator protein PET (TSPO PET) can be used. However, the gold standard TSPO PET quantification method includes a 90 min scan and continuous arterial blood sampling, which is challenging to perform on a routine basis. In this work, we determine what information is required for a simplified quantification approach using a machine learning algorithm.</p></div><div><h3>Materials and Methods</h3><p>We analyzed data from 18 patients with ischemic stroke who received 0–90 min [<sup>18</sup>F]GE-180 PET as well as T1-weigted (T1w), FLAIR, and arterial spin labeling (ASL) MRI scans. During PET scans, five manual venous blood samples at 5, 15, 30, 60, and 85 min post injection (p.i.) were drawn, and plasma activity concentration was measured. Total distribution volume (V<sub>T</sub>) was calculated using Logan plot with the full dynamic PET and an image-derived input function (IDIF) from the carotid arteries. IDIF was scaled by a calibration factor derived from all the measured plasma activity concentrations. The calculated V<sub>T</sub> values were used for training a random forest regressor. As input features for the model, we used three late PET frames (60–70, 70–80, and 80–90 min p.i.), the ASL image reflecting perfusion, the voxel coordinates, the lesion mask, and the five plasma activity concentrations. The algorithm was validated with the leave-one-out approach. To estimate the impact of the individual features on the algorithm’s performance, we used Shapley Additive Explanations (SHAP). Having determined that the three late PET frames and the plasma activity concentrations were the most important features, we tested a simplified quantification approach consisting of dividing a late PET frame by a plasma activity concentration. All the combinations of frames/samples were compared by means of concordance correlation coefficient and Bland-Altman plots.</p></div><div><h3>Results</h3><p>When using all the input features, the algorithm predicted V<sub>T</sub> values with high accuracy (87.8 ± 8.3%) for both lesion and non-lesion voxels. The SHAP values demonstrated high impact of the late PET frames (60–70, 70–80, and 80–90 min p.i.) and plasma activity concentrations on the V<sub>T</sub> prediction, while the influence of the ASL-derived perfusion, voxel coordinates, and the lesion mask was low. Among all the combinations of the late PET frames and plasma activity concentrations, the 70–80 min p.i. frame divided by the 30 min p.i. plasma sample produced the closest V<sub>T</sub> estimate in the ischemic lesion.</p></div><div><h3>Conclusion</h3><p>Reliable TSPO PET quantification is achievable by using a single late PET frame divided by a late blood sample activity concentration.</p></div>","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388922001283/pdfft?md5=f1499fef4d918f1109e5e15fcbad1787&pid=1-s2.0-S0939388922001283-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10567400","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep learning-based affine medical image registration for multimodal minimal-invasive image-guided interventions – A comparative study on generalizability 基于深度学习的仿射医学图像配准用于多模态微创图像引导干预--可推广性比较研究
IF 2 4区 医学 Q1 Medicine Pub Date : 2024-05-01 DOI: 10.1016/j.zemedi.2023.05.003
Anika Strittmatter, Lothar R. Schad, Frank G. Zöllner

Multimodal image registration is applied in medical image analysis as it allows the integration of complementary data from multiple imaging modalities. In recent years, various neural network-based approaches for medical image registration have been presented in papers, but due to the use of different datasets, a fair comparison is not possible. In this research 20 different neural networks for an affine registration of medical images were implemented. The networks’ performance and the networks’ generalizability to new datasets were evaluated using two multimodal datasets - a synthetic and a real patient dataset - of three-dimensional CT and MR images of the liver. The networks were first trained semi-supervised using the synthetic dataset and then evaluated on the synthetic dataset and the unseen patient dataset. Afterwards, the networks were finetuned on the patient dataset and subsequently evaluated on the patient dataset. The networks were compared using our own developed CNN as benchmark and a conventional affine registration with SimpleElastix as baseline. Six networks improved the pre-registration Dice coefficient of the synthetic dataset significantly (p-value < 0.05) and nine networks improved the pre-registration Dice coefficient of the patient dataset significantly and are therefore able to generalize to the new datasets used in our experiments. Many different machine learning-based methods have been proposed for affine multimodal medical image registration, but few are generalizable to new data and applications. It is therefore necessary to conduct further research in order to develop medical image registration techniques that can be applied more widely.

多模态图像配准适用于医学图像分析,因为它可以整合多种成像模式的互补数据。近年来,已有论文介绍了各种基于神经网络的医学图像配准方法,但由于使用的数据集不同,因此无法进行公平的比较。在这项研究中,采用了 20 种不同的神经网络对医学图像进行仿射配准。使用肝脏三维 CT 和 MR 图像的两个多模态数据集(一个合成数据集和一个真实患者数据集)评估了这些网络的性能和对新数据集的通用性。首先使用合成数据集对网络进行半监督训练,然后在合成数据集和未见患者数据集上进行评估。然后,在患者数据集上对网络进行微调,随后在患者数据集上进行评估。以我们自己开发的 CNN 为基准,以 SimpleElastix 的传统仿射配准为基线,对这些网络进行了比较。六个网络显著提高了合成数据集的预注册 Dice 系数(p 值为 0.05),九个网络显著提高了患者数据集的预注册 Dice 系数,因此能够推广到我们实验中使用的新数据集。针对仿射多模态医学影像配准,已经提出了许多不同的基于机器学习的方法,但很少有方法可以推广到新的数据和应用中。因此,有必要开展进一步的研究,以开发出可更广泛应用的医学图像配准技术。
{"title":"Deep learning-based affine medical image registration for multimodal minimal-invasive image-guided interventions – A comparative study on generalizability","authors":"Anika Strittmatter,&nbsp;Lothar R. Schad,&nbsp;Frank G. Zöllner","doi":"10.1016/j.zemedi.2023.05.003","DOIUrl":"10.1016/j.zemedi.2023.05.003","url":null,"abstract":"<div><p>Multimodal image registration is applied in medical image analysis as it allows the integration of complementary data from multiple imaging modalities. In recent years, various neural network-based approaches for medical image registration have been presented in papers, but due to the use of different datasets, a fair comparison is not possible. In this research 20 different neural networks for an affine registration of medical images were implemented. The networks’ performance and the networks’ generalizability to new datasets were evaluated using two multimodal datasets - a synthetic and a real patient dataset - of three-dimensional CT and MR images of the liver. The networks were first trained semi-supervised using the synthetic dataset and then evaluated on the synthetic dataset and the unseen patient dataset. Afterwards, the networks were finetuned on the patient dataset and subsequently evaluated on the patient dataset. The networks were compared using our own developed CNN as benchmark and a conventional affine registration with SimpleElastix as baseline. Six networks improved the pre-registration Dice coefficient of the synthetic dataset significantly (<em>p</em>-value <span><math><mrow><mo>&lt;</mo></mrow></math></span> 0.05) and nine networks improved the pre-registration Dice coefficient of the patient dataset significantly and are therefore able to generalize to the new datasets used in our experiments. Many different machine learning-based methods have been proposed for affine multimodal medical image registration, but few are generalizable to new data and applications. It is therefore necessary to conduct further research in order to develop medical image registration techniques that can be applied more widely.</p></div>","PeriodicalId":54397,"journal":{"name":"Zeitschrift fur Medizinische Physik","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388923000715/pdfft?md5=8bc88c35e2779691cc7ef560e61e14e3&pid=1-s2.0-S0939388923000715-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9683952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Zeitschrift fur Medizinische Physik
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1