首页 > 最新文献

Journal of Digital Imaging最新文献

英文 中文
MRI-based Machine Learning Radiomics Can Predict CSF1R Expression Level and Prognosis in High-grade Gliomas 基于磁共振成像的机器学习放射组学可预测高级别胶质瘤的 CSF1R 表达水平和预后
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-24 DOI: 10.1007/s10278-023-00905-x
Yuling Lai, Yiyang Wu, Xiangyuan Chen, Wenchao Gu, Guoxia Zhou, Meilin Weng

The purpose of this study is to predict the mRNA expression of CSF1R in HGG non-invasively using MRI (magnetic resonance imaging) omics technology and to evaluate the correlation between the established radiomics model and prognosis. We investigated the predictive value of CSF1R in the Cancer Genome Atlas (TCGA) and The Cancer Imaging Archive (TCIA) database. The Support vector machine (SVM) and the Logistic regression (LR) algorithms were used to create a radiomics_score (Rad_score), respectively. The effectiveness and performance of the radiomics model was assessed in the training (n = 89) and tenfold cross-validation sets. We further analyzed the correlation between Rad_score and macrophage-related genes using Spearman correlation analysis. A radiomics nomogram combining the clinical factors and Rad_score was constructed to validate the radiomic signatures for individualized survival estimation and risk stratification. The results showed that CSF1R expression was markedly elevated in HGG tissues, which was related to worse prognosis. CSF1R expression was closely related to the abundance of infiltrating immune cells, such as macrophages. We identified nine features for establishing a radiomics model. The radiomics model predicting CSF1R achieved high AUC in training (0.768 in SVM and 0.792 in LR) and tenfold cross-validation sets (0.706 in SVM and 0.717 in LR). Rad_score was highly associated with tumor-related macrophage genes. A radiomics nomogram combining the Rad_score and clinical factors was constructed and revealed satisfactory performance. MRI-based Rad_score is a novel way to predict CSF1R expression and prognosis in high-grade glioma patients. The radiomics nomogram could optimize individualized survival estimation for HGG patients.

本研究的目的是利用 MRI(磁共振成像)全息技术无创预测 HGG 中 CSF1R 的 mRNA 表达,并评估已建立的放射组学模型与预后之间的相关性。我们研究了癌症基因组图谱(TCGA)和癌症影像档案(TCIA)数据库中 CSF1R 的预测价值。我们分别使用支持向量机(SVM)和逻辑回归(LR)算法创建了放射组学评分(Rad_score)。在训练集(n = 89)和十倍交叉验证集中评估了放射组学模型的有效性和性能。我们使用斯皮尔曼相关分析进一步分析了 Rad_score 与巨噬细胞相关基因之间的相关性。我们结合临床因素和Rad_score构建了放射组学提名图,以验证放射组学特征在个体化生存期评估和风险分层中的作用。结果显示,CSF1R在HGG组织中的表达明显升高,这与预后较差有关。CSF1R的表达与巨噬细胞等浸润性免疫细胞的数量密切相关。我们确定了建立放射组学模型的九个特征。预测 CSF1R 的放射组学模型在训练集(SVM 为 0.768,LR 为 0.792)和十倍交叉验证集(SVM 为 0.706,LR 为 0.717)中获得了较高的 AUC。Rad_score 与肿瘤相关的巨噬细胞基因高度相关。结合 Rad_score 和临床因素构建了放射组学提名图,结果令人满意。基于 MRI 的 Rad_score 是预测高级别胶质瘤患者 CSF1R 表达和预后的一种新方法。放射组学提名图可以优化对高级别胶质瘤患者的个体化生存评估。
{"title":"MRI-based Machine Learning Radiomics Can Predict CSF1R Expression Level and Prognosis in High-grade Gliomas","authors":"Yuling Lai, Yiyang Wu, Xiangyuan Chen, Wenchao Gu, Guoxia Zhou, Meilin Weng","doi":"10.1007/s10278-023-00905-x","DOIUrl":"https://doi.org/10.1007/s10278-023-00905-x","url":null,"abstract":"<p>The purpose of this study is to predict the mRNA expression of CSF1R in HGG non-invasively using MRI (magnetic resonance imaging) omics technology and to evaluate the correlation between the established radiomics model and prognosis. We investigated the predictive value of CSF1R in the Cancer Genome Atlas (TCGA) and The Cancer Imaging Archive (TCIA) database. The Support vector machine (SVM) and the Logistic regression (LR) algorithms were used to create a radiomics_score (Rad_score), respectively. The effectiveness and performance of the radiomics model was assessed in the training (n = 89) and tenfold cross-validation sets. We further analyzed the correlation between Rad_score and macrophage-related genes using Spearman correlation analysis. A radiomics nomogram combining the clinical factors and Rad_score was constructed to validate the radiomic signatures for individualized survival estimation and risk stratification. The results showed that CSF1R expression was markedly elevated in HGG tissues, which was related to worse prognosis. CSF1R expression was closely related to the abundance of infiltrating immune cells, such as macrophages. We identified nine features for establishing a radiomics model. The radiomics model predicting CSF1R achieved high AUC in training (0.768 in SVM and 0.792 in LR) and tenfold cross-validation sets (0.706 in SVM and 0.717 in LR). Rad_score was highly associated with tumor-related macrophage genes. A radiomics nomogram combining the Rad_score and clinical factors was constructed and revealed satisfactory performance. MRI-based Rad_score is a novel way to predict CSF1R expression and prognosis in high-grade glioma patients. The radiomics nomogram could optimize individualized survival estimation for HGG patients.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"27 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139560441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting Risk Stratification in Early-Stage Endometrial Carcinoma: Significance of Multiparametric MRI Radiomics Model 预测早期子宫内膜癌的风险分层:多参数磁共振成像放射组学模型的意义
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-18 DOI: 10.1007/s10278-023-00936-4
Huan Meng, Yu-Feng Sun, Yu Zhang, Ya-Nan Yu, Jing Wang, Jia-Ning Wang, Lin-Yan Xue, Xiao-Ping Yin

Endometrial carcinoma (EC) risk stratification prior to surgery is crucial for clinical treatment. In this study, we intend to evaluate the predictive value of radiomics models based on magnetic resonance imaging (MRI) for risk stratification and staging of early-stage EC. The study included 155 patients who underwent MRI examinations prior to surgery and were pathologically diagnosed with early-stage EC between January, 2020, and September, 2022. Three-dimensional radiomics features were extracted from segmented tumor images captured by MRI scans (including T2WI, CE-T1WI delayed phase, and ADC), with 1521 features extracted from each of the three modalities. Then, using five-fold cross-validation and a multilayer perceptron algorithm, these features were filtered using Pearson’s correlation coefficient to develop a prediction model for risk stratification and staging of EC. The performance of each model was assessed by analyzing ROC curves and calculating the AUC, accuracy, sensitivity, and specificity. In terms of risk stratification, the CE-T1 sequence demonstrated the highest predictive accuracy of 0.858 ± 0.025 and an AUC of 0.878 ± 0.042 among the three sequences. However, combining all three sequences resulted in enhanced predictive accuracy, reaching 0.881 ± 0.040, with a corresponding increase in the AUC to 0.862 ± 0.069. In the context of staging, the utilization of a combination involving T2WI with CE-T1WI led to a notably elevated predictive accuracy of 0.956 ± 0.020, surpassing the accuracy achieved when employing any singular feature. Correspondingly, the AUC was 0.979 ± 0.022. When incorporating all three sequences concurrently, the predictive accuracy reached 0.956 ± 0.000, accompanied by an AUC of 0.986 ± 0.007. It is noteworthy that this level of accuracy surpassed that of the radiologist, which stood at 0.832. The MRI radiomics model has the potential to accurately predict the risk stratification and early staging of EC.

子宫内膜癌(EC)术前风险分层对临床治疗至关重要。在本研究中,我们打算评估基于磁共振成像(MRI)的放射组学模型对早期子宫内膜癌的风险分层和分期的预测价值。该研究纳入了 2020 年 1 月至 2022 年 9 月期间在手术前接受磁共振成像检查并经病理诊断为早期心肌梗死的 155 例患者。研究人员从核磁共振扫描(包括T2WI、CE-T1WI延迟相和ADC)捕获的分段肿瘤图像中提取了三维放射组学特征,从三种模式中各提取了1521个特征。然后,利用五次交叉验证和多层感知器算法,使用皮尔逊相关系数对这些特征进行筛选,从而建立了一个预测模型,用于对心肌梗死进行风险分层和分期。通过分析 ROC 曲线和计算 AUC、准确性、灵敏度和特异性,评估了每个模型的性能。在风险分层方面,CE-T1 序列的预测准确性最高,为 0.858 ± 0.025,AUC 为 0.878 ± 0.042。然而,将所有三个序列结合起来可提高预测准确性,达到 0.881 ± 0.040,AUC 也相应提高到 0.862 ± 0.069。在分期方面,将 T2WI 与 CE-T1WI 结合使用可显著提高预测准确率,达到 0.956 ± 0.020,超过了采用任何单一特征时的准确率。相应地,AUC 为 0.979 ± 0.022。当同时包含所有三个序列时,预测准确率达到 0.956 ± 0.000,AUC 为 0.986 ± 0.007。值得注意的是,这一准确度超过了放射科医生的准确度,后者为 0.832。磁共振成像放射组学模型有望准确预测心肌梗死的风险分层和早期分期。
{"title":"Predicting Risk Stratification in Early-Stage Endometrial Carcinoma: Significance of Multiparametric MRI Radiomics Model","authors":"Huan Meng, Yu-Feng Sun, Yu Zhang, Ya-Nan Yu, Jing Wang, Jia-Ning Wang, Lin-Yan Xue, Xiao-Ping Yin","doi":"10.1007/s10278-023-00936-4","DOIUrl":"https://doi.org/10.1007/s10278-023-00936-4","url":null,"abstract":"<p>Endometrial carcinoma (EC) risk stratification prior to surgery is crucial for clinical treatment. In this study, we intend to evaluate the predictive value of radiomics models based on magnetic resonance imaging (MRI) for risk stratification and staging of early-stage EC. The study included 155 patients who underwent MRI examinations prior to surgery and were pathologically diagnosed with early-stage EC between January, 2020, and September, 2022. Three-dimensional radiomics features were extracted from segmented tumor images captured by MRI scans (including T2WI, CE-T1WI delayed phase, and ADC), with 1521 features extracted from each of the three modalities. Then, using five-fold cross-validation and a multilayer perceptron algorithm, these features were filtered using Pearson’s correlation coefficient to develop a prediction model for risk stratification and staging of EC. The performance of each model was assessed by analyzing ROC curves and calculating the AUC, accuracy, sensitivity, and specificity. In terms of risk stratification, the CE-T1 sequence demonstrated the highest predictive accuracy of 0.858 ± 0.025 and an AUC of 0.878 ± 0.042 among the three sequences. However, combining all three sequences resulted in enhanced predictive accuracy, reaching 0.881 ± 0.040, with a corresponding increase in the AUC to 0.862 ± 0.069. In the context of staging, the utilization of a combination involving T2WI with CE-T1WI led to a notably elevated predictive accuracy of 0.956 ± 0.020, surpassing the accuracy achieved when employing any singular feature. Correspondingly, the AUC was 0.979 ± 0.022. When incorporating all three sequences concurrently, the predictive accuracy reached 0.956 ± 0.000, accompanied by an AUC of 0.986 ± 0.007. It is noteworthy that this level of accuracy surpassed that of the radiologist, which stood at 0.832. The MRI radiomics model has the potential to accurately predict the risk stratification and early staging of EC.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"26 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139509329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automatic 3D Segmentation and Identification of Anomalous Aortic Origin of the Coronary Arteries Combining Multi-view 2D Convolutional Neural Networks 结合多视角二维卷积神经网络自动进行三维分割并识别异常的冠状动脉主动脉起源
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-17 DOI: 10.1007/s10278-023-00950-6
Ariel Fernando Pascaner, Antonio Rosato, Alice Fantazzini, Elena Vincenzi, Curzio Basso, Francesco Secchi, Mauro Lo Rito, Michele Conti

This work aimed to automatically segment and classify the coronary arteries with either normal or anomalous origin from the aorta (AAOCA) using convolutional neural networks (CNNs), seeking to enhance and fasten clinician diagnosis. We implemented three single-view 2D Attention U-Nets with 3D view integration and trained them to automatically segment the aortic root and coronary arteries of 124 computed tomography angiographies (CTAs), with normal coronaries or AAOCA. Furthermore, we automatically classified the segmented geometries as normal or AAOCA using a decision tree model. For CTAs in the test set (n = 13), we obtained median Dice score coefficients of 0.95 and 0.84 for the aortic root and the coronary arteries, respectively. Moreover, the classification between normal and AAOCA showed excellent performance with accuracy, precision, and recall all equal to 1 in the test set. We developed a deep learning-based method to automatically segment and classify normal coronary and AAOCA. Our results represent a step towards an automatic screening and risk profiling of patients with AAOCA, based on CTA.

这项研究旨在利用卷积神经网络(CNN)自动分割和分类起源于主动脉(AAOCA)的正常或异常冠状动脉,从而提高和加快临床医生的诊断速度。我们实施了三个具有三维视图整合功能的单视图二维注意力 U 网络,并对其进行了训练,以自动分割 124 张计算机断层扫描血管造影 (CTA) 中的主动脉根部和冠状动脉,其中包括正常冠状动脉或 AAOCA。此外,我们还使用决策树模型将分割后的几何图形自动分类为正常或 AAOCA。对于测试集中的 CTA(n = 13),主动脉根部和冠状动脉的 Dice 评分系数中值分别为 0.95 和 0.84。此外,在测试集中,正常和 AAOCA 之间的分类表现出色,准确率、精确度和召回率均等于 1。我们开发了一种基于深度学习的方法来自动分割和分类正常冠状动脉和 AAOCA。我们的研究结果标志着我们向基于 CTA 的 AAOCA 患者自动筛查和风险分析迈出了一步。
{"title":"Automatic 3D Segmentation and Identification of Anomalous Aortic Origin of the Coronary Arteries Combining Multi-view 2D Convolutional Neural Networks","authors":"Ariel Fernando Pascaner, Antonio Rosato, Alice Fantazzini, Elena Vincenzi, Curzio Basso, Francesco Secchi, Mauro Lo Rito, Michele Conti","doi":"10.1007/s10278-023-00950-6","DOIUrl":"https://doi.org/10.1007/s10278-023-00950-6","url":null,"abstract":"<p>This work aimed to automatically segment and classify the coronary arteries with either normal or anomalous origin from the aorta (AAOCA) using convolutional neural networks (CNNs), seeking to enhance and fasten clinician diagnosis. We implemented three single-view 2D Attention U-Nets with 3D view integration and trained them to automatically segment the aortic root and coronary arteries of 124 computed tomography angiographies (CTAs), with normal coronaries or AAOCA. Furthermore, we automatically classified the segmented geometries as normal or AAOCA using a decision tree model. For CTAs in the test set (<i>n</i> = 13), we obtained median Dice score coefficients of 0.95 and 0.84 for the aortic root and the coronary arteries, respectively. Moreover, the classification between normal and AAOCA showed excellent performance with accuracy, precision, and recall all equal to 1 in the test set. We developed a deep learning-based method to automatically segment and classify normal coronary and AAOCA. Our results represent a step towards an automatic screening and risk profiling of patients with AAOCA, based on CTA.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"176 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139497350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Detecting Avascular Necrosis of the Lunate from Radiographs Using a Deep-Learning Model 利用深度学习模型从 X 光片检测月骨血管性坏死
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-16 DOI: 10.1007/s10278-023-00964-0
Krista Wernér, Turkka Anttila, Sina Hulkkonen, Timo Viljakka, Ville Haapamäki, Jorma Ryhänen

Deep-learning (DL) algorithms have the potential to change medical image classification and diagnostics in the coming decade. Delayed diagnosis and treatment of avascular necrosis (AVN) of the lunate may have a detrimental effect on patient hand function. The aim of this study was to use a segmentation-based DL model to diagnose AVN of the lunate from wrist postero-anterior radiographs. A total of 319 radiographs of the diseased lunate and 1228 control radiographs were gathered from Helsinki University Central Hospital database. Of these, 10% were separated to form a test set for model validation. MRI confirmed the absence of disease. In cases of AVN of the lunate, a hand surgeon at Helsinki University Hospital validated the accurate diagnosis using either MRI or radiography. For detection of AVN, the model had a sensitivity of 93.33% (95% confidence interval (CI) 77.93–99.18%), specificity of 93.28% (95% CI 87.18–97.05%), and accuracy of 93.28% (95% CI 87.99–96.73%). The area under the receiver operating characteristic curve was 0.94 (95% CI 0.88–0.99). Compared to three clinical experts, the DL model had better AUC than one clinical expert and only one expert had higher accuracy than the DL model. The results were otherwise similar between the model and clinical experts. Our DL model performed well and may be a future beneficial tool for screening of AVN of the lunate.

深度学习(DL)算法有可能在未来十年内改变医学图像分类和诊断。月骨血管性坏死(AVN)的延迟诊断和治疗可能会对患者的手部功能产生不利影响。本研究的目的是使用基于分割的 DL 模型来诊断腕关节后前位片上的月骨无血管坏死。研究人员从赫尔辛基大学中心医院的数据库中收集了 319 张患病月骨X光片和 1228 张对照X光片。其中,10%被分离出来,形成用于模型验证的测试集。核磁共振成像证实没有病变。赫尔辛基大学医院的一名手外科医生通过核磁共振成像或X光片验证了月骨反向畸形的准确诊断。对于 AVN 的检测,该模型的灵敏度为 93.33%(95% 置信区间 (CI) 77.93-99.18%),特异度为 93.28%(95% 置信区间 (CI) 87.18-97.05%),准确度为 93.28%(95% 置信区间 (CI) 87.99-96.73%)。接收者操作特征曲线下面积为 0.94 (95% CI 0.88-0.99)。与三位临床专家相比,DL 模型的 AUC 高于一位临床专家,只有一位专家的准确率高于 DL 模型。在其他方面,该模型与临床专家的结果相似。我们的 DL 模型表现良好,可能是未来筛查月骨影象神经缺损的有效工具。
{"title":"Detecting Avascular Necrosis of the Lunate from Radiographs Using a Deep-Learning Model","authors":"Krista Wernér, Turkka Anttila, Sina Hulkkonen, Timo Viljakka, Ville Haapamäki, Jorma Ryhänen","doi":"10.1007/s10278-023-00964-0","DOIUrl":"https://doi.org/10.1007/s10278-023-00964-0","url":null,"abstract":"<p>Deep-learning (DL) algorithms have the potential to change medical image classification and diagnostics in the coming decade. Delayed diagnosis and treatment of avascular necrosis (AVN) of the lunate may have a detrimental effect on patient hand function. The aim of this study was to use a segmentation-based DL model to diagnose AVN of the lunate from wrist postero-anterior radiographs. A total of 319 radiographs of the diseased lunate and 1228 control radiographs were gathered from Helsinki University Central Hospital database. Of these, 10% were separated to form a test set for model validation. MRI confirmed the absence of disease. In cases of AVN of the lunate, a hand surgeon at Helsinki University Hospital validated the accurate diagnosis using either MRI or radiography. For detection of AVN, the model had a sensitivity of 93.33% (95% confidence interval (CI) 77.93–99.18%), specificity of 93.28% (95% CI 87.18–97.05%), and accuracy of 93.28% (95% CI 87.99–96.73%). The area under the receiver operating characteristic curve was 0.94 (95% CI 0.88–0.99). Compared to three clinical experts, the DL model had better AUC than one clinical expert and only one expert had higher accuracy than the DL model. The results were otherwise similar between the model and clinical experts. Our DL model performed well and may be a future beneficial tool for screening of AVN of the lunate.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"1 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139475901","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development and Validation of a 3D Resnet Model for Prediction of Lymph Node Metastasis in Head and Neck Cancer Patients 用于预测头颈部癌症患者淋巴结转移的三维 Resnet 模型的开发与验证
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-16 DOI: 10.1007/s10278-023-00938-2
Yi-Hui Lin, Chieh-Ting Lin, Ya-Han Chang, Yen-Yu Lin, Jen-Jee Chen, Chun-Rong Huang, Yu-Wei Hsu, Weir-Chiang You

The accurate diagnosis and staging of lymph node metastasis (LNM) are crucial for determining the optimal treatment strategy for head and neck cancer patients. We aimed to develop a 3D Resnet model and investigate its prediction value in detecting LNM. This study enrolled 156 head and neck cancer patients and analyzed 342 lymph nodes segmented from surgical pathologic reports. The patients’ clinical and pathological data related to the primary tumor site and clinical and pathology T and N stages were collected. To predict LNM, we developed a dual-pathway 3D Resnet model incorporating two Resnet models with different depths to extract features from the input data. To assess the model’s performance, we compared its predictions with those of radiologists in a test dataset comprising 38 patients. The study found that the dimensions and volume of LNM + were significantly larger than those of LNM-. Specifically, the Y and Z dimensions showed the highest sensitivity of 84.6% and specificity of 72.2%, respectively, in predicting LNM + . The analysis of various variations of the proposed 3D Resnet model demonstrated that Dual-3D-Resnet models with a depth of 34 achieved the highest AUC values of 0.9294. In the validation test of 38 patients and 86 lymph nodes dataset, the 3D Resnet model outperformed both physical examination and radiologists in terms of sensitivity (80.8% compared to 50.0% and 91.7%, respectively), specificity(90.0% compared to 88.5% and 65.4%, respectively), and positive predictive value (77.8% compared to 66.7% and 55.0%, respectively) in detecting individual LNM + . These results suggest that the 3D Resnet model can be valuable for accurately identifying LNM + in head and neck cancer patients. A prospective trial is needed to evaluate further the role of the 3D Resnet model in determining LNM + in head and neck cancer patients and its impact on treatment strategies and patient outcomes.

淋巴结转移(LNM)的准确诊断和分期对于确定头颈部癌症患者的最佳治疗策略至关重要。我们旨在开发一种三维 Resnet 模型,并研究其在检测 LNM 方面的预测价值。这项研究纳入了 156 名头颈部癌症患者,分析了从手术病理报告中分割出的 342 个淋巴结。研究收集了患者的临床和病理数据,包括原发肿瘤部位、临床和病理 T 期和 N 期。为了预测 LNM,我们开发了一个双途径三维 Resnet 模型,其中包含两个不同深度的 Resnet 模型,以便从输入数据中提取特征。为了评估该模型的性能,我们在一个由 38 名患者组成的测试数据集中将其预测结果与放射科医生的预测结果进行了比较。研究发现,LNM + 的尺寸和体积明显大于 LNM-。具体来说,在预测 LNM + 时,Y 和 Z 维度的灵敏度最高,分别为 84.6% 和 72.2%。对所提出的三维 Resnet 模型的各种变化进行的分析表明,深度为 34 的双三维 Resnet 模型的 AUC 值最高,达到 0.9294。在对 38 名患者和 86 个淋巴结数据集进行的验证测试中,三维 Resnet 模型在检测单个 LNM + 的灵敏度(80.8%,而物理检查和放射科医生的灵敏度分别为 50.0% 和 91.7%)、特异性(90.0%,而物理检查和放射科医生的特异性分别为 88.5% 和 65.4%)和阳性预测值(77.8%,而物理检查和放射科医生的阳性预测值分别为 66.7% 和 55.0%)方面均优于物理检查和放射科医生。这些结果表明,三维 Resnet 模型对准确识别头颈部癌症患者的 LNM + 很有价值。需要进行前瞻性试验,进一步评估三维 Resnet 模型在确定头颈部癌症患者 LNM + 中的作用及其对治疗策略和患者预后的影响。
{"title":"Development and Validation of a 3D Resnet Model for Prediction of Lymph Node Metastasis in Head and Neck Cancer Patients","authors":"Yi-Hui Lin, Chieh-Ting Lin, Ya-Han Chang, Yen-Yu Lin, Jen-Jee Chen, Chun-Rong Huang, Yu-Wei Hsu, Weir-Chiang You","doi":"10.1007/s10278-023-00938-2","DOIUrl":"https://doi.org/10.1007/s10278-023-00938-2","url":null,"abstract":"<p>The accurate diagnosis and staging of lymph node metastasis (LNM) are crucial for determining the optimal treatment strategy for head and neck cancer patients. We aimed to develop a 3D Resnet model and investigate its prediction value in detecting LNM. This study enrolled 156 head and neck cancer patients and analyzed 342 lymph nodes segmented from surgical pathologic reports. The patients’ clinical and pathological data related to the primary tumor site and clinical and pathology T and N stages were collected. To predict LNM, we developed a dual-pathway 3D Resnet model incorporating two Resnet models with different depths to extract features from the input data. To assess the model’s performance, we compared its predictions with those of radiologists in a test dataset comprising 38 patients. The study found that the dimensions and volume of LNM + were significantly larger than those of LNM-. Specifically, the <i>Y</i> and <i>Z</i> dimensions showed the highest sensitivity of 84.6% and specificity of 72.2%, respectively, in predicting LNM + . The analysis of various variations of the proposed 3D Resnet model demonstrated that Dual-3D-Resnet models with a depth of 34 achieved the highest AUC values of 0.9294. In the validation test of 38 patients and 86 lymph nodes dataset, the 3D Resnet model outperformed both physical examination and radiologists in terms of sensitivity (80.8% compared to 50.0% and 91.7%, respectively), specificity(90.0% compared to 88.5% and 65.4%, respectively), and positive predictive value (77.8% compared to 66.7% and 55.0%, respectively) in detecting individual LNM + . These results suggest that the 3D Resnet model can be valuable for accurately identifying LNM + in head and neck cancer patients. A prospective trial is needed to evaluate further the role of the 3D Resnet model in determining LNM + in head and neck cancer patients and its impact on treatment strategies and patient outcomes.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"25 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139495849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Lightweight Attentive Graph Neural Network with Conditional Random Field for Diagnosis of Anterior Cruciate Ligament Tear 利用条件随机场诊断前十字韧带撕裂的轻量级注意力图神经网络
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-16 DOI: 10.1007/s10278-023-00944-4
Jiaoju Wang, Jiewen Luo, Jiehui Liang, Yangbo Cao, Jing Feng, Lingjie Tan, Zhengcheng Wang, Jingming Li, Alphonse Houssou Hounye, Muzhou Hou, Jinshen He

Anterior cruciate ligament (ACL) tears are prevalent orthopedic sports injuries and are difficult to precisely classify. Previous works have demonstrated the ability of deep learning (DL) to provide support for clinicians in ACL tear classification scenarios, but it requires a large quantity of labeled samples and incurs a high computational expense. This study aims to overcome the challenges brought by small and imbalanced data and achieve fast and accurate ACL tear classification based on magnetic resonance imaging (MRI) of the knee. We propose a lightweight attentive graph neural network (GNN) with a conditional random field (CRF), named the ACGNN, to classify ACL ruptures in knee MR images. A metric-based meta-learning strategy is introduced to conduct independent testing through multiple node classification tasks. We design a lightweight feature embedding network using a feature-based knowledge distillation method to extract features from the given images. Then, GNN layers are used to find the dependencies between samples and complete the classification process. The CRF is incorporated into each GNN layer to refine the affinities. To mitigate oversmoothing and overfitting issues, we apply self-boosting attention, node attention, and memory attention for graph initialization, node updating, and correlation across graph layers, respectively. Experiments demonstrated that our model provided excellent performance on both oblique coronal data and sagittal data with accuracies of 92.94% and 91.92%, respectively. Notably, our proposed method exhibited comparable performance to that of orthopedic surgeons during an internal clinical validation. This work shows the potential of our method to advance ACL diagnosis and facilitates the development of computer-aided diagnosis methods for use in clinical practice.

前交叉韧带(ACL)撕裂是一种常见的骨科运动损伤,很难精确分类。之前的研究已经证明了深度学习(DL)在前交叉韧带撕裂分类场景中为临床医生提供支持的能力,但它需要大量的标注样本,并产生较高的计算费用。本研究旨在克服小数据和不平衡数据带来的挑战,实现基于膝关节磁共振成像(MRI)的快速、准确的前交叉韧带撕裂分类。我们提出了一种带有条件随机场(CRF)的轻量级殷勤图神经网络(GNN),命名为 ACGNN,用于对膝关节磁共振图像中的前交叉韧带断裂进行分类。我们引入了一种基于度量的元学习策略,通过多个节点分类任务进行独立测试。我们设计了一个轻量级特征嵌入网络,使用基于特征的知识提炼方法从给定图像中提取特征。然后,利用 GNN 层找到样本之间的依赖关系,完成分类过程。CRF 被纳入每个 GNN 层,以完善亲缘关系。为了缓解过平滑和过拟合问题,我们在图初始化、节点更新和图层间相关性时分别应用了自增强注意力、节点注意力和记忆注意力。实验表明,我们的模型在斜冠状面数据和矢状面数据上都表现出色,准确率分别为 92.94% 和 91.92%。值得注意的是,我们提出的方法在内部临床验证中表现出了与骨科医生相当的性能。这项工作显示了我们的方法在推进前交叉韧带诊断方面的潜力,并促进了用于临床实践的计算机辅助诊断方法的发展。
{"title":"Lightweight Attentive Graph Neural Network with Conditional Random Field for Diagnosis of Anterior Cruciate Ligament Tear","authors":"Jiaoju Wang, Jiewen Luo, Jiehui Liang, Yangbo Cao, Jing Feng, Lingjie Tan, Zhengcheng Wang, Jingming Li, Alphonse Houssou Hounye, Muzhou Hou, Jinshen He","doi":"10.1007/s10278-023-00944-4","DOIUrl":"https://doi.org/10.1007/s10278-023-00944-4","url":null,"abstract":"<p>Anterior cruciate ligament (ACL) tears are prevalent orthopedic sports injuries and are difficult to precisely classify. Previous works have demonstrated the ability of deep learning (DL) to provide support for clinicians in ACL tear classification scenarios, but it requires a large quantity of labeled samples and incurs a high computational expense. This study aims to overcome the challenges brought by small and imbalanced data and achieve fast and accurate ACL tear classification based on magnetic resonance imaging (MRI) of the knee. We propose a lightweight attentive graph neural network (GNN) with a conditional random field (CRF), named the ACGNN, to classify ACL ruptures in knee MR images. A metric-based meta-learning strategy is introduced to conduct independent testing through multiple node classification tasks. We design a lightweight feature embedding network using a feature-based knowledge distillation method to extract features from the given images. Then, GNN layers are used to find the dependencies between samples and complete the classification process. The CRF is incorporated into each GNN layer to refine the affinities. To mitigate oversmoothing and overfitting issues, we apply self-boosting attention, node attention, and memory attention for graph initialization, node updating, and correlation across graph layers, respectively. Experiments demonstrated that our model provided excellent performance on both oblique coronal data and sagittal data with accuracies of 92.94% and 91.92%, respectively. Notably, our proposed method exhibited comparable performance to that of orthopedic surgeons during an internal clinical validation. This work shows the potential of our method to advance ACL diagnosis and facilitates the development of computer-aided diagnosis methods for use in clinical practice.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"3 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139497352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Segmentation of Multiple Types of Uterine Lesions in Magnetic Resonance Images Using a Sequential Deep Learning Method with Image-Level Annotations 使用带图像级注释的序列深度学习方法分割磁共振图像中的多种类型子宫病变
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-16 DOI: 10.1007/s10278-023-00931-9
Yu-meng Cui, Hua-li Wang, Rui Cao, Hong Bai, Dan Sun, Jiu-xiang Feng, Xue-feng Lu

Fully supervised medical image segmentation methods use pixel-level labels to achieve good results, but obtaining such large-scale, high-quality labels is cumbersome and time consuming. This study aimed to develop a weakly supervised model that only used image-level labels to achieve automatic segmentation of four types of uterine lesions and three types of normal tissues on magnetic resonance images. The MRI data of the patients were retrospectively collected from the database of our institution, and the T2-weighted sequence images were selected and only image-level annotations were made. The proposed two-stage model can be divided into four sequential parts: the pixel correlation module, the class re-activation map module, the inter-pixel relation network module, and the Deeplab v3 + module. The dice similarity coefficient (DSC), the Hausdorff distance (HD), and the average symmetric surface distance (ASSD) were employed to evaluate the performance of the model. The original dataset consisted of 85,730 images from 316 patients with four different types of lesions (i.e., endometrial cancer, uterine leiomyoma, endometrial polyps, and atypical hyperplasia of endometrium). A total number of 196, 57, and 63 patients were randomly selected for model training, validation, and testing. After being trained from scratch, the proposed model showed a good segmentation performance with an average DSC of 83.5%, HD of 29.3 mm, and ASSD of 8.83 mm, respectively. As far as the weakly supervised methods using only image-level labels are concerned, the performance of the proposed model is equivalent to the state-of-the-art weakly supervised methods.

全监督医学影像分割方法使用像素级标签来实现良好的效果,但获得这种大规模、高质量的标签既麻烦又耗时。本研究旨在开发一种仅使用图像级标签的弱监督模型,以实现磁共振图像上四类子宫病变和三类正常组织的自动分割。患者的磁共振成像数据是从本院的数据库中回顾性收集的,选取T2加权序列图像,仅进行图像级标注。所提出的两阶段模型可分为四个连续部分:像素相关性模块、类再激活图模块、像素间关系网络模块和 Deeplab v3 + 模块。模型的性能评估采用了骰子相似系数(DSC)、豪斯多夫距离(HD)和平均对称面距离(ASSD)。原始数据集包括来自 316 名患者的 85,730 张图像,这些患者有四种不同类型的病变(即子宫内膜癌、子宫肌瘤、子宫内膜息肉和子宫内膜非典型增生)。共随机抽取了 196、57 和 63 名患者进行模型训练、验证和测试。经过从头开始的训练后,提出的模型显示出良好的分割性能,平均 DSC 为 83.5%,HD 为 29.3 mm,ASSD 为 8.83 mm。就仅使用图像级标签的弱监督方法而言,所提模型的性能与最先进的弱监督方法相当。
{"title":"The Segmentation of Multiple Types of Uterine Lesions in Magnetic Resonance Images Using a Sequential Deep Learning Method with Image-Level Annotations","authors":"Yu-meng Cui, Hua-li Wang, Rui Cao, Hong Bai, Dan Sun, Jiu-xiang Feng, Xue-feng Lu","doi":"10.1007/s10278-023-00931-9","DOIUrl":"https://doi.org/10.1007/s10278-023-00931-9","url":null,"abstract":"<p>Fully supervised medical image segmentation methods use pixel-level labels to achieve good results, but obtaining such large-scale, high-quality labels is cumbersome and time consuming. This study aimed to develop a weakly supervised model that only used image-level labels to achieve automatic segmentation of four types of uterine lesions and three types of normal tissues on magnetic resonance images. The MRI data of the patients were retrospectively collected from the database of our institution, and the T2-weighted sequence images were selected and only image-level annotations were made. The proposed two-stage model can be divided into four sequential parts: the pixel correlation module, the class re-activation map module, the inter-pixel relation network module, and the Deeplab v3 + module. The dice similarity coefficient (DSC), the Hausdorff distance (HD), and the average symmetric surface distance (ASSD) were employed to evaluate the performance of the model. The original dataset consisted of 85,730 images from 316 patients with four different types of lesions (i.e., endometrial cancer, uterine leiomyoma, endometrial polyps, and atypical hyperplasia of endometrium). A total number of 196, 57, and 63 patients were randomly selected for model training, validation, and testing. After being trained from scratch, the proposed model showed a good segmentation performance with an average DSC of 83.5%, HD of 29.3 mm, and ASSD of 8.83 mm, respectively. As far as the weakly supervised methods using only image-level labels are concerned, the performance of the proposed model is equivalent to the state-of-the-art weakly supervised methods.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"120 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139497351","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing the Lung Graph-Based Machine Learning Model for Identification of Fibrotic Interstitial Lung Diseases 开发基于肺图的机器学习模型,用于识别纤维化间质性肺病
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-16 DOI: 10.1007/s10278-023-00909-7
Haishuang Sun, Min Liu, Anqi Liu, Mei Deng, Xiaoyan Yang, Han Kang, Ling Zhao, Yanhong Ren, Bingbing Xie, Rongguo Zhang, Huaping Dai

Accurate detection of fibrotic interstitial lung disease (f-ILD) is conducive to early intervention. Our aim was to develop a lung graph-based machine learning model to identify f-ILD. A total of 417 HRCTs from 279 patients with confirmed ILD (156 f-ILD and 123 non-f-ILD) were included in this study. A lung graph-based machine learning model based on HRCT was developed for aiding clinician to diagnose f-ILD. In this approach, local radiomics features were extracted from an automatically generated geometric atlas of the lung and used to build a series of specific lung graph models. Encoding these lung graphs, a lung descriptor was gained and became as a characterization of global radiomics feature distribution to diagnose f-ILD. The Weighted Ensemble model showed the best predictive performance in cross-validation. The classification accuracy of the model was significantly higher than that of the three radiologists at both the CT sequence level and the patient level. At the patient level, the diagnostic accuracy of the model versus radiologists A, B, and C was 0.986 (95% CI 0.959 to 1.000), 0.918 (95% CI 0.849 to 0.973), 0.822 (95% CI 0.726 to 0.904), and 0.904 (95% CI 0.836 to 0.973), respectively. There was a statistically significant difference in AUC values between the model and 3 physicians (p < 0.05). The lung graph-based machine learning model could identify f-ILD, and the diagnostic performance exceeded radiologists which could aid clinicians to assess ILD objectively.

Graphical Abstract

Given a sequence of HRCT slices from a patient, the lung field is first automatically extracted. Next, this lung region is divided into 36 sub-regions using geometric rules, obtaining a lung atlas. And then, the lung graph is built based on 3D radiomics features of each sub-region of the lung atlas. Finally, the model’s predictions were compared to the physicians’ assessment results.

准确检测纤维化间质性肺病(f-ILD)有利于早期干预。我们的目的是开发一种基于肺图的机器学习模型来识别 f-ILD。本研究共纳入了 279 例确诊 ILD 患者(156 例 f-ILD 和 123 例非 f-ILD)的 417 例 HRCT。基于HRCT的肺图机器学习模型被开发出来,以帮助临床医生诊断f-ILD。在这种方法中,从自动生成的肺部几何图谱中提取局部放射组学特征,并用于建立一系列特定的肺图模型。通过对这些肺图进行编码,可获得肺描述符,并将其作为诊断 f-ILD 的全局放射组学特征分布的表征。加权集合模型在交叉验证中表现出最佳预测性能。无论是在 CT 序列层面还是在患者层面,该模型的分类准确率都明显高于三位放射科医生的分类准确率。在患者层面,模型与放射科医生 A、B 和 C 的诊断准确率分别为 0.986(95% CI 0.959 至 1.000)、0.918(95% CI 0.849 至 0.973)、0.822(95% CI 0.726 至 0.904)和 0.904(95% CI 0.836 至 0.973)。该模型与 3 位医生的 AUC 值差异有统计学意义(P < 0.05)。基于肺图的机器学习模型可以识别f-ILD,其诊断性能超过放射科医生,有助于临床医生客观地评估ILD。然后,利用几何规则将该肺区划分为 36 个子区域,得到肺图谱。然后,根据肺图谱中每个子区域的三维放射组学特征建立肺图。最后,将模型的预测结果与医生的评估结果进行比较。
{"title":"Developing the Lung Graph-Based Machine Learning Model for Identification of Fibrotic Interstitial Lung Diseases","authors":"Haishuang Sun, Min Liu, Anqi Liu, Mei Deng, Xiaoyan Yang, Han Kang, Ling Zhao, Yanhong Ren, Bingbing Xie, Rongguo Zhang, Huaping Dai","doi":"10.1007/s10278-023-00909-7","DOIUrl":"https://doi.org/10.1007/s10278-023-00909-7","url":null,"abstract":"<p>Accurate detection of fibrotic interstitial lung disease (f-ILD) is conducive to early intervention. Our aim was to develop a lung graph-based machine learning model to identify f-ILD. A total of 417 HRCTs from 279 patients with confirmed ILD (156 f-ILD and 123 non-f-ILD) were included in this study. A lung graph-based machine learning model based on HRCT was developed for aiding clinician to diagnose f-ILD. In this approach, local radiomics features were extracted from an automatically generated geometric atlas of the lung and used to build a series of specific lung graph models. Encoding these lung graphs, a lung descriptor was gained and became as a characterization of global radiomics feature distribution to diagnose f-ILD. The Weighted Ensemble model showed the best predictive performance in cross-validation. The classification accuracy of the model was significantly higher than that of the three radiologists at both the CT sequence level and the patient level. At the patient level, the diagnostic accuracy of the model versus radiologists A, B, and C was 0.986 (95% CI 0.959 to 1.000), 0.918 (95% CI 0.849 to 0.973), 0.822 (95% CI 0.726 to 0.904), and 0.904 (95% CI 0.836 to 0.973), respectively. There was a statistically significant difference in AUC values between the model and 3 physicians (<i>p</i> &lt; 0.05). The lung graph-based machine learning model could identify f-ILD, and the diagnostic performance exceeded radiologists which could aid clinicians to assess ILD objectively.</p><h3 data-test=\"abstract-sub-heading\">Graphical Abstract</h3>\u0000<p>Given a sequence of HRCT slices from a patient, the lung field is first automatically extracted. Next, this lung region is divided into 36 sub-regions using geometric rules, obtaining a lung atlas. And then, the lung graph is built based on 3D radiomics features of each sub-region of the lung atlas. Finally, the model’s predictions were compared to the physicians’ assessment results.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"23 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139496105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Text Report Analysis to Identify Opportunities for Optimizing Target Selection for Chest Radiograph Artificial Intelligence Models 通过文本报告分析确定优化胸片人工智能模型目标选择的机会
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-12 DOI: 10.1007/s10278-023-00927-5
Carl Sabottke, Jason Lee, Alan Chiang, Bradley Spieler, Raza Mushtaq

Our goal was to analyze radiology report text for chest radiographs (CXRs) to identify imaging findings that have the most impact on report length and complexity. Identifying these imaging findings can highlight opportunities for designing CXR AI systems which increase radiologist efficiency. We retrospectively analyzed text from 210,025 MIMIC-CXR reports and 168,949 reports from our local institution collected from 2019 to 2022. Fifty-nine categories of imaging finding keywords were extracted from reports using natural language processing (NLP), and their impact on report length was assessed using linear regression with and without LASSO regularization. Regression was also used to assess the impact of additional factors contributing to report length, such as the signing radiologist and use of terms of perception. For modeling CXR report word counts with regression, mean coefficient of determination, R2, was 0.469 ± 0.001 for local reports and 0.354 ± 0.002 for MIMIC-CXR when considering only imaging finding keyword features. Mean R2 was significantly less at 0.067 ± 0.001 for local reports and 0.086 ± 0.002 for MIMIC-CXR, when only considering use of terms of perception. For a combined model for the local report data accounting for the signing radiologist, imaging finding keywords, and terms of perception, the mean R2 was 0.570 ± 0.002. With LASSO, highest value coefficients pertained to endotracheal tubes and pleural drains for local data and masses, nodules, and cavitary and cystic lesions for MIMIC-CXR. Natural language processing and regression analysis of radiology report textual data can highlight imaging targets for AI models which offer opportunities to bolster radiologist efficiency.

我们的目标是分析胸片(CXR)的放射学报告文本,找出对报告长度和复杂性影响最大的成像结果。找出这些成像结果可以突出设计 CXR AI 系统的机会,从而提高放射医师的效率。我们回顾性分析了从 2019 年到 2022 年收集的 210,025 份 MIMIC-CXR 报告和本地机构的 168,949 份报告的文本。我们使用自然语言处理(NLP)技术从报告中提取了59类成像发现关键词,并使用线性回归(带或不带LASSO正则化)评估了它们对报告长度的影响。回归还用于评估其他因素对报告长度的影响,如放射科医生的签名和感知术语的使用。在使用回归法对 CXR 报告字数建模时,仅考虑成像发现关键词特征时,本地报告的平均判定系数 R2 为 0.469 ± 0.001,MIMIC-CXR 的平均判定系数 R2 为 0.354 ± 0.002。仅考虑使用感知术语时,本地报告的平均 R2 为 0.067 ± 0.001,MIMIC-CXR 的平均 R2 为 0.086 ± 0.002。在本地报告数据的综合模型中,考虑到放射科医生签名、成像发现关键词和感知术语,平均 R2 为 0.570 ± 0.002。通过 LASSO,本地数据中气管插管和胸腔引流管的数值系数最高,MIMIC-CXR 中肿块、结节、腔隙性和囊性病变的数值系数最高。对放射学报告文本数据进行自然语言处理和回归分析可为人工智能模型突出成像目标,从而为提高放射科医生的工作效率提供机会。
{"title":"Text Report Analysis to Identify Opportunities for Optimizing Target Selection for Chest Radiograph Artificial Intelligence Models","authors":"Carl Sabottke, Jason Lee, Alan Chiang, Bradley Spieler, Raza Mushtaq","doi":"10.1007/s10278-023-00927-5","DOIUrl":"https://doi.org/10.1007/s10278-023-00927-5","url":null,"abstract":"<p>Our goal was to analyze radiology report text for chest radiographs (CXRs) to identify imaging findings that have the most impact on report length and complexity. Identifying these imaging findings can highlight opportunities for designing CXR AI systems which increase radiologist efficiency. We retrospectively analyzed text from 210,025 MIMIC-CXR reports and 168,949 reports from our local institution collected from 2019 to 2022. Fifty-nine categories of imaging finding keywords were extracted from reports using natural language processing (NLP), and their impact on report length was assessed using linear regression with and without LASSO regularization. Regression was also used to assess the impact of additional factors contributing to report length, such as the signing radiologist and use of terms of perception. For modeling CXR report word counts with regression, mean coefficient of determination, <i>R</i><sup>2</sup>, was 0.469 ± 0.001 for local reports and 0.354 ± 0.002 for MIMIC-CXR when considering only imaging finding keyword features. Mean <i>R</i><sup>2</sup> was significantly less at 0.067 ± 0.001 for local reports and 0.086 ± 0.002 for MIMIC-CXR, when only considering use of terms of perception. For a combined model for the local report data accounting for the signing radiologist, imaging finding keywords, and terms of perception, the mean <i>R</i><sup>2</sup> was 0.570 ± 0.002. With LASSO, highest value coefficients pertained to endotracheal tubes and pleural drains for local data and masses, nodules, and cavitary and cystic lesions for MIMIC-CXR. Natural language processing and regression analysis of radiology report textual data can highlight imaging targets for AI models which offer opportunities to bolster radiologist efficiency.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"34 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139463159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using the Textual Content of Radiological Reports to Detect Emerging Diseases: A Proof-of-Concept Study of COVID-19 利用放射报告的文本内容检测新发疾病:COVID-19 概念验证研究
IF 4.4 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2024-01-12 DOI: 10.1007/s10278-023-00949-z

Abstract

Changes in the content of radiological reports at population level could detect emerging diseases. Herein, we developed a method to quantify similarities in consecutive temporal groupings of radiological reports using natural language processing, and we investigated whether appearance of dissimilarities between consecutive periods correlated with the beginning of the COVID-19 pandemic in France. CT reports from 67,368 consecutive adults across 62 emergency departments throughout France between October 2019 and March 2020 were collected. Reports were vectorized using time frequency–inverse document frequency (TF-IDF) analysis on one-grams. For each successive 2-week period, we performed unsupervised clustering of the reports based on TF-IDF values and partition-around-medoids. Next, we assessed the similarities between this clustering and a clustering from two weeks before according to the average adjusted Rand index (AARI). Statistical analyses included (1) cross-correlation functions (CCFs) with the number of positive SARS-CoV-2 tests and advanced sanitary index for flu syndromes (ASI-flu, from open-source dataset), and (2) linear regressions of time series at different lags to understand the variations of AARI over time. Overall, 13,235 chest CT reports were analyzed. AARI was correlated with ASI-flu at lag = + 1, + 5, and + 6 weeks (P = 0.0454, 0.0121, and 0.0042, respectively) and with SARS-CoV-2 positive tests at lag = − 1 and 0 week (P = 0.0057 and 0.0001, respectively). In the best fit, AARI correlated with the ASI-flu with a lag of 2 weeks (P = 0.0026), SARS-CoV-2-positive tests in the same week (P < 0.0001) and their interaction (P < 0.0001) (adjusted R2 = 0.921). Thus, our method enables the automatic monitoring of changes in radiological reports and could help capturing disease emergence.

摘要 人口层面放射报告内容的变化可以发现新出现的疾病。在此,我们开发了一种利用自然语言处理量化放射报告连续时间分组相似性的方法,并研究了连续时间段之间出现的不相似性是否与法国 COVID-19 大流行的开始有关。我们收集了 2019 年 10 月至 2020 年 3 月期间全法国 62 个急诊科的 67368 份连续成人 CT 报告。报告采用时间频率-反向文档频率(TF-IDF)分析法对单克隆进行矢量化。对于每个连续两周的时间段,我们根据 TF-IDF 值和分区-around-medoids 对报告进行了无监督聚类。接下来,我们根据平均调整兰德指数(AARI)评估了该聚类与两周前的聚类之间的相似性。统计分析包括:(1)与 SARS-CoV-2 阳性检测次数和流感综合症高级卫生指数(ASI-flu,来自开源数据集)的交叉相关函数(CCFs);(2)对不同滞后期的时间序列进行线性回归,以了解 AARI 随时间的变化。总共分析了 13,235 份胸部 CT 报告。在滞后 = + 1、+ 5 和 + 6 周时,AARI 与 ASI-flu 相关(P = 0.0454、0.0121 和 0.0042),在滞后 = - 1 和 0 周时,AARI 与 SARS-CoV-2 阳性检测相关(P = 0.0057 和 0.0001)。在最佳拟合中,AARI 与滞后 2 周的 ASI-flu(P = 0.0026)、同一周的 SARS-CoV-2 阳性检测(P < 0.0001)以及它们之间的交互作用(P < 0.0001)相关(调整 R2 = 0.921)。因此,我们的方法能够自动监测放射报告的变化,有助于捕捉疾病的出现。
{"title":"Using the Textual Content of Radiological Reports to Detect Emerging Diseases: A Proof-of-Concept Study of COVID-19","authors":"","doi":"10.1007/s10278-023-00949-z","DOIUrl":"https://doi.org/10.1007/s10278-023-00949-z","url":null,"abstract":"<h3>Abstract</h3> <p>Changes in the content of radiological reports at population level could detect emerging diseases. Herein, we developed a method to quantify similarities in consecutive temporal groupings of radiological reports using natural language processing, and we investigated whether appearance of dissimilarities between consecutive periods correlated with the beginning of the COVID-19 pandemic in France. CT reports from 67,368 consecutive adults across 62 emergency departments throughout France between October 2019 and March 2020 were collected. Reports were vectorized using time frequency–inverse document frequency (TF-IDF) analysis on one-grams. For each successive 2-week period, we performed unsupervised clustering of the reports based on TF-IDF values and partition-around-medoids. Next, we assessed the similarities between this clustering and a clustering from two weeks before according to the average adjusted Rand index (AARI). Statistical analyses included (1) cross-correlation functions (CCFs) with the number of positive SARS-CoV-2 tests and advanced sanitary index for flu syndromes (ASI-flu, from open-source dataset), and (2) linear regressions of time series at different lags to understand the variations of AARI over time. Overall, 13,235 chest CT reports were analyzed. AARI was correlated with ASI-flu at lag = + 1, + 5, and + 6 weeks (<em>P</em> = 0.0454, 0.0121, and 0.0042, respectively) and with SARS-CoV-2 positive tests at lag = − 1 and 0 week (<em>P</em> = 0.0057 and 0.0001, respectively). In the best fit, AARI correlated with the ASI-flu with a lag of 2 weeks (<em>P</em> = 0.0026), SARS-CoV-2-positive tests in the same week (<em>P</em> &lt; 0.0001) and their interaction (<em>P</em> &lt; 0.0001) (adjusted <em>R</em><sup>2</sup> = 0.921). Thus, our method enables the automatic monitoring of changes in radiological reports and could help capturing disease emergence.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"45 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139463192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Digital Imaging
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1