首页 > 最新文献

Journal of Medical Imaging最新文献

英文 中文
Investigating the effect of adding comparisons with prior mammograms to standalone digital breast tomosynthesis screening. 调查与先前乳房x光片比较对独立数字乳房断层合成筛查的影响。
IF 1.9 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-03-24 DOI: 10.1117/1.JMI.12.S2.S22003
Pontus Timberg, Gustav Hellgren, Magnus Dustler, Anders Tingberg

Purpose: The purpose is to retrospectively investigate how the addition of prior and concurrent mammograms affects wide-angle digital breast tomosynthesis (DBT) screening false-positive recall rates, malignancy scoring, and recall agreement.

Approach: A total of 200 cases were selected from the Malmö Breast Tomosynthesis Screening Trial. They consist of 150 recalled cases [30 true positives (TPs), 120 false positives (FPs), and 50 healthy, non-recalled true-negative (TN) cases]. The positive cases were categorized based on being recalled by either DBT, digital mammography (DM), or both. Each case had DBT, synthetic mammography (SM), and DM (prior screening round) images. Five radiologists participated in a reading study where detection, risk of malignancy, and recall were assessed. They read each case twice, once using only DBT and once using DBT together with SM and DM priors.

Results: The results showed a significant reduction in recall rates for all FP categories, as well as for the TN cases, when adding SM and prior DM to DBT. This resulted also in a significant increase in recall agreement for these categories, with more of the negative cases being recalled by few or no readers. These categories were overall rated as appearing more malignant in the DBT reading arm. For the TP categories, there was a significant decrease in recalls for DM-recalled cancers ( p = 0.047 ), but no significant difference for DBT-recalled cancers ( p = 0.063 ), or DBT/DM-recalled cancers ( p = 0.208 ).

Conclusions: Similar to the documented effect of priors in DM screening, we suggest that added two-dimensional priors improve the specificity of DBT screening but may reduce the sensitivity.

目的:回顾性研究既往和并发乳房x线照片对广角数字乳腺断层合成(DBT)筛查假阳性回忆率、恶性肿瘤评分和回忆一致性的影响。方法:从Malmö乳腺断层合成筛查试验中选取200例病例。他们包括150例召回病例[30例真阳性(TPs), 120例假阳性(FPs)和50例健康,未召回的真阴性(TN)病例]。阳性病例根据DBT,数字乳房x线摄影(DM)或两者的召回进行分类。每个病例都有DBT,合成乳房x线摄影(SM)和DM(先前筛查轮)图像。五名放射科医生参加了一项阅读研究,评估了检测、恶性肿瘤风险和回忆。他们阅读每个病例两次,一次只使用DBT,一次使用DBT与SM和DM先验。结果:结果显示,当在DBT中加入SM和既往DM时,所有FP类别以及TN病例的召回率显著降低。这也导致这些类别的召回协议显著增加,更多的负面案例被很少或没有读者召回。这些类别总体上被认为在DBT阅读组中更恶性。对于TP类别,dm回忆的癌症召回率显著降低(p = 0.047),但DBT回忆的癌症召回率无显著差异(p = 0.063), DBT/ dm回忆的癌症召回率无显著差异(p = 0.208)。结论:与文献记载的先验在DM筛查中的作用类似,我们认为增加二维先验可以提高DBT筛查的特异性,但可能降低敏感性。
{"title":"Investigating the effect of adding comparisons with prior mammograms to standalone digital breast tomosynthesis screening.","authors":"Pontus Timberg, Gustav Hellgren, Magnus Dustler, Anders Tingberg","doi":"10.1117/1.JMI.12.S2.S22003","DOIUrl":"10.1117/1.JMI.12.S2.S22003","url":null,"abstract":"<p><strong>Purpose: </strong>The purpose is to retrospectively investigate how the addition of prior and concurrent mammograms affects wide-angle digital breast tomosynthesis (DBT) screening false-positive recall rates, malignancy scoring, and recall agreement.</p><p><strong>Approach: </strong>A total of 200 cases were selected from the Malmö Breast Tomosynthesis Screening Trial. They consist of 150 recalled cases [30 true positives (TPs), 120 false positives (FPs), and 50 healthy, non-recalled true-negative (TN) cases]. The positive cases were categorized based on being recalled by either DBT, digital mammography (DM), or both. Each case had DBT, synthetic mammography (SM), and DM (prior screening round) images. Five radiologists participated in a reading study where detection, risk of malignancy, and recall were assessed. They read each case twice, once using only DBT and once using DBT together with SM and DM priors.</p><p><strong>Results: </strong>The results showed a significant reduction in recall rates for all FP categories, as well as for the TN cases, when adding SM and prior DM to DBT. This resulted also in a significant increase in recall agreement for these categories, with more of the negative cases being recalled by few or no readers. These categories were overall rated as appearing more malignant in the DBT reading arm. For the TP categories, there was a significant decrease in recalls for DM-recalled cancers ( <math><mrow><mi>p</mi> <mo>=</mo> <mn>0.047</mn></mrow> </math> ), but no significant difference for DBT-recalled cancers ( <math><mrow><mi>p</mi> <mo>=</mo> <mn>0.063</mn></mrow> </math> ), or DBT/DM-recalled cancers ( <math><mrow><mi>p</mi> <mo>=</mo> <mn>0.208</mn></mrow> </math> ).</p><p><strong>Conclusions: </strong>Similar to the documented effect of priors in DM screening, we suggest that added two-dimensional priors improve the specificity of DBT screening but may reduce the sensitivity.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 Suppl 2","pages":"S22003"},"PeriodicalIF":1.9,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11931293/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143711591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the impact of image restoration in simulating higher dose mammography: effects on the detectability of microcalcifications across different sizes using model observer analysis. 探索图像恢复在模拟高剂量乳房x线摄影中的影响:使用模型观察者分析对不同大小的微钙化的可检测性的影响。
IF 1.9 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-06-18 DOI: 10.1117/1.JMI.12.S2.S22013
Renann F Brandão, Lucas E Soares, Lucas R Borges, Predrag R Bakic, Anders Tingberg, Marcelo A C Vieira

Purpose: Breast cancer is one of the leading causes of cancer-related deaths among women, and digital mammography plays a key role in screening and early detection. The radiation dose on mammographic exams directly influences image quality and radiologists' performance. We evaluate the impact of an image restoration pipeline-designed to simulate higher dose acquisitions-on the detectability of microcalcifications of various sizes in mammograms acquired at different radiation doses.

Approach: The restoration pipeline denoises the image using a Poisson-Gaussian noise model, combining it with the noisy image to achieve a signal-to-noise ratio comparable with an acquisition at twice the original dose. We created a database of images using a physical breast phantom at doses ranging from 50% to 200% of the standard dose. Clustered microcalcifications were computationally inserted into the phantom images. The channelized Hotelling observer was employed in a four-alternative forced-choice to evaluate the detectability of microcalcifications across different sizes and exposure levels.

Results: The restoration of low-dose images acquired at 75 % of the standard dose resulted in detectability levels comparable with those of images acquired at the standard dose. Moreover, images restored at the standard dose demonstrated detectability similar to those acquired at 160% of the nominal radiation dose, with no statistically significant differences.

Conclusions: We demonstrate the potential of an image restoration pipeline to simulate higher quality mammography images. The results indicate that reducing noise through denoising and restoration impacts the detectability of microcalcifications. This method improves image quality without hardware modifications or additional radiation exposure.

目的:乳腺癌是女性癌症相关死亡的主要原因之一,数字化乳房x光摄影在筛查和早期发现方面发挥着关键作用。乳房x光检查的辐射剂量直接影响图像质量和放射科医生的工作表现。我们评估了图像恢复管道(设计用于模拟高剂量获取)对在不同辐射剂量下获得的乳房x线照片中不同大小的微钙化的可检测性的影响。方法:恢复管道使用泊松-高斯噪声模型对图像进行降噪,并将其与噪声图像相结合,以获得与原始剂量两倍的采集相媲美的信噪比。我们创建了一个图像数据库,使用物理乳房假体,剂量从标准剂量的50%到200%不等。聚集的微钙化被计算插入到幻象图像中。采用通道化霍特林观察器进行四选项强制选择,以评估不同尺寸和暴露水平下微钙化的可检测性。结果:以标准剂量的~ 75%获得的低剂量图像的恢复导致可检测性水平与以标准剂量获得的图像相当。此外,在标准剂量下恢复的图像显示出与在标称辐射剂量的160%下获得的图像相似的可探测性,没有统计学上的显著差异。结论:我们展示了图像恢复管道模拟高质量乳房x线摄影图像的潜力。结果表明,通过去噪和恢复来降低噪声会影响微钙化的可检测性。这种方法可以提高图像质量,而无需修改硬件或增加辐射曝光。
{"title":"Exploring the impact of image restoration in simulating higher dose mammography: effects on the detectability of microcalcifications across different sizes using model observer analysis.","authors":"Renann F Brandão, Lucas E Soares, Lucas R Borges, Predrag R Bakic, Anders Tingberg, Marcelo A C Vieira","doi":"10.1117/1.JMI.12.S2.S22013","DOIUrl":"10.1117/1.JMI.12.S2.S22013","url":null,"abstract":"<p><strong>Purpose: </strong>Breast cancer is one of the leading causes of cancer-related deaths among women, and digital mammography plays a key role in screening and early detection. The radiation dose on mammographic exams directly influences image quality and radiologists' performance. We evaluate the impact of an image restoration pipeline-designed to simulate higher dose acquisitions-on the detectability of microcalcifications of various sizes in mammograms acquired at different radiation doses.</p><p><strong>Approach: </strong>The restoration pipeline denoises the image using a Poisson-Gaussian noise model, combining it with the noisy image to achieve a signal-to-noise ratio comparable with an acquisition at twice the original dose. We created a database of images using a physical breast phantom at doses ranging from 50% to 200% of the standard dose. Clustered microcalcifications were computationally inserted into the phantom images. The channelized Hotelling observer was employed in a four-alternative forced-choice to evaluate the detectability of microcalcifications across different sizes and exposure levels.</p><p><strong>Results: </strong>The restoration of low-dose images acquired at <math><mrow><mo>∼</mo> <mn>75</mn> <mo>%</mo></mrow> </math> of the standard dose resulted in detectability levels comparable with those of images acquired at the standard dose. Moreover, images restored at the standard dose demonstrated detectability similar to those acquired at 160% of the nominal radiation dose, with no statistically significant differences.</p><p><strong>Conclusions: </strong>We demonstrate the potential of an image restoration pipeline to simulate higher quality mammography images. The results indicate that reducing noise through denoising and restoration impacts the detectability of microcalcifications. This method improves image quality without hardware modifications or additional radiation exposure.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 Suppl 2","pages":"S22013"},"PeriodicalIF":1.9,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12175087/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144334186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hybrid simulation of breast CT for assessing microcalcification detectability. 评估乳腺CT微钙化检出率的混合模拟。
IF 1.9 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-07-03 DOI: 10.1117/1.JMI.12.S2.S22015
Su Hyun Lyu, Andrey Makeev, Dan Li, Andreu Badal, Andrew M Hernandez, John M Boone, Stephen J Glick

Purpose: Virtual imaging trials (VITs) are of interest for regulatory evaluation because they enable faster and more cost-effective evaluation of new imaging technologies than patient clinical trials. Our purpose is to develop a hybrid VIT methodology for breast computed tomography (CT) applications and use it to investigate microcalcification detectability.

Approach: Ray tracing was used to generate projection images of clusters of five microcalcifications which varied in diameter, chemical composition, and density. These simulated projection images were added to patient projection images acquired with the fourth-generation breast CT scanner from UC Davis (Doheny) and reconstructed using the Feldkamp filtered backprojection algorithm with varying apodization kernels. Volumes of interest and maximum intensity projections were extracted from the reconstructed volumes. Human observers (HOs) and deep learning model observers (DLMOs) were used to detect calcification clusters, and receiver operating characteristic curve analysis was used to analyze detection performance.

Results: DLMO detected 0.18-mm type I calcifications with AUC = 0.80 and 0.21 mm calcifications with AUC = 0.99 . HO performance was inferior to deep learning model observer performance, but both HO and DLMO detected 0.21-mm type I calcifications with AUC > 0.90 and 0.24-mm type I calcifications with near-perfect performance. Microcalcification clusters embedded in adipose tissue were more conspicuous than clusters embedded in fibroglandular tissue. There was superior detection performance for clusters located anteriorly within the breast compared with clusters located posteriorly within the breast.

Conclusions: A hybrid approach for virtual imaging trials shows promise for the assessment of imaging systems across a broad range of parameters.

目的:虚拟成像试验(VITs)对监管评估很有兴趣,因为它们能够比患者临床试验更快、更经济地评估新成像技术。我们的目的是开发一种用于乳腺计算机断层扫描(CT)应用的混合VIT方法,并使用它来研究微钙化的可检测性。方法:采用射线追踪技术生成5个微钙化簇的投影图像,这些微钙化簇的直径、化学成分和密度各不相同。这些模拟投影图像被添加到由加州大学戴维斯分校(Doheny)的第四代乳腺CT扫描仪获得的患者投影图像中,并使用具有不同apodization核的Feldkamp滤波反投影算法进行重建。从重建体中提取感兴趣的体块和最大强度投影。使用人类观察者(HOs)和深度学习模型观察者(DLMOs)检测钙化簇,并使用接收者工作特征曲线分析分析检测性能。结果:DLMO检测到0.18 mm的I型钙化,AUC = 0.80, 0.21 mm的钙化,AUC = 0.99。HO的性能不如深度学习模型观测器的性能,但HO和DLMO都检测到0.21 mm的I型钙化,AUC为0.90,0.24 mm的I型钙化,性能接近完美。嵌入脂肪组织的微钙化团簇比嵌入纤维腺组织的微钙化团簇更明显。与位于乳房后部的簇相比,位于乳房前部的簇具有更好的检测性能。结论:虚拟成像试验的混合方法显示了在广泛参数范围内评估成像系统的希望。
{"title":"Hybrid simulation of breast CT for assessing microcalcification detectability.","authors":"Su Hyun Lyu, Andrey Makeev, Dan Li, Andreu Badal, Andrew M Hernandez, John M Boone, Stephen J Glick","doi":"10.1117/1.JMI.12.S2.S22015","DOIUrl":"https://doi.org/10.1117/1.JMI.12.S2.S22015","url":null,"abstract":"<p><strong>Purpose: </strong>Virtual imaging trials (VITs) are of interest for regulatory evaluation because they enable faster and more cost-effective evaluation of new imaging technologies than patient clinical trials. Our purpose is to develop a hybrid VIT methodology for breast computed tomography (CT) applications and use it to investigate microcalcification detectability.</p><p><strong>Approach: </strong>Ray tracing was used to generate projection images of clusters of five microcalcifications which varied in diameter, chemical composition, and density. These simulated projection images were added to patient projection images acquired with the fourth-generation breast CT scanner from UC Davis (Doheny) and reconstructed using the Feldkamp filtered backprojection algorithm with varying apodization kernels. Volumes of interest and maximum intensity projections were extracted from the reconstructed volumes. Human observers (HOs) and deep learning model observers (DLMOs) were used to detect calcification clusters, and receiver operating characteristic curve analysis was used to analyze detection performance.</p><p><strong>Results: </strong>DLMO detected 0.18-mm type I calcifications with AUC = 0.80 and 0.21 mm calcifications with <math><mrow><mi>AUC</mi> <mo>=</mo> <mn>0.99</mn></mrow> </math> . HO performance was inferior to deep learning model observer performance, but both HO and DLMO detected 0.21-mm type I calcifications with <math><mrow><mi>AUC</mi> <mo>></mo> <mn>0.90</mn></mrow> </math> and 0.24-mm type I calcifications with near-perfect performance. Microcalcification clusters embedded in adipose tissue were more conspicuous than clusters embedded in fibroglandular tissue. There was superior detection performance for clusters located anteriorly within the breast compared with clusters located posteriorly within the breast.</p><p><strong>Conclusions: </strong>A hybrid approach for virtual imaging trials shows promise for the assessment of imaging systems across a broad range of parameters.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 Suppl 2","pages":"S22015"},"PeriodicalIF":1.9,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12225739/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144576688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Harmonizing 10,000 connectomes: site-invariant representation learning for multi-site analysis of network connectivity and cognitive impairment. 协调10,000个连接体:用于网络连接和认知障碍多站点分析的站点不变表示学习。
IF 1.7 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-11-05 DOI: 10.1117/1.JMI.12.6.064001
Nancy R Newlin, Michael E Kim, Praitayini Kanakaraj, Elyssa McMaster, Chloe Cho, Chenyu Gao, Timothy J Hohman, Lori Beason-Held, Susan M Resnick, Sid E O'Bryant, Nicole Phillips, Robert C Barber, David A Bennett, Lisa L Barnes, Sarah Biber, Sterling Johnson, Derek Archer, Zhiyuan Li, Lianrui Zuo, Daniel Moyer, Bennett A Landman

Purpose: Data-driven harmonization can mitigate systematic confounding signals across imaging cohorts caused by variance in scanners and acquisition protocols. As diffusion magnetic resonance imaging data are often acquired with different hardware and software, harmonization is essential for integrating these scattered datasets into a cohesive analysis for improved statistical power. Large-scale, multi-site studies for Alzheimer's disease (AD), a neurodegenerative condition characterized by high data variability and complex pathology, pose the challenge of both site-based and biological variation.

Approach: We learn lower-dimensional representations of structural connectivity invariant to imaging cohort, geographical location, scanner, and acquisition factors. We design a conditional variational autoencoder that creates latent representations with minimal information about imaging factors and maximal information related to patient cognitive status. With this model, we consolidate 9 cohorts and 35 unique imaging acquisitions (for a total of 38 imaging "sites") into a cohesive dataset of 6956 persons (16.4% with mild cognitive impairment and 10.7% with AD) imaged for 1 to 16 sessions for a total of 11,927 diffusion-weighted imaging sessions.

Results: These site-invariant representations successfully remove significant ( p < 0.05 ) site effects in 12 network connectivity measures of interest and enhance the prediction of cognitive diagnosis (from 68% accuracy to 73% accuracy).

Conclusions: The proposed model yields reproducible precision across 15 data configurations. This approach demonstrates the effectiveness of representation learning in enhancing biological signals by mitigating acquisition-specific confounding factors in neuroimaging studies.

目的:数据驱动的协调可以减轻由扫描仪和采集协议差异引起的成像队列之间的系统混淆信号。由于扩散磁共振成像数据通常是通过不同的硬件和软件获得的,因此协调对于将这些分散的数据集整合到一个内聚分析中以提高统计能力至关重要。阿尔茨海默病(AD)是一种神经退行性疾病,其特征是高数据变异性和复杂的病理,其大规模、多位点研究对基于位点和生物学变异的研究提出了挑战。方法:我们学习结构连通性不变的低维表示与成像队列、地理位置、扫描仪和采集因素有关。我们设计了一个条件变分自编码器,该编码器以最小的成像因素信息和最大的与患者认知状态相关的信息创建潜在表征。通过该模型,我们将9个队列和35个独特的成像采集(总共38个成像“点”)整合到一个包含6956人(16.4%患有轻度认知障碍,10.7%患有AD)的内聚数据集中,对1至16次成像,共计11,927次弥散加权成像。结果:这些位点不变表示成功地消除了12个感兴趣的网络连接测量中的显著(p 0.05)位点效应,并增强了认知诊断的预测(准确率从68%提高到73%)。结论:提出的模型在15个数据配置中具有可重复的精度。这种方法证明了表征学习在神经影像学研究中通过减轻获取特异性混淆因素来增强生物信号的有效性。
{"title":"Harmonizing 10,000 connectomes: site-invariant representation learning for multi-site analysis of network connectivity and cognitive impairment.","authors":"Nancy R Newlin, Michael E Kim, Praitayini Kanakaraj, Elyssa McMaster, Chloe Cho, Chenyu Gao, Timothy J Hohman, Lori Beason-Held, Susan M Resnick, Sid E O'Bryant, Nicole Phillips, Robert C Barber, David A Bennett, Lisa L Barnes, Sarah Biber, Sterling Johnson, Derek Archer, Zhiyuan Li, Lianrui Zuo, Daniel Moyer, Bennett A Landman","doi":"10.1117/1.JMI.12.6.064001","DOIUrl":"10.1117/1.JMI.12.6.064001","url":null,"abstract":"<p><strong>Purpose: </strong>Data-driven harmonization can mitigate systematic confounding signals across imaging cohorts caused by variance in scanners and acquisition protocols. As diffusion magnetic resonance imaging data are often acquired with different hardware and software, harmonization is essential for integrating these scattered datasets into a cohesive analysis for improved statistical power. Large-scale, multi-site studies for Alzheimer's disease (AD), a neurodegenerative condition characterized by high data variability and complex pathology, pose the challenge of both site-based and biological variation.</p><p><strong>Approach: </strong>We learn lower-dimensional representations of structural connectivity invariant to imaging cohort, geographical location, scanner, and acquisition factors. We design a conditional variational autoencoder that creates latent representations with minimal information about imaging factors and maximal information related to patient cognitive status. With this model, we consolidate 9 cohorts and 35 unique imaging acquisitions (for a total of 38 imaging \"sites\") into a cohesive dataset of 6956 persons (16.4% with mild cognitive impairment and 10.7% with AD) imaged for 1 to 16 sessions for a total of 11,927 diffusion-weighted imaging sessions.</p><p><strong>Results: </strong>These site-invariant representations successfully remove significant ( <math><mrow><mi>p</mi> <mo><</mo> <mn>0.05</mn></mrow> </math> ) site effects in 12 network connectivity measures of interest and enhance the prediction of cognitive diagnosis (from 68% accuracy to 73% accuracy).</p><p><strong>Conclusions: </strong>The proposed model yields reproducible precision across 15 data configurations. This approach demonstrates the effectiveness of representation learning in enhancing biological signals by mitigating acquisition-specific confounding factors in neuroimaging studies.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 6","pages":"064001"},"PeriodicalIF":1.7,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12594104/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145483388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Img2ST-Net: efficient high-resolution spatial omics prediction from whole-slide histology images via fully convolutional image-to-image learning. Img2ST-Net:通过全卷积图像到图像学习,从整个切片组织学图像中进行高效的高分辨率空间组学预测。
IF 1.7 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-11-07 DOI: 10.1117/1.JMI.12.6.061410
Junchao Zhu, Ruining Deng, Junlin Guo, Tianyuan Yao, Juming Xiong, Chongyu Qu, Mengmeng Yin, Yu Wang, Shilin Zhao, Haichun Yang, Daguang Xu, Yucheng Tang, Yuankai Huo
<p><strong>Purpose: </strong>Recent advances in multimodal artificial intelligence (AI) have demonstrated promising potential for generating the currently expensive spatial transcriptomics (ST) data directly from routine histology images, offering a means to reduce the high cost and time-intensive nature of ST data acquisition. However, the increasing resolution of ST-particularly with platforms such as Visium HD achieving <math><mrow><mn>8</mn> <mtext>  </mtext> <mi>μ</mi> <mi>m</mi></mrow> </math> or finer-introduces significant computational and modeling challenges. Conventional spot-by-spot sequential regression frameworks become inefficient and unstable at this scale, whereas the inherent extreme sparsity and low expression levels of high-resolution ST further complicate both prediction and evaluation.</p><p><strong>Approach: </strong>To address these limitations, we propose Img2ST-Net, a high-definition (HD) histology-to-ST generation framework for efficient and parallel high-resolution ST prediction. Unlike conventional spot-by-spot inference methods, Img2ST-Net employs a fully convolutional architecture to generate dense, HD gene expression maps in a parallelized manner. By modeling HD ST data as super-pixel representations, the task is reformulated from image-to-omics inference into a super-content image generation problem with hundreds or thousands of output channels. This design not only improves computational efficiency but also better preserves the spatial organization intrinsic to spatial omics data. To enhance robustness under sparse expression patterns, we further introduce SSIM-ST, a structural-similarity-based evaluation metric tailored for high-resolution ST analysis.</p><p><strong>Results: </strong>Evaluations on two public Visium HD datasets at 8 and <math><mrow><mn>16</mn> <mtext>  </mtext> <mi>μ</mi> <mi>m</mi></mrow> </math> resolutions demonstrate that Img2ST-Net outperforms state-of-the-art methods in both accuracy and spatial coherence. On the Breast Cancer dataset at <math><mrow><mn>16</mn> <mtext>  </mtext> <mi>μ</mi> <mi>m</mi></mrow> </math> , Img2ST-Net achieves a mean squared error (MSE) of 0.1657 and a structural similarity index of 0.0937, whereas on the Colorectal Cancer dataset, it reaches an MSE of 0.7981 and a mean absolute error of 0.5208. These results highlight its ability to capture fine-grained gene expression patterns. In addition, our region-wise modeling significantly reduces training time without sacrificing performance, achieving up to 28-fold acceleration over conventional spot-wise methods. Ablation studies further validate the contribution of contrastive learning in enhancing spatial fidelity. The source code has been made publicly available at https://github.com/hrlblab/Img2ST-Net.</p><p><strong>Conclusions: </strong>We present a scalable, biologically coherent framework for high-resolution ST prediction. Img2ST-Net offers a principled solution for efficient and accurate ST inference at scale.
目的:多模式人工智能(AI)的最新进展表明,它有潜力直接从常规组织学图像中生成目前昂贵的空间转录组学(ST)数据,为降低ST数据采集的高成本和时间密集型提供了一种手段。然而,st分辨率的不断提高,特别是在Visium HD等平台达到8 μ m或更细的情况下,带来了重大的计算和建模挑战。传统的逐点序列回归框架在这种尺度下变得低效和不稳定,而高分辨率温度固有的极端稀疏性和低表达水平进一步使预测和评估复杂化。方法:为了解决这些限制,我们提出了Img2ST-Net,这是一个用于高效并行高分辨率ST预测的高清(HD)组织学到ST生成框架。与传统的逐点推理方法不同,Img2ST-Net采用全卷积架构,以并行方式生成密集的HD基因表达图谱。通过将HD ST数据建模为超像素表示,将任务从图像到组学的推理重新定义为具有数百或数千个输出通道的超级内容图像生成问题。这种设计不仅提高了计算效率,而且更好地保留了空间组学数据固有的空间组织。为了增强稀疏表达模式下的鲁棒性,我们进一步引入了SSIM-ST,这是一种为高分辨率ST分析量身定制的基于结构相似性的评估指标。结果:对8 μ m和16 μ m分辨率的两个公共Visium HD数据集的评估表明,Img2ST-Net在精度和空间相干性方面都优于最先进的方法。在16 μ m的乳腺癌数据集上,Img2ST-Net的均方误差(MSE)为0.1657,结构相似性指数为0.0937,而在结直肠癌数据集上,MSE为0.7981,平均绝对误差为0.5208。这些结果突出了它捕捉细粒度基因表达模式的能力。此外,我们的区域智能建模在不牺牲性能的情况下显著减少了训练时间,比传统的点智能方法实现了高达28倍的加速。消融研究进一步验证了对比学习在提高空间保真度方面的贡献。源代码已在https://github.com/hrlblab/Img2ST-Net.Conclusions上公开提供:我们提出了一个可扩展的、生物学上一致的高分辨率ST预测框架。Img2ST-Net为大规模高效准确的ST推断提供了原则性解决方案。我们的贡献为下一代具有鲁棒性和分辨率感知的ST建模奠定了基础。
{"title":"Img2ST-Net: efficient high-resolution spatial omics prediction from whole-slide histology images via fully convolutional image-to-image learning.","authors":"Junchao Zhu, Ruining Deng, Junlin Guo, Tianyuan Yao, Juming Xiong, Chongyu Qu, Mengmeng Yin, Yu Wang, Shilin Zhao, Haichun Yang, Daguang Xu, Yucheng Tang, Yuankai Huo","doi":"10.1117/1.JMI.12.6.061410","DOIUrl":"10.1117/1.JMI.12.6.061410","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Purpose: &lt;/strong&gt;Recent advances in multimodal artificial intelligence (AI) have demonstrated promising potential for generating the currently expensive spatial transcriptomics (ST) data directly from routine histology images, offering a means to reduce the high cost and time-intensive nature of ST data acquisition. However, the increasing resolution of ST-particularly with platforms such as Visium HD achieving &lt;math&gt;&lt;mrow&gt;&lt;mn&gt;8&lt;/mn&gt; &lt;mtext&gt;  &lt;/mtext&gt; &lt;mi&gt;μ&lt;/mi&gt; &lt;mi&gt;m&lt;/mi&gt;&lt;/mrow&gt; &lt;/math&gt; or finer-introduces significant computational and modeling challenges. Conventional spot-by-spot sequential regression frameworks become inefficient and unstable at this scale, whereas the inherent extreme sparsity and low expression levels of high-resolution ST further complicate both prediction and evaluation.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Approach: &lt;/strong&gt;To address these limitations, we propose Img2ST-Net, a high-definition (HD) histology-to-ST generation framework for efficient and parallel high-resolution ST prediction. Unlike conventional spot-by-spot inference methods, Img2ST-Net employs a fully convolutional architecture to generate dense, HD gene expression maps in a parallelized manner. By modeling HD ST data as super-pixel representations, the task is reformulated from image-to-omics inference into a super-content image generation problem with hundreds or thousands of output channels. This design not only improves computational efficiency but also better preserves the spatial organization intrinsic to spatial omics data. To enhance robustness under sparse expression patterns, we further introduce SSIM-ST, a structural-similarity-based evaluation metric tailored for high-resolution ST analysis.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;Evaluations on two public Visium HD datasets at 8 and &lt;math&gt;&lt;mrow&gt;&lt;mn&gt;16&lt;/mn&gt; &lt;mtext&gt;  &lt;/mtext&gt; &lt;mi&gt;μ&lt;/mi&gt; &lt;mi&gt;m&lt;/mi&gt;&lt;/mrow&gt; &lt;/math&gt; resolutions demonstrate that Img2ST-Net outperforms state-of-the-art methods in both accuracy and spatial coherence. On the Breast Cancer dataset at &lt;math&gt;&lt;mrow&gt;&lt;mn&gt;16&lt;/mn&gt; &lt;mtext&gt;  &lt;/mtext&gt; &lt;mi&gt;μ&lt;/mi&gt; &lt;mi&gt;m&lt;/mi&gt;&lt;/mrow&gt; &lt;/math&gt; , Img2ST-Net achieves a mean squared error (MSE) of 0.1657 and a structural similarity index of 0.0937, whereas on the Colorectal Cancer dataset, it reaches an MSE of 0.7981 and a mean absolute error of 0.5208. These results highlight its ability to capture fine-grained gene expression patterns. In addition, our region-wise modeling significantly reduces training time without sacrificing performance, achieving up to 28-fold acceleration over conventional spot-wise methods. Ablation studies further validate the contribution of contrastive learning in enhancing spatial fidelity. The source code has been made publicly available at https://github.com/hrlblab/Img2ST-Net.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;We present a scalable, biologically coherent framework for high-resolution ST prediction. Img2ST-Net offers a principled solution for efficient and accurate ST inference at scale. ","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 6","pages":"061410"},"PeriodicalIF":1.7,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12594103/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145483338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multiscale attention network with structure guidance for colorectal polyp segmentation. 基于结构导向的多尺度关注网络结肠直肠息肉分割。
IF 1.7 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-12-04 DOI: 10.1117/1.JMI.12.6.064004
Yang Yang, Jie Gao, Lanling Zeng, Xinsheng Wang, Xinyu Wang

Purpose: Accurate segmentation and precise delineation of colorectal polyp structures are crucial for early clinical diagnosis and treatment planning. However, existing polyp segmentation techniques face significant challenges due to the high variability in polyp size and morphology, as well as the frequent indistinctness of polyp-tissue structures.

Approach: To address these challenges, we propose a multiscale attention network with structure guidance (MAN-SG). The core of MAN-SG is a structure extraction module (SEM) designed to capture rich structural information from fine-grained early-stage encoder features. In addition, we introduce a cross-scale structure guided attention (CSGA) module that effectively fuses multiscale features under the guidance of the structural information provided by the SEM, thereby enabling more accurate delineation of polyp structures. MAN-SG is implemented and evaluated using two high-performance backbone networks: Res2Net-50 and PVTv2-B2.

Results: Extensive experiments were conducted on five benchmark datasets for polyp segmentation. The results demonstrate that MAN-SG consistently outperforms existing state-of-the-art methods across these datasets.

Conclusion: The proposed MAN-SG framework, which leverages structural guidance via SEM and CSGA modules, proves to be both highly effective and robust for the challenging task of colorectal polyp segmentation.

目的:结直肠息肉结构的准确分割和准确描绘对临床早期诊断和治疗方案的制定至关重要。然而,由于息肉大小和形态的高度可变性以及息肉组织结构的频繁不一致性,现有的息肉分割技术面临着重大挑战。方法:为了解决这些挑战,我们提出了一种带有结构引导的多尺度注意力网络(MAN-SG)。MAN-SG的核心是一个结构提取模块(SEM),旨在从细粒度的早期编码器特征中捕获丰富的结构信息。此外,我们引入了跨尺度结构引导注意(CSGA)模块,该模块在SEM提供的结构信息的指导下有效融合多尺度特征,从而更准确地描绘息肉结构。MAN-SG通过Res2Net-50和PVTv2-B2两个高性能骨干网实现和评估。结果:在5个基准数据集上进行了大量的息肉分割实验。结果表明,在这些数据集上,MAN-SG始终优于现有的最先进的方法。结论:本文提出的MAN-SG框架利用SEM和CSGA模块的结构引导,对于具有挑战性的结直肠息肉分割任务是高效且稳健的。
{"title":"Multiscale attention network with structure guidance for colorectal polyp segmentation.","authors":"Yang Yang, Jie Gao, Lanling Zeng, Xinsheng Wang, Xinyu Wang","doi":"10.1117/1.JMI.12.6.064004","DOIUrl":"https://doi.org/10.1117/1.JMI.12.6.064004","url":null,"abstract":"<p><strong>Purpose: </strong>Accurate segmentation and precise delineation of colorectal polyp structures are crucial for early clinical diagnosis and treatment planning. However, existing polyp segmentation techniques face significant challenges due to the high variability in polyp size and morphology, as well as the frequent indistinctness of polyp-tissue structures.</p><p><strong>Approach: </strong>To address these challenges, we propose a multiscale attention network with structure guidance (MAN-SG). The core of MAN-SG is a structure extraction module (SEM) designed to capture rich structural information from fine-grained early-stage encoder features. In addition, we introduce a cross-scale structure guided attention (CSGA) module that effectively fuses multiscale features under the guidance of the structural information provided by the SEM, thereby enabling more accurate delineation of polyp structures. MAN-SG is implemented and evaluated using two high-performance backbone networks: Res2Net-50 and PVTv2-B2.</p><p><strong>Results: </strong>Extensive experiments were conducted on five benchmark datasets for polyp segmentation. The results demonstrate that MAN-SG consistently outperforms existing state-of-the-art methods across these datasets.</p><p><strong>Conclusion: </strong>The proposed MAN-SG framework, which leverages structural guidance via SEM and CSGA modules, proves to be both highly effective and robust for the challenging task of colorectal polyp segmentation.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 6","pages":"064004"},"PeriodicalIF":1.7,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12674953/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145679134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Quantification-based explainable artificial intelligence for deep learning decisions: clustering and visualization of quantitative morphometric features in hepatocellular carcinoma discrimination. 基于定量的深度学习决策的可解释人工智能:肝细胞癌鉴别定量形态学特征的聚类和可视化。
IF 1.7 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-10-11 DOI: 10.1117/1.JMI.12.6.061407
Gen Takagi, Saori Takeyama, Tokiya Abe, Akinori Hashiguchi, Michiie Sakamoto, Kenji Suzuki, Masahiro Yamaguchi

Purpose: Deep learning (DL) is rapidly advancing in computational pathology, offering high diagnostic accuracy but often functioning as a "black box" with limited interpretability. This lack of transparency hinders its clinical adoption, emphasizing the need for quantitative explainable artificial intelligence (QXAI) methods. We propose a QXAI approach to objectively and quantitatively elucidate the reasoning behind DL model decisions in hepatocellular carcinoma (HCC) pathological image analysis.

Approach: The proposed method utilizes clustering in the latent space of embeddings generated by a DL model to identify regions that contribute to the model's discrimination. Each cluster is then quantitatively characterized by morphometric features obtained through nuclear segmentation using HoverNet and key feature selection with LightGBM. Statistical analysis is performed to assess the importance of selected features, ensuring an interpretable relationship between morphological characteristics and classification outcomes. This approach enables the quantitative interpretation of which regions and features are critical for the model's decision-making, without sacrificing accuracy.

Results: Experiments on pathology images of hematoxylin-and-eosin-stained HCC tissue sections showed that the proposed method effectively identified key discriminatory regions and features, such as nuclear size, chromatin density, and shape irregularity. The clustering-based analysis provided structured insights into morphological patterns influencing classification, with explanations evaluated as clinically relevant and interpretable by a pathologist.

Conclusions: Our QXAI framework enhances the interpretability of DL-based pathology analysis by linking morphological features to classification decisions. This fosters trust in DL models and facilitates their clinical integration.

目的:深度学习(DL)在计算病理学中迅速发展,提供高诊断准确性,但通常作为“黑匣子”,具有有限的可解释性。缺乏透明度阻碍了其临床应用,强调需要定量可解释的人工智能(QXAI)方法。我们提出了一种QXAI方法来客观和定量地阐明肝细胞癌(HCC)病理图像分析中DL模型决策背后的原因。方法:该方法利用深度学习模型生成的嵌入的潜在空间中的聚类来识别有助于模型识别的区域。然后通过HoverNet核分割和LightGBM关键特征选择获得的形态特征对每个聚类进行定量表征。进行统计分析以评估所选特征的重要性,确保形态特征和分类结果之间的可解释关系。这种方法能够定量解释哪些区域和特征对模型的决策至关重要,而不牺牲准确性。结果:苏木精和伊红染色的HCC组织切片病理图像实验表明,该方法可以有效识别出关键的区分区域和特征,如细胞核大小、染色质密度和形状不规则性。基于聚类的分析为影响分类的形态模式提供了结构化的见解,病理学家对其解释进行了临床相关和可解释的评估。结论:我们的QXAI框架通过将形态学特征与分类决策联系起来,增强了基于dl的病理分析的可解释性。这促进了对DL模型的信任,并促进了它们的临床整合。
{"title":"Quantification-based explainable artificial intelligence for deep learning decisions: clustering and visualization of quantitative morphometric features in hepatocellular carcinoma discrimination.","authors":"Gen Takagi, Saori Takeyama, Tokiya Abe, Akinori Hashiguchi, Michiie Sakamoto, Kenji Suzuki, Masahiro Yamaguchi","doi":"10.1117/1.JMI.12.6.061407","DOIUrl":"https://doi.org/10.1117/1.JMI.12.6.061407","url":null,"abstract":"<p><strong>Purpose: </strong>Deep learning (DL) is rapidly advancing in computational pathology, offering high diagnostic accuracy but often functioning as a \"black box\" with limited interpretability. This lack of transparency hinders its clinical adoption, emphasizing the need for quantitative explainable artificial intelligence (QXAI) methods. We propose a QXAI approach to objectively and quantitatively elucidate the reasoning behind DL model decisions in hepatocellular carcinoma (HCC) pathological image analysis.</p><p><strong>Approach: </strong>The proposed method utilizes clustering in the latent space of embeddings generated by a DL model to identify regions that contribute to the model's discrimination. Each cluster is then quantitatively characterized by morphometric features obtained through nuclear segmentation using HoverNet and key feature selection with LightGBM. Statistical analysis is performed to assess the importance of selected features, ensuring an interpretable relationship between morphological characteristics and classification outcomes. This approach enables the quantitative interpretation of which regions and features are critical for the model's decision-making, without sacrificing accuracy.</p><p><strong>Results: </strong>Experiments on pathology images of hematoxylin-and-eosin-stained HCC tissue sections showed that the proposed method effectively identified key discriminatory regions and features, such as nuclear size, chromatin density, and shape irregularity. The clustering-based analysis provided structured insights into morphological patterns influencing classification, with explanations evaluated as clinically relevant and interpretable by a pathologist.</p><p><strong>Conclusions: </strong>Our QXAI framework enhances the interpretability of DL-based pathology analysis by linking morphological features to classification decisions. This fosters trust in DL models and facilitates their clinical integration.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 6","pages":"061407"},"PeriodicalIF":1.7,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12513858/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145281599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Glo-In-One-v2: holistic identification of glomerular cells, tissues, and lesions in human and mouse histopathology. Glo-In-One-v2:人类和小鼠组织病理学肾小球细胞、组织和病变的整体鉴定。
IF 1.7 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-07-28 DOI: 10.1117/1.JMI.12.6.061406
Lining Yu, Mengmeng Yin, Ruining Deng, Quan Liu, Tianyuan Yao, Can Cui, Junlin Guo, Yu Wang, Yaohong Wang, Shilin Zhao, Haichun Yang, Yuankai Huo

Purpose: Segmenting intraglomerular tissue and glomerular lesions traditionally depends on detailed morphological evaluations by expert nephropathologists, a labor-intensive process susceptible to interobserver variability. Our group previously developed the Glo-In-One toolkit for integrated glomerulus detection and segmentation. We leverage the Glo-In-One toolkit to version 2 (Glo-In-One-v2), which adds fine-grained segmentation capabilities. We curated 14 distinct labels spanning tissue regions, cells, and lesions across 23,529 annotated glomeruli from human and mouse histopathology data. To our knowledge, this dataset is among the largest of its kind to date.

Approach: We present a single dynamic-head deep learning architecture for segmenting 14 classes within partially labeled images from human and mouse kidney pathology. The model was trained on data derived from 368 annotated kidney whole-slide images with five key intraglomerular tissue types and nine glomerular lesion types.

Results: The glomerulus segmentation model achieved a decent performance compared with baselines and achieved a 76.5% average Dice similarity coefficient. In addition, transfer learning from rodent to human for the glomerular lesion segmentation model has enhanced the average segmentation accuracy across different types of lesions by more than 3%, as measured by Dice scores.

Conclusions: We introduce a convolutional neural network for multiclass segmentation of intraglomerular tissue and lesions. The Glo-In-One-v2 model and pretrained weight are publicly available at https://github.com/hrlblab/Glo-In-One_v2.

目的:分割肾小球内组织和肾小球病变传统上依赖于肾病理学专家详细的形态学评估,这是一个劳动密集型的过程,容易受到观察者之间的差异。我们的团队之前开发了glo - one工具包,用于综合肾小球检测和分割。我们将gloo - in - one工具包利用到版本2 (gloo - in - one -v2),它增加了细粒度分段功能。我们整理了14个不同的标签,跨越组织区域、细胞和病变,涵盖23,529个来自人和小鼠组织病理学数据的注释肾小球。据我们所知,这个数据集是迄今为止同类数据集中最大的。方法:我们提出了一个单一的动态头部深度学习架构,用于分割来自人类和小鼠肾脏病理的部分标记图像中的14个类。该模型的训练数据来自368张带注释的肾脏全片图像,其中包括5种关键肾小球内组织类型和9种肾小球病变类型。结果:与基线相比,肾小球分割模型取得了较好的性能,平均Dice相似系数达到76.5%。此外,对于肾小球病变分割模型,从啮齿动物到人类的迁移学习将不同类型病变的平均分割准确率提高了3%以上(以Dice分数衡量)。结论:采用卷积神经网络对肾小球内组织和病变进行多分类分割。gloin - one -v2模型和预训练权重可在https://github.com/hrlblab/Glo-In-One_v2上公开获取。
{"title":"Glo-In-One-v2: holistic identification of glomerular cells, tissues, and lesions in human and mouse histopathology.","authors":"Lining Yu, Mengmeng Yin, Ruining Deng, Quan Liu, Tianyuan Yao, Can Cui, Junlin Guo, Yu Wang, Yaohong Wang, Shilin Zhao, Haichun Yang, Yuankai Huo","doi":"10.1117/1.JMI.12.6.061406","DOIUrl":"10.1117/1.JMI.12.6.061406","url":null,"abstract":"<p><strong>Purpose: </strong>Segmenting intraglomerular tissue and glomerular lesions traditionally depends on detailed morphological evaluations by expert nephropathologists, a labor-intensive process susceptible to interobserver variability. Our group previously developed the Glo-In-One toolkit for integrated glomerulus detection and segmentation. We leverage the Glo-In-One toolkit to version 2 (Glo-In-One-v2), which adds fine-grained segmentation capabilities. We curated 14 distinct labels spanning tissue regions, cells, and lesions across 23,529 annotated glomeruli from human and mouse histopathology data. To our knowledge, this dataset is among the largest of its kind to date.</p><p><strong>Approach: </strong>We present a single dynamic-head deep learning architecture for segmenting 14 classes within partially labeled images from human and mouse kidney pathology. The model was trained on data derived from 368 annotated kidney whole-slide images with five key intraglomerular tissue types and nine glomerular lesion types.</p><p><strong>Results: </strong>The glomerulus segmentation model achieved a decent performance compared with baselines and achieved a 76.5% average Dice similarity coefficient. In addition, transfer learning from rodent to human for the glomerular lesion segmentation model has enhanced the average segmentation accuracy across different types of lesions by more than 3%, as measured by Dice scores.</p><p><strong>Conclusions: </strong>We introduce a convolutional neural network for multiclass segmentation of intraglomerular tissue and lesions. The Glo-In-One-v2 model and pretrained weight are publicly available at https://github.com/hrlblab/Glo-In-One_v2.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 6","pages":"061406"},"PeriodicalIF":1.7,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12303538/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144733981","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Workload reduction of digital breast tomosynthesis screening using artificial intelligence and synthetic mammography: a simulation study. 使用人工智能和合成乳房x线照相术减少数字乳房断层合成筛查的工作量:一项模拟研究。
IF 1.9 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-04-30 DOI: 10.1117/1.JMI.12.S2.S22005
Victor Dahlblom, Magnus Dustler, Sophia Zackrisson, Anders Tingberg

Purpose: To achieve the high sensitivity of digital breast tomosynthesis (DBT), a time-consuming reading is necessary. However, synthetic mammography (SM) images, equivalent to digital mammography (DM), can be generated from DBT images. SM is faster to read and might be sufficient in many cases. We investigate using artificial intelligence (AI) to stratify examinations into reading of either SM or DBT to minimize workload and maximize accuracy.

Approach: This is a retrospective study based on double-read paired DM and one-view DBT from the Malmö Breast Tomosynthesis Screening Trial. DBT examinations were analyzed with the cancer detection AI system ScreenPoint Transpara 1.7. For low-risk examinations, SM reading was simulated by assuming equality with DM reading. For high-risk examinations, the DBT reading results were used. Different combinations of single and double reading were studied.

Results: By double-reading the DBT of 30% (4452/14,772) of the cases with the highest risk, and single-reading SM for the rest, 122 cancers would be detected with the same reading workload as DM double reading. That is 28% (27/95) more cancers would be detected than with DM double reading, and in total, 96% (122/127) of the cancers detectable with full DBT double reading would be found.

Conclusions: In a DBT-based screening program, AI could be used to select high-risk cases where the reading of DBT is valuable, whereas SM is sufficient for low-risk cases. Substantially, more cancers could be detected compared with DM only, with only a limited increase in reading workload. Prospective studies are necessary.

目的:为了实现数字乳腺断层合成(DBT)的高灵敏度,需要进行耗时的读取。然而,合成乳房x线摄影(SM)图像,相当于数字乳房x线摄影(DM),可以从DBT图像生成。SM的阅读速度更快,在许多情况下可能就足够了。我们研究使用人工智能(AI)将考试分为SM阅读或DBT阅读,以最大限度地减少工作量和提高准确性。方法:这是一项基于Malmö乳腺断层合成筛查试验的双读配对DM和单视图DBT的回顾性研究。采用癌症检测AI系统ScreenPoint Transpara 1.7对DBT检查进行分析。对于低风险检查,SM读数通过假设与DM读数相等来模拟。对于高危检查,采用DBT读数结果。研究了单读和双读的不同组合。结果:通过双读30%(4452/ 14772)高危患者的DBT,单读SM,在与DM双读工作量相同的情况下检出122例肿瘤。也就是说,与DM双读数相比,多28%(27/95)的癌症被检测到,而DBT全双读数检测到的癌症中,有96%(122/127)被发现。结论:在基于DBT的筛查项目中,人工智能可用于选择DBT读数有价值的高风险病例,而SM用于低风险病例就足够了。实际上,与DM相比,可以检测到更多的癌症,而阅读工作量仅增加有限。前瞻性研究是必要的。
{"title":"Workload reduction of digital breast tomosynthesis screening using artificial intelligence and synthetic mammography: a simulation study.","authors":"Victor Dahlblom, Magnus Dustler, Sophia Zackrisson, Anders Tingberg","doi":"10.1117/1.JMI.12.S2.S22005","DOIUrl":"10.1117/1.JMI.12.S2.S22005","url":null,"abstract":"<p><strong>Purpose: </strong>To achieve the high sensitivity of digital breast tomosynthesis (DBT), a time-consuming reading is necessary. However, synthetic mammography (SM) images, equivalent to digital mammography (DM), can be generated from DBT images. SM is faster to read and might be sufficient in many cases. We investigate using artificial intelligence (AI) to stratify examinations into reading of either SM or DBT to minimize workload and maximize accuracy.</p><p><strong>Approach: </strong>This is a retrospective study based on double-read paired DM and one-view DBT from the Malmö Breast Tomosynthesis Screening Trial. DBT examinations were analyzed with the cancer detection AI system ScreenPoint Transpara 1.7. For low-risk examinations, SM reading was simulated by assuming equality with DM reading. For high-risk examinations, the DBT reading results were used. Different combinations of single and double reading were studied.</p><p><strong>Results: </strong>By double-reading the DBT of 30% (4452/14,772) of the cases with the highest risk, and single-reading SM for the rest, 122 cancers would be detected with the same reading workload as DM double reading. That is 28% (27/95) more cancers would be detected than with DM double reading, and in total, 96% (122/127) of the cancers detectable with full DBT double reading would be found.</p><p><strong>Conclusions: </strong>In a DBT-based screening program, AI could be used to select high-risk cases where the reading of DBT is valuable, whereas SM is sufficient for low-risk cases. Substantially, more cancers could be detected compared with DM only, with only a limited increase in reading workload. Prospective studies are necessary.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 Suppl 2","pages":"S22005"},"PeriodicalIF":1.9,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12042222/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144003543","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparing percent breast density assessments of an AI-based method with expert reader estimates: inter-observer variability. 比较基于人工智能的方法与专家读者估计的乳腺密度百分比评估:观察者之间的可变性。
IF 1.9 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Pub Date : 2025-11-01 Epub Date: 2025-06-12 DOI: 10.1117/1.JMI.12.S2.S22011
Stepan Romanov, Sacha Howell, Elaine Harkness, Dafydd Gareth Evans, Sue Astley, Martin Fergie

Purpose: Breast density estimation is an important part of breast cancer risk assessment, as mammographic density is associated with risk. However, density assessed by multiple experts can be subject to high inter-observer variability, so automated methods are increasingly used. We investigate the inter-reader variability and risk prediction for expert assessors and a deep learning approach.

Approach: Screening data from a cohort of 1328 women, case-control matched, was used to compare between two expert readers and between a single reader and a deep learning model, Manchester artificial intelligence - visual analog scale (MAI-VAS). Bland-Altman analysis was used to assess the variability and matched concordance index to assess risk.

Results: Although the mean differences for the two experiments were alike, the limits of agreement between MAI-VAS and a single reader are substantially lower at +SD (standard deviation) 21 (95% CI: 19.65, 21.69) -SD 22 (95% CI: - 22.71 , - 20.68 ) than between two expert readers +SD 31 (95% CI: 32.08, 29.23) -SD 29 (95% CI: - 29.94 , - 27.09 ). In addition, breast cancer risk discrimination for the deep learning method and density readings from a single expert was similar, with a matched concordance of 0.628 (95% CI: 0.598, 0.658) and 0.624 (95% CI: 0.595, 0.654), respectively. The automatic method had a similar inter-view agreement to experts and maintained consistency across density quartiles.

Conclusions: The artificial intelligence breast density assessment tool MAI-VAS has a better inter-observer agreement with a randomly selected expert reader than that between two expert readers. Deep learning-based density methods provide consistent density scores without compromising on breast cancer risk discrimination.

目的:乳腺密度评估是乳腺癌风险评估的重要组成部分,因为乳房x线摄影密度与风险相关。然而,由多位专家评估的密度可能会受到观测者之间高度可变性的影响,因此越来越多地使用自动化方法。我们研究了专家评估和深度学习方法的读者间变异性和风险预测。方法:从1328名女性队列中筛选数据,病例对照匹配,用于比较两名专家读者之间以及单一读者与深度学习模型曼彻斯特人工智能-视觉模拟量表(MAI-VAS)之间的差异。采用Bland-Altman分析评估变异性,匹配一致性指数评估风险。结果:虽然两个实验的平均差异相似,但MAI-VAS和单个读者之间的一致性界限在+SD(标准差)21 (95% CI: 19.65, 21.69) -SD 22 (95% CI: - 22.71, - 20.68)明显低于两个专家读者+SD 31 (95% CI: 32.08, 29.23) -SD 29 (95% CI: - 29.94, - 27.09)。此外,深度学习方法与单个专家的密度读数的乳腺癌风险判别相似,匹配一致性分别为0.628 (95% CI: 0.598, 0.658)和0.624 (95% CI: 0.595, 0.654)。自动方法具有与专家相似的访谈观点一致性,并保持密度四分位数的一致性。结论:人工智能乳腺密度评估工具MAI-VAS与随机选择的专家阅读者之间的观察者间一致性优于两个专家阅读者之间的一致性。基于深度学习的密度方法在不影响乳腺癌风险歧视的情况下提供一致的密度分数。
{"title":"Comparing percent breast density assessments of an AI-based method with expert reader estimates: inter-observer variability.","authors":"Stepan Romanov, Sacha Howell, Elaine Harkness, Dafydd Gareth Evans, Sue Astley, Martin Fergie","doi":"10.1117/1.JMI.12.S2.S22011","DOIUrl":"10.1117/1.JMI.12.S2.S22011","url":null,"abstract":"<p><strong>Purpose: </strong>Breast density estimation is an important part of breast cancer risk assessment, as mammographic density is associated with risk. However, density assessed by multiple experts can be subject to high inter-observer variability, so automated methods are increasingly used. We investigate the inter-reader variability and risk prediction for expert assessors and a deep learning approach.</p><p><strong>Approach: </strong>Screening data from a cohort of 1328 women, case-control matched, was used to compare between two expert readers and between a single reader and a deep learning model, Manchester artificial intelligence - visual analog scale (MAI-VAS). Bland-Altman analysis was used to assess the variability and matched concordance index to assess risk.</p><p><strong>Results: </strong>Although the mean differences for the two experiments were alike, the limits of agreement between MAI-VAS and a single reader are substantially lower at +SD (standard deviation) 21 (95% CI: 19.65, 21.69) -SD 22 (95% CI: <math><mrow><mo>-</mo> <mn>22.71</mn></mrow> </math> , <math><mrow><mo>-</mo> <mn>20.68</mn></mrow> </math> ) than between two expert readers +SD 31 (95% CI: 32.08, 29.23) -SD 29 (95% CI: <math><mrow><mo>-</mo> <mn>29.94</mn></mrow> </math> , <math><mrow><mo>-</mo> <mn>27.09</mn></mrow> </math> ). In addition, breast cancer risk discrimination for the deep learning method and density readings from a single expert was similar, with a matched concordance of 0.628 (95% CI: 0.598, 0.658) and 0.624 (95% CI: 0.595, 0.654), respectively. The automatic method had a similar inter-view agreement to experts and maintained consistency across density quartiles.</p><p><strong>Conclusions: </strong>The artificial intelligence breast density assessment tool MAI-VAS has a better inter-observer agreement with a randomly selected expert reader than that between two expert readers. Deep learning-based density methods provide consistent density scores without compromising on breast cancer risk discrimination.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 Suppl 2","pages":"S22011"},"PeriodicalIF":1.9,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12159425/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144303313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Medical Imaging
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1