Aniwat Juhong, Bo Li, Yifan Liu, Chia-Wei Yang, Cheng-You Yao, Dalen W. Agnew, Yu Leo Lei, Gary D. Luker, Harvey Bumpers, Xuefei Huang, Wibool Piyawattanametha, Zhen Qiu
{"title":"Multihead Attention U-Net for Magnetic Particle Imaging–Computed Tomography Image Segmentation","authors":"Aniwat Juhong, Bo Li, Yifan Liu, Chia-Wei Yang, Cheng-You Yao, Dalen W. Agnew, Yu Leo Lei, Gary D. Luker, Harvey Bumpers, Xuefei Huang, Wibool Piyawattanametha, Zhen Qiu","doi":"10.1002/aisy.202400007","DOIUrl":null,"url":null,"abstract":"<p>Magnetic particle imaging (MPI) is an emerging noninvasive molecular imaging modality with high sensitivity and specificity, exceptional linear quantitative ability, and potential for successful applications in clinical settings. Computed tomography (CT) is typically combined with the MPI image to obtain more anatomical information. Herein, a deep learning-based approach for MPI-CT image segmentation is presented. The dataset utilized in training the proposed deep learning model is obtained from a transgenic mouse model of breast cancer following administration of indocyanine green (ICG)-conjugated superparamagnetic iron oxide nanoworms (NWs-ICG) as the tracer. The NWs-ICG particles progressively accumulate in tumors due to the enhanced permeability and retention (EPR) effect. The proposed deep learning model exploits the advantages of the multihead attention mechanism and the U-Net model to perform segmentation on the MPI-CT images, showing superb results. In addition, the model is characterized with a different number of attention heads to explore the optimal number for our custom MPI-CT dataset.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400007","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/aisy.202400007","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Magnetic particle imaging (MPI) is an emerging noninvasive molecular imaging modality with high sensitivity and specificity, exceptional linear quantitative ability, and potential for successful applications in clinical settings. Computed tomography (CT) is typically combined with the MPI image to obtain more anatomical information. Herein, a deep learning-based approach for MPI-CT image segmentation is presented. The dataset utilized in training the proposed deep learning model is obtained from a transgenic mouse model of breast cancer following administration of indocyanine green (ICG)-conjugated superparamagnetic iron oxide nanoworms (NWs-ICG) as the tracer. The NWs-ICG particles progressively accumulate in tumors due to the enhanced permeability and retention (EPR) effect. The proposed deep learning model exploits the advantages of the multihead attention mechanism and the U-Net model to perform segmentation on the MPI-CT images, showing superb results. In addition, the model is characterized with a different number of attention heads to explore the optimal number for our custom MPI-CT dataset.