Shahzad Ahmed , Feng Jinchao , Javed Ferzund , Muhammad Usman Ali , Muhammad Yaqub , Malik Abdul Manan , Atif Mehmood
{"title":"GraFMRI:基于图形的鲁棒性多模态磁共振成像重建融合框架。","authors":"Shahzad Ahmed , Feng Jinchao , Javed Ferzund , Muhammad Usman Ali , Muhammad Yaqub , Malik Abdul Manan , Atif Mehmood","doi":"10.1016/j.mri.2024.110279","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><div>This study introduces GraFMRI, a novel framework designed to address the challenges of reconstructing high-quality MRI images from undersampled k-space data. Traditional methods often suffer from noise amplification and loss of structural detail, leading to suboptimal image quality. GraFMRI leverages Graph Neural Networks (GNNs) to transform multi-modal MRI data (T1, T2, PD) into a graph-based representation, enabling the model to capture intricate spatial relationships and inter-modality dependencies.</div></div><div><h3>Methods</h3><div>The framework integrates Graph-Based Non-Local Means (NLM) Filtering for effective noise suppression and Adversarial Training to reduce artifacts. A dynamic attention mechanism enables the model to focus on key anatomical regions, even when fully-sampled reference images are unavailable. GraFMRI was evaluated on the IXI and fastMRI datasets using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) as metrics for reconstruction quality.</div></div><div><h3>Results</h3><div>GraFMRI consistently outperforms traditional and self-supervised reconstruction techniques. Significant improvements in multi-modal fusion were observed, with better preservation of information across modalities. Noise suppression through NLM filtering and artifact reduction via adversarial training led to higher PSNR and SSIM scores across both datasets. The dynamic attention mechanism further enhanced the accuracy of the reconstructions by focusing on critical anatomical regions.</div></div><div><h3>Conclusion</h3><div>GraFMRI provides a scalable, robust solution for multi-modal MRI reconstruction, addressing noise and artifact challenges while enhancing diagnostic accuracy. Its ability to fuse information from different MRI modalities makes it adaptable to various clinical applications, improving the quality and reliability of reconstructed images.</div></div>","PeriodicalId":18165,"journal":{"name":"Magnetic resonance imaging","volume":"116 ","pages":"Article 110279"},"PeriodicalIF":2.1000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"GraFMRI: A graph-based fusion framework for robust multi-modal MRI reconstruction\",\"authors\":\"Shahzad Ahmed , Feng Jinchao , Javed Ferzund , Muhammad Usman Ali , Muhammad Yaqub , Malik Abdul Manan , Atif Mehmood\",\"doi\":\"10.1016/j.mri.2024.110279\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Purpose</h3><div>This study introduces GraFMRI, a novel framework designed to address the challenges of reconstructing high-quality MRI images from undersampled k-space data. Traditional methods often suffer from noise amplification and loss of structural detail, leading to suboptimal image quality. GraFMRI leverages Graph Neural Networks (GNNs) to transform multi-modal MRI data (T1, T2, PD) into a graph-based representation, enabling the model to capture intricate spatial relationships and inter-modality dependencies.</div></div><div><h3>Methods</h3><div>The framework integrates Graph-Based Non-Local Means (NLM) Filtering for effective noise suppression and Adversarial Training to reduce artifacts. A dynamic attention mechanism enables the model to focus on key anatomical regions, even when fully-sampled reference images are unavailable. GraFMRI was evaluated on the IXI and fastMRI datasets using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) as metrics for reconstruction quality.</div></div><div><h3>Results</h3><div>GraFMRI consistently outperforms traditional and self-supervised reconstruction techniques. Significant improvements in multi-modal fusion were observed, with better preservation of information across modalities. Noise suppression through NLM filtering and artifact reduction via adversarial training led to higher PSNR and SSIM scores across both datasets. The dynamic attention mechanism further enhanced the accuracy of the reconstructions by focusing on critical anatomical regions.</div></div><div><h3>Conclusion</h3><div>GraFMRI provides a scalable, robust solution for multi-modal MRI reconstruction, addressing noise and artifact challenges while enhancing diagnostic accuracy. Its ability to fuse information from different MRI modalities makes it adaptable to various clinical applications, improving the quality and reliability of reconstructed images.</div></div>\",\"PeriodicalId\":18165,\"journal\":{\"name\":\"Magnetic resonance imaging\",\"volume\":\"116 \",\"pages\":\"Article 110279\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Magnetic resonance imaging\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0730725X24002601\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Magnetic resonance imaging","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0730725X24002601","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
GraFMRI: A graph-based fusion framework for robust multi-modal MRI reconstruction
Purpose
This study introduces GraFMRI, a novel framework designed to address the challenges of reconstructing high-quality MRI images from undersampled k-space data. Traditional methods often suffer from noise amplification and loss of structural detail, leading to suboptimal image quality. GraFMRI leverages Graph Neural Networks (GNNs) to transform multi-modal MRI data (T1, T2, PD) into a graph-based representation, enabling the model to capture intricate spatial relationships and inter-modality dependencies.
Methods
The framework integrates Graph-Based Non-Local Means (NLM) Filtering for effective noise suppression and Adversarial Training to reduce artifacts. A dynamic attention mechanism enables the model to focus on key anatomical regions, even when fully-sampled reference images are unavailable. GraFMRI was evaluated on the IXI and fastMRI datasets using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) as metrics for reconstruction quality.
Results
GraFMRI consistently outperforms traditional and self-supervised reconstruction techniques. Significant improvements in multi-modal fusion were observed, with better preservation of information across modalities. Noise suppression through NLM filtering and artifact reduction via adversarial training led to higher PSNR and SSIM scores across both datasets. The dynamic attention mechanism further enhanced the accuracy of the reconstructions by focusing on critical anatomical regions.
Conclusion
GraFMRI provides a scalable, robust solution for multi-modal MRI reconstruction, addressing noise and artifact challenges while enhancing diagnostic accuracy. Its ability to fuse information from different MRI modalities makes it adaptable to various clinical applications, improving the quality and reliability of reconstructed images.
期刊介绍:
Magnetic Resonance Imaging (MRI) is the first international multidisciplinary journal encompassing physical, life, and clinical science investigations as they relate to the development and use of magnetic resonance imaging. MRI is dedicated to both basic research, technological innovation and applications, providing a single forum for communication among radiologists, physicists, chemists, biochemists, biologists, engineers, internists, pathologists, physiologists, computer scientists, and mathematicians.