Linlin Hou , Zishen Yan , Christian Desrosiers , Hui Liu
{"title":"MFCPNet:通过多尺度特征融合和通道剪枝实现实时医学图像分割网络","authors":"Linlin Hou , Zishen Yan , Christian Desrosiers , Hui Liu","doi":"10.1016/j.bspc.2024.107074","DOIUrl":null,"url":null,"abstract":"<div><div>Real-time medical image segmentation can not only enhance the interactivity and feasibility of applications but also support more medical application scenarios. Local feature extraction methods reliant on Convolutional Neural Networks (CNN) are hampered by restricted receptive fields, which weakens their ability to capture comprehensive information. Conversely, global feature extraction methods based on Transformers generally face impediments in real-time tasks due to their extensive computational demands. To address these challenges and explore accurate and real-time medical image segmentation models, we introduce this novel MFCPNet. MFCPNet begins by devising Multi-Scale Multi-Channel Convolution (MSMC Conv) to extract local features across various levels and scales. This innovative design contributes to extracting richer local information without unduly burdening the model. Second, for the enhanced receptive field of convolution and the model’s generalization capability, we introduce an Attention Block (Attn Block) carrying rotation invariance. This block, inspired by lightweight Bi-Level Routing Attention (BRA) and MLP-Mixer, effectively mitigates the constraints of convolutional structures and achieves superior contextual modeling. Finally, a judicious pruning of the channel count is employed within MFCPNet, striking a trade-off between segmentation accuracy and efficiency. To evaluate the proposed method, we compare it with several classic approaches using three different types of datasets: retinal images, brain scans, and colon polyps. Across these datasets, MFCPNet achieves segmentation performance comparable to existing methods, with a computational cost of 2.2G FLOPs and 0.49M parameters. Furthermore, it demonstrates a processing speed of 79.54 FPS, meeting the requirements for real-time applications.</div></div>","PeriodicalId":55362,"journal":{"name":"Biomedical Signal Processing and Control","volume":null,"pages":null},"PeriodicalIF":4.9000,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MFCPNet: Real time medical image segmentation network via multi-scale feature fusion and channel pruning\",\"authors\":\"Linlin Hou , Zishen Yan , Christian Desrosiers , Hui Liu\",\"doi\":\"10.1016/j.bspc.2024.107074\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Real-time medical image segmentation can not only enhance the interactivity and feasibility of applications but also support more medical application scenarios. Local feature extraction methods reliant on Convolutional Neural Networks (CNN) are hampered by restricted receptive fields, which weakens their ability to capture comprehensive information. Conversely, global feature extraction methods based on Transformers generally face impediments in real-time tasks due to their extensive computational demands. To address these challenges and explore accurate and real-time medical image segmentation models, we introduce this novel MFCPNet. MFCPNet begins by devising Multi-Scale Multi-Channel Convolution (MSMC Conv) to extract local features across various levels and scales. This innovative design contributes to extracting richer local information without unduly burdening the model. Second, for the enhanced receptive field of convolution and the model’s generalization capability, we introduce an Attention Block (Attn Block) carrying rotation invariance. This block, inspired by lightweight Bi-Level Routing Attention (BRA) and MLP-Mixer, effectively mitigates the constraints of convolutional structures and achieves superior contextual modeling. Finally, a judicious pruning of the channel count is employed within MFCPNet, striking a trade-off between segmentation accuracy and efficiency. To evaluate the proposed method, we compare it with several classic approaches using three different types of datasets: retinal images, brain scans, and colon polyps. Across these datasets, MFCPNet achieves segmentation performance comparable to existing methods, with a computational cost of 2.2G FLOPs and 0.49M parameters. Furthermore, it demonstrates a processing speed of 79.54 FPS, meeting the requirements for real-time applications.</div></div>\",\"PeriodicalId\":55362,\"journal\":{\"name\":\"Biomedical Signal Processing and Control\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.9000,\"publicationDate\":\"2024-10-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biomedical Signal Processing and Control\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1746809424011327\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Signal Processing and Control","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1746809424011327","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
MFCPNet: Real time medical image segmentation network via multi-scale feature fusion and channel pruning
Real-time medical image segmentation can not only enhance the interactivity and feasibility of applications but also support more medical application scenarios. Local feature extraction methods reliant on Convolutional Neural Networks (CNN) are hampered by restricted receptive fields, which weakens their ability to capture comprehensive information. Conversely, global feature extraction methods based on Transformers generally face impediments in real-time tasks due to their extensive computational demands. To address these challenges and explore accurate and real-time medical image segmentation models, we introduce this novel MFCPNet. MFCPNet begins by devising Multi-Scale Multi-Channel Convolution (MSMC Conv) to extract local features across various levels and scales. This innovative design contributes to extracting richer local information without unduly burdening the model. Second, for the enhanced receptive field of convolution and the model’s generalization capability, we introduce an Attention Block (Attn Block) carrying rotation invariance. This block, inspired by lightweight Bi-Level Routing Attention (BRA) and MLP-Mixer, effectively mitigates the constraints of convolutional structures and achieves superior contextual modeling. Finally, a judicious pruning of the channel count is employed within MFCPNet, striking a trade-off between segmentation accuracy and efficiency. To evaluate the proposed method, we compare it with several classic approaches using three different types of datasets: retinal images, brain scans, and colon polyps. Across these datasets, MFCPNet achieves segmentation performance comparable to existing methods, with a computational cost of 2.2G FLOPs and 0.49M parameters. Furthermore, it demonstrates a processing speed of 79.54 FPS, meeting the requirements for real-time applications.
期刊介绍:
Biomedical Signal Processing and Control aims to provide a cross-disciplinary international forum for the interchange of information on research in the measurement and analysis of signals and images in clinical medicine and the biological sciences. Emphasis is placed on contributions dealing with the practical, applications-led research on the use of methods and devices in clinical diagnosis, patient monitoring and management.
Biomedical Signal Processing and Control reflects the main areas in which these methods are being used and developed at the interface of both engineering and clinical science. The scope of the journal is defined to include relevant review papers, technical notes, short communications and letters. Tutorial papers and special issues will also be published.