Qianyao Ye , Hao Yin , Jianan Lin , Junzhao Liang , Mugui Xie , Cong Ye , Bin Zhou , An Huang , Zhiwei Wu , Xiaosong Li , Yanxiong Wu
{"title":"改进的嵌套 U 型结构可实现准确的甲沟毛细血管分割。","authors":"Qianyao Ye , Hao Yin , Jianan Lin , Junzhao Liang , Mugui Xie , Cong Ye , Bin Zhou , An Huang , Zhiwei Wu , Xiaosong Li , Yanxiong Wu","doi":"10.1016/j.mvr.2024.104680","DOIUrl":null,"url":null,"abstract":"<div><p>Changes in the structure and function of nailfold capillaries may be indicators of numerous diseases. Noninvasive diagnostic tools are commonly used for the extraction of morphological information from segmented nailfold capillaries to study physiological and pathological changes therein. However, current segmentation methods for nailfold capillaries cannot accurately separate capillaries from the background, resulting in issues such as unclear segmentation boundaries. Therefore, improving the accuracy of nailfold capillary segmentation is necessary to facilitate more efficient clinical diagnosis and research. Herein, we propose a nailfold capillary image segmentation method based on a U<sup>2</sup>-Net backbone network combined with a Transformer structure. This method integrates the U<sup>2</sup>-Net and Transformer networks to establish a decoder–encoder network, which inserts Transformer layers into the nested two-layer U-shaped architecture of the U<sup>2</sup>-Net. This structure effectively extracts multiscale features within stages and aggregates multilevel features across stages to generate high-resolution feature maps. The experimental results demonstrate an overall accuracy of 98.23 %, a Dice coefficient of 88.56 %, and an IoU of 80.41 % compared to the ground truth. Furthermore, our proposed method improves the overall accuracy by approximately 2 %, 3 %, and 5 % compared to the original U<sup>2</sup>-Net, Res-Unet, and U-Net, respectively. These results indicate that the Transformer–U<sup>2</sup>Net network performs well in nailfold capillary image segmentation and provides more detailed and accurate information on the segmented nailfold capillary structure, which may aid clinicians in the more precise diagnosis and treatment of nailfold capillary-related diseases.</p></div>","PeriodicalId":18534,"journal":{"name":"Microvascular research","volume":"154 ","pages":"Article 104680"},"PeriodicalIF":2.9000,"publicationDate":"2024-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improved nested U-structure for accurate nailfold capillary segmentation\",\"authors\":\"Qianyao Ye , Hao Yin , Jianan Lin , Junzhao Liang , Mugui Xie , Cong Ye , Bin Zhou , An Huang , Zhiwei Wu , Xiaosong Li , Yanxiong Wu\",\"doi\":\"10.1016/j.mvr.2024.104680\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Changes in the structure and function of nailfold capillaries may be indicators of numerous diseases. Noninvasive diagnostic tools are commonly used for the extraction of morphological information from segmented nailfold capillaries to study physiological and pathological changes therein. However, current segmentation methods for nailfold capillaries cannot accurately separate capillaries from the background, resulting in issues such as unclear segmentation boundaries. Therefore, improving the accuracy of nailfold capillary segmentation is necessary to facilitate more efficient clinical diagnosis and research. Herein, we propose a nailfold capillary image segmentation method based on a U<sup>2</sup>-Net backbone network combined with a Transformer structure. This method integrates the U<sup>2</sup>-Net and Transformer networks to establish a decoder–encoder network, which inserts Transformer layers into the nested two-layer U-shaped architecture of the U<sup>2</sup>-Net. This structure effectively extracts multiscale features within stages and aggregates multilevel features across stages to generate high-resolution feature maps. The experimental results demonstrate an overall accuracy of 98.23 %, a Dice coefficient of 88.56 %, and an IoU of 80.41 % compared to the ground truth. Furthermore, our proposed method improves the overall accuracy by approximately 2 %, 3 %, and 5 % compared to the original U<sup>2</sup>-Net, Res-Unet, and U-Net, respectively. These results indicate that the Transformer–U<sup>2</sup>Net network performs well in nailfold capillary image segmentation and provides more detailed and accurate information on the segmented nailfold capillary structure, which may aid clinicians in the more precise diagnosis and treatment of nailfold capillary-related diseases.</p></div>\",\"PeriodicalId\":18534,\"journal\":{\"name\":\"Microvascular research\",\"volume\":\"154 \",\"pages\":\"Article 104680\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-03-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Microvascular research\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0026286224000293\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PERIPHERAL VASCULAR DISEASE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Microvascular research","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0026286224000293","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PERIPHERAL VASCULAR DISEASE","Score":null,"Total":0}
Improved nested U-structure for accurate nailfold capillary segmentation
Changes in the structure and function of nailfold capillaries may be indicators of numerous diseases. Noninvasive diagnostic tools are commonly used for the extraction of morphological information from segmented nailfold capillaries to study physiological and pathological changes therein. However, current segmentation methods for nailfold capillaries cannot accurately separate capillaries from the background, resulting in issues such as unclear segmentation boundaries. Therefore, improving the accuracy of nailfold capillary segmentation is necessary to facilitate more efficient clinical diagnosis and research. Herein, we propose a nailfold capillary image segmentation method based on a U2-Net backbone network combined with a Transformer structure. This method integrates the U2-Net and Transformer networks to establish a decoder–encoder network, which inserts Transformer layers into the nested two-layer U-shaped architecture of the U2-Net. This structure effectively extracts multiscale features within stages and aggregates multilevel features across stages to generate high-resolution feature maps. The experimental results demonstrate an overall accuracy of 98.23 %, a Dice coefficient of 88.56 %, and an IoU of 80.41 % compared to the ground truth. Furthermore, our proposed method improves the overall accuracy by approximately 2 %, 3 %, and 5 % compared to the original U2-Net, Res-Unet, and U-Net, respectively. These results indicate that the Transformer–U2Net network performs well in nailfold capillary image segmentation and provides more detailed and accurate information on the segmented nailfold capillary structure, which may aid clinicians in the more precise diagnosis and treatment of nailfold capillary-related diseases.
期刊介绍:
Microvascular Research is dedicated to the dissemination of fundamental information related to the microvascular field. Full-length articles presenting the results of original research and brief communications are featured.
Research Areas include:
• Angiogenesis
• Biochemistry
• Bioengineering
• Biomathematics
• Biophysics
• Cancer
• Circulatory homeostasis
• Comparative physiology
• Drug delivery
• Neuropharmacology
• Microvascular pathology
• Rheology
• Tissue Engineering.