Polyp image segmentation based on multi-scale ResNeSt-50 aggregation network and message passing

Ping XIA, Guangyi ZHANG, Bangjun LEI, Yaobing ZOU, Tinglong TANG
{"title":"Polyp image segmentation based on multi-scale ResNeSt-50 aggregation network and message passing","authors":"Ping XIA, Guangyi ZHANG, Bangjun LEI, Yaobing ZOU, Tinglong TANG","doi":"10.37188/ope.20233118.2765","DOIUrl":null,"url":null,"abstract":"é’ˆå¯¹å¤§è‚ çš„æ¯è‚‰ç»„ç»‡ä¸Žæ­£å¸¸ç»„ç»‡é—´æ— æ˜Žæ˜¾è¾¹ç•Œï¼Œå‡†ç¡®å®šä½æ¯è‚‰ä½ç½®å›°éš¾çš„é—®é¢˜ï¼Œæå‡ºäº†ä¸€ç§å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œèžåˆé¡ºåºæ ‘é‡åŠ æƒç½®ä¿¡åº¦ä¼ æ’­ï¼ˆsequential Tree-Reweighted Message Passing, TRW-Sï¼‰çš„æ¯è‚‰å›¾åƒåˆ†å‰²æ–¹æ³•ã€‚ä¸ºæé«˜ç½‘ç»œå¯¹æ¯è‚‰ä¿¡æ¯çš„è¡¨è¾¾èƒ½åŠ›ï¼Œæž„å»ºç¼–ç -è§£ç ç»“æž„çš„å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œï¼Œç¼–ç å™¨ç”±å·ç§¯æ¨¡å—å’Œ4级ResNeSt模块级联构建ResNeSt-50骨干网络,实现跨通道信息间的线性整合与连接;ResNeSt-50é‡‡ç”¨æ‹†åˆ†æ³¨æ„åŠ›æœºåˆ¶åŠ å¼ºé‡è¦é€šé“ç»„çš„è¡¨çŽ°èƒ½åŠ›ï¼Œå¢žå¼ºäº†æ®‹å·®æ¨¡å—æå–æ¯è‚‰å›¾åƒä¿¡æ¯çš„èƒ½åŠ›ï¼›è§£ç éƒ¨åˆ†ä¸‹ä¸‰å±‚æž„å»ºå¤šå±‚æ„Ÿå—é‡Žæ¨¡å—ï¼ˆreceptive field block, RFBï¼‰èŽ·å–å¤šå°ºåº¦ä¿¡æ¯ï¼Œç„¶åŽç”¨å¯†é›†èšåˆæ¨¡å—æ•´åˆå ¶è¾“å‡ºï¼Œå¹¶ä»¥å¿«é€Ÿè§£ç æ–¹å¼è¾“å‡ºè§£ç ä¿¡æ¯ï¼Œä¿è¯å ¶åˆ†å‰²æ€§èƒ½çš„åŒæ—¶å‡å°‘å‚æ•°é‡ï¼›å ¶æ¬¡ï¼Œç”Ÿæˆé¢„æµ‹å›¾æ—¶é‡‡ç”¨æµ‹è¯•æ—¶å›¾åƒå¢žå¼ºï¼ˆTest-Time Augmentation, TTA)模块提升预测准确度,并增强网络的泛化能力;最后,构建基于马尔科夫随机场的TRW-Sç®—æ³•å¯¹è¾“å‡ºçš„é¢„æµ‹å›¾è¿›è¡ŒåŽå¤„ç†ï¼Œä»¥å®žçŽ°åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§å’Œåˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€‚å¯¹å¤§è‚ æ¯è‚‰æ•°æ®é›†Kvasir-SEG的测试结果表明,本文方法相比于U-Net,U-Net++,ResUnet、SFA、PraNet等算法,mDice值达91.6%,mIoUè¾¾86.3%,Smeasureè¾¾0.921, MAE为0.023ï¼Œä¼˜äºŽå ¶ä»–äº”ç§æ¯è‚‰åˆ†å‰²ç®—æ³•ï¼›åœ¨æœªçŸ¥æ•°æ®é›†ETIS-LaribPolypDB,ColonDB上测试结果表明,相比于PraNet模型,本文模型的mDice值分别提升了14.2%,7.7%;从本文模型在ETIS-LaribPolypDBæ•°æ®é›†ä¸Šçš„åˆ†å‰²è¡¨çŽ°çœ‹ï¼Œæœ¬æ–‡ç®—æ³•å¯¹å¾®å°ç— å˜ååˆ†æ•æ„Ÿï¼›å› æ­¤ï¼Œæœ¬æ–‡ç®—æ³•åˆ†å‰²çš„æ¯è‚‰å›¾åƒï¼Œåœ¨åˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§ã€è½®å»“æ¸ æ™°åº¦ã€æ•æ‰å¾®å°ç— å˜èƒ½åŠ›ç­‰æ–¹é¢å‡è¡¨çŽ°å‡ºä¼˜è‰¯çš„æ€§èƒ½ï¼ŒåŒæ—¶ï¼Œå¯¹æœªçŸ¥æ•°æ®é›†å ·æœ‰è¾ƒå¥½çš„æ³›åŒ–èƒ½åŠ›ã€‚","PeriodicalId":39778,"journal":{"name":"Guangxue Jingmi Gongcheng/Optics and Precision Engineering","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Guangxue Jingmi Gongcheng/Optics and Precision Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.37188/ope.20233118.2765","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Materials Science","Score":null,"Total":0}
引用次数: 0

Abstract

é’ˆå¯¹å¤§è‚ çš„æ¯è‚‰ç»„ç»‡ä¸Žæ­£å¸¸ç»„ç»‡é—´æ— æ˜Žæ˜¾è¾¹ç•Œï¼Œå‡†ç¡®å®šä½æ¯è‚‰ä½ç½®å›°éš¾çš„é—®é¢˜ï¼Œæå‡ºäº†ä¸€ç§å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œèžåˆé¡ºåºæ ‘é‡åŠ æƒç½®ä¿¡åº¦ä¼ æ’­ï¼ˆsequential Tree-Reweighted Message Passing, TRW-Sï¼‰çš„æ¯è‚‰å›¾åƒåˆ†å‰²æ–¹æ³•ã€‚ä¸ºæé«˜ç½‘ç»œå¯¹æ¯è‚‰ä¿¡æ¯çš„è¡¨è¾¾èƒ½åŠ›ï¼Œæž„å»ºç¼–ç -è§£ç ç»“æž„çš„å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œï¼Œç¼–ç å™¨ç”±å·ç§¯æ¨¡å—å’Œ4级ResNeSt模块级联构建ResNeSt-50骨干网络,实现跨通道信息间的线性整合与连接;ResNeSt-50é‡‡ç”¨æ‹†åˆ†æ³¨æ„åŠ›æœºåˆ¶åŠ å¼ºé‡è¦é€šé“ç»„çš„è¡¨çŽ°èƒ½åŠ›ï¼Œå¢žå¼ºäº†æ®‹å·®æ¨¡å—æå–æ¯è‚‰å›¾åƒä¿¡æ¯çš„èƒ½åŠ›ï¼›è§£ç éƒ¨åˆ†ä¸‹ä¸‰å±‚æž„å»ºå¤šå±‚æ„Ÿå—é‡Žæ¨¡å—ï¼ˆreceptive field block, RFBï¼‰èŽ·å–å¤šå°ºåº¦ä¿¡æ¯ï¼Œç„¶åŽç”¨å¯†é›†èšåˆæ¨¡å—æ•´åˆå ¶è¾“å‡ºï¼Œå¹¶ä»¥å¿«é€Ÿè§£ç æ–¹å¼è¾“å‡ºè§£ç ä¿¡æ¯ï¼Œä¿è¯å ¶åˆ†å‰²æ€§èƒ½çš„åŒæ—¶å‡å°‘å‚æ•°é‡ï¼›å ¶æ¬¡ï¼Œç”Ÿæˆé¢„æµ‹å›¾æ—¶é‡‡ç”¨æµ‹è¯•æ—¶å›¾åƒå¢žå¼ºï¼ˆTest-Time Augmentation, TTA)模块提升预测准确度,并增强网络的泛化能力;最后,构建基于马尔科夫随机场的TRW-Sç®—æ³•å¯¹è¾“å‡ºçš„é¢„æµ‹å›¾è¿›è¡ŒåŽå¤„ç†ï¼Œä»¥å®žçŽ°åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§å’Œåˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€‚å¯¹å¤§è‚ æ¯è‚‰æ•°æ®é›†Kvasir-SEG的测试结果表明,本文方法相比于U-Net,U-Net++,ResUnet、SFA、PraNet等算法,mDice值达91.6%,mIoUè¾¾86.3%,Smeasureè¾¾0.921, MAE为0.023ï¼Œä¼˜äºŽå ¶ä»–äº”ç§æ¯è‚‰åˆ†å‰²ç®—æ³•ï¼›åœ¨æœªçŸ¥æ•°æ®é›†ETIS-LaribPolypDB,ColonDB上测试结果表明,相比于PraNet模型,本文模型的mDice值分别提升了14.2%,7.7%;从本文模型在ETIS-LaribPolypDBæ•°æ®é›†ä¸Šçš„åˆ†å‰²è¡¨çŽ°çœ‹ï¼Œæœ¬æ–‡ç®—æ³•å¯¹å¾®å°ç— å˜ååˆ†æ•æ„Ÿï¼›å› æ­¤ï¼Œæœ¬æ–‡ç®—æ³•åˆ†å‰²çš„æ¯è‚‰å›¾åƒï¼Œåœ¨åˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§ã€è½®å»“æ¸ æ™°åº¦ã€æ•æ‰å¾®å°ç— å˜èƒ½åŠ›ç­‰æ–¹é¢å‡è¡¨çŽ°å‡ºä¼˜è‰¯çš„æ€§èƒ½ï¼ŒåŒæ—¶ï¼Œå¯¹æœªçŸ¥æ•°æ®é›†å ·æœ‰è¾ƒå¥½çš„æ³›åŒ–èƒ½åŠ›ã€‚
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于多尺度ResNeSt-50聚合网络和消息传递的息肉图像分割
在此基础上,我们开发出了ResNeSt-50ResNeSt-50ResNeSt-50ResNeSt-50 "相序树重加权信息传递"(Tree-Reweighted Message Passing)技术。S: "我想知道","我想知道","我想知道","我想知道","我想知道"。50颗,每颗4.5分,共4颗ResNeSt-50颗。50颗 "感知场阻滞"(receptive field block)。RFB:在人体的感知区域内,形成一个 "感知区块",这个 "感知区块 "就是 "RFB",它的作用是在人体的感知区域内,形成一个 "感知区块"。Time Augmentation(时间扩展):TTA。Sç®æ³å¯¹è¾åºçé¢æµå¾è¿è-å¤ç¼è¿ç" æ§åºå²åºå¯¹ä¸ä¸è æ¯èæ°æ®éKvasir-SEGçæµè¯ç "æ表æ¼æ¬æ¬¹æ¸çæ¯äºU-Netï¼U-Net++ï¼ResUnetãSFAãPraNetç®æ³ï¼mDiceå¼¾¾91.6%,MAE0.023,ETIS-LaribolPolypDB,ColonDB,PraNet,DiceDice14.2%。7%ETIS-LaribPolypDB("LaribPolypDB")炖汤:炖汤的时候加入适量的葱花和姜末,再加入适量的盐和胡椒粉,搅拌均匀即可。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Guangxue Jingmi Gongcheng/Optics and Precision Engineering
Guangxue Jingmi Gongcheng/Optics and Precision Engineering Materials Science-Electronic, Optical and Magnetic Materials
CiteScore
2.40
自引率
0.00%
发文量
95
期刊最新文献
Lightweight target detection network for UAV platforms Research of ultra-precision gear pitch artifact based on dividing mechanism with multi-tooth position Spatial information adaptive regulation and feature alignment for infrared methane instance segmentation Photoelectric inequivalence characteristics of an electric substitution radiative heat flux meter Coupled hysteresis model and its inverse compensation for three-degree-of-freedom tip-tilt-piston piezoelectric stage
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1