Lightweight deep learning model for underwater waste segmentation based on sonar images

IF 7.1 2区 环境科学与生态学 Q1 ENGINEERING, ENVIRONMENTAL Waste management Pub Date : 2024-09-14 DOI:10.1016/j.wasman.2024.09.008
{"title":"Lightweight deep learning model for underwater waste segmentation based on sonar images","authors":"","doi":"10.1016/j.wasman.2024.09.008","DOIUrl":null,"url":null,"abstract":"<div><p>In recent years, the rapid accumulation of marine waste not only endangers the ecological environment but also causes seawater pollution. Traditional manual salvage methods often have low efficiency and pose safety risks to human operators, making automatic underwater waste recycling a mainstream approach. In this paper, we propose a lightweight multi-scale cross-level network for underwater waste segmentation based on sonar images that provides pixel-level location information and waste categories for autonomous underwater robots. In particular, we introduce hybrid perception and multi-scale attention modules to capture multi-scale contextual features and enhance high-level critical information, respectively. At the same time, we use sampling attention modules and cross-level interaction modules to achieve feature down-sampling and fuse detailed features and semantic features, respectively. Relevant experimental results indicate that our method outperforms other semantic segmentation models and achieves 74.66 % <em>mIoU</em> with only 0.68 M parameters. In particular, compared with the representative PIDNet Small model based on the convolutional neural network architecture, our method can improve the <em>mIoU</em> metric by 1.15 percentage points and can reduce model parameters by approximately 91 %. Compared with the representative SeaFormer T model based on the transformer architecture, our approach can improve the <em>mIoU</em> metric by 2.07 percentage points and can reduce model parameters by approximately 59 %. Our approach maintains a satisfactory balance between model parameters and segmentation performance. Our solution provides new insights into intelligent underwater waste recycling, which helps in promoting sustainable marine development.</p></div>","PeriodicalId":23969,"journal":{"name":"Waste management","volume":null,"pages":null},"PeriodicalIF":7.1000,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Waste management","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0956053X24004951","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ENVIRONMENTAL","Score":null,"Total":0}
引用次数: 0

Abstract

In recent years, the rapid accumulation of marine waste not only endangers the ecological environment but also causes seawater pollution. Traditional manual salvage methods often have low efficiency and pose safety risks to human operators, making automatic underwater waste recycling a mainstream approach. In this paper, we propose a lightweight multi-scale cross-level network for underwater waste segmentation based on sonar images that provides pixel-level location information and waste categories for autonomous underwater robots. In particular, we introduce hybrid perception and multi-scale attention modules to capture multi-scale contextual features and enhance high-level critical information, respectively. At the same time, we use sampling attention modules and cross-level interaction modules to achieve feature down-sampling and fuse detailed features and semantic features, respectively. Relevant experimental results indicate that our method outperforms other semantic segmentation models and achieves 74.66 % mIoU with only 0.68 M parameters. In particular, compared with the representative PIDNet Small model based on the convolutional neural network architecture, our method can improve the mIoU metric by 1.15 percentage points and can reduce model parameters by approximately 91 %. Compared with the representative SeaFormer T model based on the transformer architecture, our approach can improve the mIoU metric by 2.07 percentage points and can reduce model parameters by approximately 59 %. Our approach maintains a satisfactory balance between model parameters and segmentation performance. Our solution provides new insights into intelligent underwater waste recycling, which helps in promoting sustainable marine development.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于声纳图像的轻量级水下废物分割深度学习模型
近年来,海洋废弃物的快速积累不仅危及生态环境,还会造成海水污染。传统的人工打捞方法往往效率低下,且存在人为操作的安全隐患,因此水下垃圾自动回收成为主流方法。在本文中,我们提出了一种基于声纳图像的轻量级多尺度跨级水下垃圾分割网络,可为自主水下机器人提供像素级的位置信息和垃圾类别。其中,我们引入了混合感知和多尺度注意力模块,分别用于捕捉多尺度上下文特征和增强高层关键信息。同时,我们利用采样注意模块和跨级交互模块分别实现了特征下采样和细节特征与语义特征的融合。相关实验结果表明,我们的方法优于其他语义分割模型,仅用 0.68 M 个参数就实现了 74.66 % 的 mIoU。其中,与代表性的基于卷积神经网络架构的 PIDNet Small 模型相比,我们的方法可将 mIoU 指标提高 1.15 个百分点,并可减少约 91 % 的模型参数。与基于变压器结构的代表性 SeaFormer T 模型相比,我们的方法可将 mIoU 指标提高 2.07 个百分点,并可减少约 59 % 的模型参数。我们的方法在模型参数和分割性能之间保持了令人满意的平衡。我们的解决方案为智能水下废物回收提供了新的见解,有助于促进海洋的可持续发展。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Waste management
Waste management 环境科学-工程:环境
CiteScore
15.60
自引率
6.20%
发文量
492
审稿时长
39 days
期刊介绍: Waste Management is devoted to the presentation and discussion of information on solid wastes,it covers the entire lifecycle of solid. wastes. Scope: Addresses solid wastes in both industrialized and economically developing countries Covers various types of solid wastes, including: Municipal (e.g., residential, institutional, commercial, light industrial) Agricultural Special (e.g., C and D, healthcare, household hazardous wastes, sewage sludge)
期刊最新文献
Kinetic investigation on the catalytic pyrolysis of plastic fractions of waste electrical and electronic equipment (WEEE): A mathematical deconvolution approach. Lightweight deep learning model for underwater waste segmentation based on sonar images Molecular understanding of speciation transformation of phosphorus and sulfur in food waste digestate during hydrothermal treatment Corrigendum to “Spillover of different regulatory policies for waste sorting: Potential influence on energy-saving policy acceptability” [Waste Manag. 125 (2021) 112–121] Editorial Board
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1