A novel deep learning-based bioacoustic approach for identification of look-alike white-eye (Zosterops) species traded in wildlife markets

IF 16.4 1区 化学 Q1 CHEMISTRY, MULTIDISCIPLINARY Accounts of Chemical Research Pub Date : 2024-02-01 DOI:10.1111/ibi.13309
Shan Su, Dahe Gu, Jun-Yu Lai, Nico Arcilla, Tai-Yuan Su
{"title":"A novel deep learning-based bioacoustic approach for identification of look-alike white-eye (Zosterops) species traded in wildlife markets","authors":"Shan Su, Dahe Gu, Jun-Yu Lai, Nico Arcilla, Tai-Yuan Su","doi":"10.1111/ibi.13309","DOIUrl":null,"url":null,"abstract":"The songbird trade crisis in East and South East Asia has been fuelled by high demand, driving many species to the brink of extinction. This demand, driven by the desire for songbirds as pets, for singing competitions and for prayer animal release has led to the overexploitation of numerous species and the introduction and spread of invasive alien species and diseases to novel environments. The ability to identify traded species efficiently and accurately is crucial for monitoring bird trade markets, protecting threatened species and enforcing wildlife laws. Citizen scientists can make major contributions to these conservation efforts but may be constrained by difficulties in distinguishing ‘look-alike’ bird species traded in markets. To address this challenge, we developed a novel deep learning-based Artificial Intelligence (AI) bioacoustic tool to enable citizen scientists to identify bird species traded in markets. To this end, we used three major avian vocalization databases to access bioacoustic data for 15 morphologically similar White-eye (<i>Zosterops</i>) species that are commonly traded in Asian wildlife markets. Specifically, we employed the Inception v3 pre-trained model to classify the 15 White-eye species and ambient sound (i.e. non-bird sound) using 448 bird recordings we obtained. We converted recordings into spectrogram (i.e. image form) and used eight image augmentation methods to enhance the performance of the AI neural network through training and validation. We found that recall, precision and F1 score increased as the amount of data augmentation increased, resulting in up to 91.6% overall accuracy and an F1 score of 88.8% for identifying focal species. Through the application of bioacoustics and deep learning, this approach would enable citizen scientists and law enforcement officials efficiently and accurately to identify prohibited trade in threatened species, making important contributions to conservation.","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":null,"pages":null},"PeriodicalIF":16.4000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"99","ListUrlMain":"https://doi.org/10.1111/ibi.13309","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

The songbird trade crisis in East and South East Asia has been fuelled by high demand, driving many species to the brink of extinction. This demand, driven by the desire for songbirds as pets, for singing competitions and for prayer animal release has led to the overexploitation of numerous species and the introduction and spread of invasive alien species and diseases to novel environments. The ability to identify traded species efficiently and accurately is crucial for monitoring bird trade markets, protecting threatened species and enforcing wildlife laws. Citizen scientists can make major contributions to these conservation efforts but may be constrained by difficulties in distinguishing ‘look-alike’ bird species traded in markets. To address this challenge, we developed a novel deep learning-based Artificial Intelligence (AI) bioacoustic tool to enable citizen scientists to identify bird species traded in markets. To this end, we used three major avian vocalization databases to access bioacoustic data for 15 morphologically similar White-eye (Zosterops) species that are commonly traded in Asian wildlife markets. Specifically, we employed the Inception v3 pre-trained model to classify the 15 White-eye species and ambient sound (i.e. non-bird sound) using 448 bird recordings we obtained. We converted recordings into spectrogram (i.e. image form) and used eight image augmentation methods to enhance the performance of the AI neural network through training and validation. We found that recall, precision and F1 score increased as the amount of data augmentation increased, resulting in up to 91.6% overall accuracy and an F1 score of 88.8% for identifying focal species. Through the application of bioacoustics and deep learning, this approach would enable citizen scientists and law enforcement officials efficiently and accurately to identify prohibited trade in threatened species, making important contributions to conservation.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于深度学习的新型生物声学方法,用于识别野生动物市场上交易的相似白眼(Zosterops)物种
高需求助长了东亚和东南亚的鸣禽贸易危机,使许多物种濒临灭绝。人们希望将鸣禽作为宠物、参加歌唱比赛和放生祈福动物,这种需求导致许多物种被过度开发,外来入侵物种和疾病被引入新环境并蔓延开来。有效、准确地识别交易物种的能力对于监控鸟类交易市场、保护濒危物种和执行野生动物法律至关重要。公民科学家可以为这些保护工作做出重大贡献,但可能会受到难以区分市场上交易的 "相似 "鸟类物种的限制。为了应对这一挑战,我们开发了一种基于深度学习的新型人工智能(AI)生物声学工具,使公民科学家能够识别市场上交易的鸟类物种。为此,我们利用三大鸟类发声数据库,获取了亚洲野生动物市场上常见的 15 种形态相似的白眼鸟(Zosterops)的生物声学数据。具体来说,我们使用 Inception v3 预先训练的模型,利用获得的 448 份鸟类录音对 15 种白眼鸟和环境声音(即非鸟类声音)进行分类。我们将录音转换成频谱图(即图像形式),并使用八种图像增强方法,通过训练和验证提高人工智能神经网络的性能。我们发现,随着数据增强量的增加,召回率、精确度和 F1 分数也随之增加,从而使识别重点物种的总体准确率高达 91.6%,F1 分数为 88.8%。通过应用生物声学和深度学习,这种方法将使公民科学家和执法人员能够高效、准确地识别濒危物种的违禁贸易,为保护做出重要贡献。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Accounts of Chemical Research
Accounts of Chemical Research 化学-化学综合
CiteScore
31.40
自引率
1.10%
发文量
312
审稿时长
2 months
期刊介绍: Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance. Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.
期刊最新文献
Management of Cholesteatoma: Hearing Rehabilitation. Congenital Cholesteatoma. Evaluation of Cholesteatoma. Management of Cholesteatoma: Extension Beyond Middle Ear/Mastoid. Recidivism and Recurrence.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1