Shan Su, Dahe Gu, Jun-Yu Lai, Nico Arcilla, Tai-Yuan Su
{"title":"基于深度学习的新型生物声学方法,用于识别野生动物市场上交易的相似白眼(Zosterops)物种","authors":"Shan Su, Dahe Gu, Jun-Yu Lai, Nico Arcilla, Tai-Yuan Su","doi":"10.1111/ibi.13309","DOIUrl":null,"url":null,"abstract":"The songbird trade crisis in East and South East Asia has been fuelled by high demand, driving many species to the brink of extinction. This demand, driven by the desire for songbirds as pets, for singing competitions and for prayer animal release has led to the overexploitation of numerous species and the introduction and spread of invasive alien species and diseases to novel environments. The ability to identify traded species efficiently and accurately is crucial for monitoring bird trade markets, protecting threatened species and enforcing wildlife laws. Citizen scientists can make major contributions to these conservation efforts but may be constrained by difficulties in distinguishing ‘look-alike’ bird species traded in markets. To address this challenge, we developed a novel deep learning-based Artificial Intelligence (AI) bioacoustic tool to enable citizen scientists to identify bird species traded in markets. To this end, we used three major avian vocalization databases to access bioacoustic data for 15 morphologically similar White-eye (<i>Zosterops</i>) species that are commonly traded in Asian wildlife markets. Specifically, we employed the Inception v3 pre-trained model to classify the 15 White-eye species and ambient sound (i.e. non-bird sound) using 448 bird recordings we obtained. We converted recordings into spectrogram (i.e. image form) and used eight image augmentation methods to enhance the performance of the AI neural network through training and validation. We found that recall, precision and F1 score increased as the amount of data augmentation increased, resulting in up to 91.6% overall accuracy and an F1 score of 88.8% for identifying focal species. Through the application of bioacoustics and deep learning, this approach would enable citizen scientists and law enforcement officials efficiently and accurately to identify prohibited trade in threatened species, making important contributions to conservation.","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":null,"pages":null},"PeriodicalIF":16.4000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel deep learning-based bioacoustic approach for identification of look-alike white-eye (Zosterops) species traded in wildlife markets\",\"authors\":\"Shan Su, Dahe Gu, Jun-Yu Lai, Nico Arcilla, Tai-Yuan Su\",\"doi\":\"10.1111/ibi.13309\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The songbird trade crisis in East and South East Asia has been fuelled by high demand, driving many species to the brink of extinction. This demand, driven by the desire for songbirds as pets, for singing competitions and for prayer animal release has led to the overexploitation of numerous species and the introduction and spread of invasive alien species and diseases to novel environments. The ability to identify traded species efficiently and accurately is crucial for monitoring bird trade markets, protecting threatened species and enforcing wildlife laws. Citizen scientists can make major contributions to these conservation efforts but may be constrained by difficulties in distinguishing ‘look-alike’ bird species traded in markets. To address this challenge, we developed a novel deep learning-based Artificial Intelligence (AI) bioacoustic tool to enable citizen scientists to identify bird species traded in markets. To this end, we used three major avian vocalization databases to access bioacoustic data for 15 morphologically similar White-eye (<i>Zosterops</i>) species that are commonly traded in Asian wildlife markets. Specifically, we employed the Inception v3 pre-trained model to classify the 15 White-eye species and ambient sound (i.e. non-bird sound) using 448 bird recordings we obtained. We converted recordings into spectrogram (i.e. image form) and used eight image augmentation methods to enhance the performance of the AI neural network through training and validation. We found that recall, precision and F1 score increased as the amount of data augmentation increased, resulting in up to 91.6% overall accuracy and an F1 score of 88.8% for identifying focal species. Through the application of bioacoustics and deep learning, this approach would enable citizen scientists and law enforcement officials efficiently and accurately to identify prohibited trade in threatened species, making important contributions to conservation.\",\"PeriodicalId\":1,\"journal\":{\"name\":\"Accounts of Chemical Research\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":16.4000,\"publicationDate\":\"2024-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Accounts of Chemical Research\",\"FirstCategoryId\":\"99\",\"ListUrlMain\":\"https://doi.org/10.1111/ibi.13309\",\"RegionNum\":1,\"RegionCategory\":\"化学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CHEMISTRY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"99","ListUrlMain":"https://doi.org/10.1111/ibi.13309","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
A novel deep learning-based bioacoustic approach for identification of look-alike white-eye (Zosterops) species traded in wildlife markets
The songbird trade crisis in East and South East Asia has been fuelled by high demand, driving many species to the brink of extinction. This demand, driven by the desire for songbirds as pets, for singing competitions and for prayer animal release has led to the overexploitation of numerous species and the introduction and spread of invasive alien species and diseases to novel environments. The ability to identify traded species efficiently and accurately is crucial for monitoring bird trade markets, protecting threatened species and enforcing wildlife laws. Citizen scientists can make major contributions to these conservation efforts but may be constrained by difficulties in distinguishing ‘look-alike’ bird species traded in markets. To address this challenge, we developed a novel deep learning-based Artificial Intelligence (AI) bioacoustic tool to enable citizen scientists to identify bird species traded in markets. To this end, we used three major avian vocalization databases to access bioacoustic data for 15 morphologically similar White-eye (Zosterops) species that are commonly traded in Asian wildlife markets. Specifically, we employed the Inception v3 pre-trained model to classify the 15 White-eye species and ambient sound (i.e. non-bird sound) using 448 bird recordings we obtained. We converted recordings into spectrogram (i.e. image form) and used eight image augmentation methods to enhance the performance of the AI neural network through training and validation. We found that recall, precision and F1 score increased as the amount of data augmentation increased, resulting in up to 91.6% overall accuracy and an F1 score of 88.8% for identifying focal species. Through the application of bioacoustics and deep learning, this approach would enable citizen scientists and law enforcement officials efficiently and accurately to identify prohibited trade in threatened species, making important contributions to conservation.
期刊介绍:
Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance.
Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.