Shan Su, Dahe Gu, Jun-Yu Lai, Nico Arcilla, Tai-Yuan Su
{"title":"基于深度学习的新型生物声学方法,用于识别野生动物市场上交易的相似白眼(Zosterops)物种","authors":"Shan Su, Dahe Gu, Jun-Yu Lai, Nico Arcilla, Tai-Yuan Su","doi":"10.1111/ibi.13309","DOIUrl":null,"url":null,"abstract":"<p>The songbird trade crisis in East and South East Asia has been fuelled by high demand, driving many species to the brink of extinction. This demand, driven by the desire for songbirds as pets, for singing competitions and for prayer animal release has led to the overexploitation of numerous species and the introduction and spread of invasive alien species and diseases to novel environments. The ability to identify traded species efficiently and accurately is crucial for monitoring bird trade markets, protecting threatened species and enforcing wildlife laws. Citizen scientists can make major contributions to these conservation efforts but may be constrained by difficulties in distinguishing ‘look-alike’ bird species traded in markets. To address this challenge, we developed a novel deep learning-based Artificial Intelligence (AI) bioacoustic tool to enable citizen scientists to identify bird species traded in markets. To this end, we used three major avian vocalization databases to access bioacoustic data for 15 morphologically similar White-eye (<i>Zosterops</i>) species that are commonly traded in Asian wildlife markets. Specifically, we employed the Inception v3 pre-trained model to classify the 15 White-eye species and ambient sound (i.e. non-bird sound) using 448 bird recordings we obtained. We converted recordings into spectrogram (i.e. image form) and used eight image augmentation methods to enhance the performance of the AI neural network through training and validation. We found that recall, precision and F1 score increased as the amount of data augmentation increased, resulting in up to 91.6% overall accuracy and an F1 score of 88.8% for identifying focal species. Through the application of bioacoustics and deep learning, this approach would enable citizen scientists and law enforcement officials efficiently and accurately to identify prohibited trade in threatened species, making important contributions to conservation.</p>","PeriodicalId":13254,"journal":{"name":"Ibis","volume":"167 1","pages":"41-55"},"PeriodicalIF":1.8000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel deep learning-based bioacoustic approach for identification of look-alike white-eye (Zosterops) species traded in wildlife markets\",\"authors\":\"Shan Su, Dahe Gu, Jun-Yu Lai, Nico Arcilla, Tai-Yuan Su\",\"doi\":\"10.1111/ibi.13309\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The songbird trade crisis in East and South East Asia has been fuelled by high demand, driving many species to the brink of extinction. This demand, driven by the desire for songbirds as pets, for singing competitions and for prayer animal release has led to the overexploitation of numerous species and the introduction and spread of invasive alien species and diseases to novel environments. The ability to identify traded species efficiently and accurately is crucial for monitoring bird trade markets, protecting threatened species and enforcing wildlife laws. Citizen scientists can make major contributions to these conservation efforts but may be constrained by difficulties in distinguishing ‘look-alike’ bird species traded in markets. To address this challenge, we developed a novel deep learning-based Artificial Intelligence (AI) bioacoustic tool to enable citizen scientists to identify bird species traded in markets. To this end, we used three major avian vocalization databases to access bioacoustic data for 15 morphologically similar White-eye (<i>Zosterops</i>) species that are commonly traded in Asian wildlife markets. Specifically, we employed the Inception v3 pre-trained model to classify the 15 White-eye species and ambient sound (i.e. non-bird sound) using 448 bird recordings we obtained. We converted recordings into spectrogram (i.e. image form) and used eight image augmentation methods to enhance the performance of the AI neural network through training and validation. We found that recall, precision and F1 score increased as the amount of data augmentation increased, resulting in up to 91.6% overall accuracy and an F1 score of 88.8% for identifying focal species. Through the application of bioacoustics and deep learning, this approach would enable citizen scientists and law enforcement officials efficiently and accurately to identify prohibited trade in threatened species, making important contributions to conservation.</p>\",\"PeriodicalId\":13254,\"journal\":{\"name\":\"Ibis\",\"volume\":\"167 1\",\"pages\":\"41-55\"},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2024-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ibis\",\"FirstCategoryId\":\"99\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/ibi.13309\",\"RegionNum\":3,\"RegionCategory\":\"生物学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ORNITHOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ibis","FirstCategoryId":"99","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/ibi.13309","RegionNum":3,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORNITHOLOGY","Score":null,"Total":0}
A novel deep learning-based bioacoustic approach for identification of look-alike white-eye (Zosterops) species traded in wildlife markets
The songbird trade crisis in East and South East Asia has been fuelled by high demand, driving many species to the brink of extinction. This demand, driven by the desire for songbirds as pets, for singing competitions and for prayer animal release has led to the overexploitation of numerous species and the introduction and spread of invasive alien species and diseases to novel environments. The ability to identify traded species efficiently and accurately is crucial for monitoring bird trade markets, protecting threatened species and enforcing wildlife laws. Citizen scientists can make major contributions to these conservation efforts but may be constrained by difficulties in distinguishing ‘look-alike’ bird species traded in markets. To address this challenge, we developed a novel deep learning-based Artificial Intelligence (AI) bioacoustic tool to enable citizen scientists to identify bird species traded in markets. To this end, we used three major avian vocalization databases to access bioacoustic data for 15 morphologically similar White-eye (Zosterops) species that are commonly traded in Asian wildlife markets. Specifically, we employed the Inception v3 pre-trained model to classify the 15 White-eye species and ambient sound (i.e. non-bird sound) using 448 bird recordings we obtained. We converted recordings into spectrogram (i.e. image form) and used eight image augmentation methods to enhance the performance of the AI neural network through training and validation. We found that recall, precision and F1 score increased as the amount of data augmentation increased, resulting in up to 91.6% overall accuracy and an F1 score of 88.8% for identifying focal species. Through the application of bioacoustics and deep learning, this approach would enable citizen scientists and law enforcement officials efficiently and accurately to identify prohibited trade in threatened species, making important contributions to conservation.
期刊介绍:
IBIS publishes original papers, reviews, short communications and forum articles reflecting the forefront of international research activity in ornithological science, with special emphasis on the behaviour, ecology, evolution and conservation of birds. IBIS aims to publish as rapidly as is consistent with the requirements of peer-review and normal publishing constraints.