5G AI-IoT System for Bird Species Monitoring and Song Classification

Jaume Segura-García, Sean Sturley, M. Arevalillo-Herráez, J. Alcaraz-Calero, Santiago Felici-Castell, Enrique A. Navarro-Camba
{"title":"5G AI-IoT System for Bird Species Monitoring and Song Classification","authors":"Jaume Segura-García, Sean Sturley, M. Arevalillo-Herráez, J. Alcaraz-Calero, Santiago Felici-Castell, Enrique A. Navarro-Camba","doi":"10.3390/s24113687","DOIUrl":null,"url":null,"abstract":"Identification of different species of animals has become an important issue in biology and ecology. Ornithology has made alliances with other disciplines in order to establish a set of methods that play an important role in the birds’ protection and the evaluation of the environmental quality of different ecosystems. In this case, the use of machine learning and deep learning techniques has produced big progress in birdsong identification. To make an approach from AI-IoT, we have used different approaches based on image feature comparison (through CNNs trained with Imagenet weights, such as EfficientNet or MobileNet) using the feature spectrogram for the birdsong, but also the use of the deep CNN (DCNN) has shown good performance for birdsong classification for reduction of the model size. A 5G IoT-based system for raw audio gathering has been developed, and different CNNs have been tested for bird identification from audio recordings. This comparison shows that Imagenet-weighted CNN shows a relatively high performance for most species, achieving 75% accuracy. However, this network contains a large number of parameters, leading to a less energy efficient inference. We have designed two DCNNs to reduce the amount of parameters, to keep the accuracy at a certain level, and to allow their integration into a small board computer (SBC) or a microcontroller unit (MCU).","PeriodicalId":221960,"journal":{"name":"Sensors (Basel, Switzerland)","volume":"51 3","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Sensors (Basel, Switzerland)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/s24113687","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Identification of different species of animals has become an important issue in biology and ecology. Ornithology has made alliances with other disciplines in order to establish a set of methods that play an important role in the birds’ protection and the evaluation of the environmental quality of different ecosystems. In this case, the use of machine learning and deep learning techniques has produced big progress in birdsong identification. To make an approach from AI-IoT, we have used different approaches based on image feature comparison (through CNNs trained with Imagenet weights, such as EfficientNet or MobileNet) using the feature spectrogram for the birdsong, but also the use of the deep CNN (DCNN) has shown good performance for birdsong classification for reduction of the model size. A 5G IoT-based system for raw audio gathering has been developed, and different CNNs have been tested for bird identification from audio recordings. This comparison shows that Imagenet-weighted CNN shows a relatively high performance for most species, achieving 75% accuracy. However, this network contains a large number of parameters, leading to a less energy efficient inference. We have designed two DCNNs to reduce the amount of parameters, to keep the accuracy at a certain level, and to allow their integration into a small board computer (SBC) or a microcontroller unit (MCU).
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于鸟类物种监测和鸟鸣分类的 5G 人工智能物联网系统
识别不同种类的动物已成为生物学和生态学的一个重要问题。鸟类学与其他学科结成联盟,以建立一套在鸟类保护和不同生态系统环境质量评估中发挥重要作用的方法。在这种情况下,机器学习和深度学习技术的使用在鸟鸣识别方面取得了重大进展。为了从人工智能-物联网的角度出发,我们使用了基于图像特征比较的不同方法(通过使用 Imagenet 权重训练的 CNN,如 EfficientNet 或 MobileNet),使用鸟鸣的特征频谱图,而且深度 CNN(DCNN)的使用在鸟鸣分类方面也显示出了良好的性能,从而减少了模型的大小。我们开发了一个基于 5G 物联网的原始音频采集系统,并对不同的 CNN 进行了测试,以从音频记录中识别鸟类。比较结果表明,Imagenet 加权 CNN 对大多数物种都有相对较高的性能,准确率达到 75%。但是,该网络包含大量参数,导致推理能效较低。我们设计了两个 DCNN,以减少参数数量,将准确率保持在一定水平,并将其集成到小型板卡计算机(SBC)或微控制器单元(MCU)中。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A Flexible Ammonia Gas Sensor Based on a Grafted Polyaniline Grown on a Polyethylene Terephthalate Film Investigation of Appropriate Scaling of Networks and Images for Convolutional Neural Network-Based Nerve Detection in Ultrasound-Guided Nerve Blocks EMR-HRNet: A Multi-Scale Feature Fusion Network for Landslide Segmentation from Remote Sensing Images Measuring DNI with a New Radiometer Based on an Optical Fiber and Photodiode Highly Sensitive Balloon-like Fiber Interferometer Based on Ethanol Coated for Temperature Measurement
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1