Ali M. Hayajneh, Sami A. Aldalahmeh, Feras Alasali, Haitham Al-Obiedollah, Sayed Ali Zaidi, Des McLernon
{"title":"Tiny machine learning on the edge: A framework for transfer learning empowered unmanned aerial vehicle assisted smart farming","authors":"Ali M. Hayajneh, Sami A. Aldalahmeh, Feras Alasali, Haitham Al-Obiedollah, Sayed Ali Zaidi, Des McLernon","doi":"10.1049/smc2.12072","DOIUrl":null,"url":null,"abstract":"<p>Emerging technologies are continually redefining the paradigms of smart farming and opening up avenues for more precise and informed farming practices. A tiny machine learning (TinyML)-based framework is proposed for unmanned aerial vehicle (UAV)-assisted smart farming applications. The practical deployment of such a framework on the UAV and bespoke internet of things (IoT) sensors which measure soil moisture and ambient environmental conditions is demonstrated. The key objective of this framework is to harness TinyML for implementing transfer learning (TL) using deep neural networks (DNNs) and long short-term memory (LSTM) ML models. As a case study, this framework is employed to predict soil moisture content for smart agriculture applications, guiding optimal water utilisation for crops through time-series forecasting models. To the best of authors’ knowledge, a framework which leverages UAV-assisted TL for the edge internet of things using TinyML has not been investigated previously. The TL-based framework employs a pre-trained data model on different but similar applications and data domains. Not only do the authors demonstrate the practical deployment of the proposed framework but they also quantify its performance through real-world deployment. This is accomplished by designing a custom sensor board for soil and environmental sensing which uses an ESP32 microcontroller unit. The inference metrics (i.e. inference time and accuracy) are measured for different ML model architectures on edge devices as well as other performance metrics (i.e. mean square error and coefficient of determination [<i>R</i><sup>2</sup>]), while emphasising the need for balancing accuracy and processing complexity. In summary, the results show the practical feasibility of using drones to deliver TL for DNN and LSTM models to ultra-low performance edge IoT devices for soil humidity prediction. But in general, this work also lays the foundation for further research into other applications of TinyML usage in many different aspects of smart farming.</p>","PeriodicalId":34740,"journal":{"name":"IET Smart Cities","volume":"6 1","pages":"10-26"},"PeriodicalIF":2.1000,"publicationDate":"2023-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/smc2.12072","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Smart Cities","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/smc2.12072","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Emerging technologies are continually redefining the paradigms of smart farming and opening up avenues for more precise and informed farming practices. A tiny machine learning (TinyML)-based framework is proposed for unmanned aerial vehicle (UAV)-assisted smart farming applications. The practical deployment of such a framework on the UAV and bespoke internet of things (IoT) sensors which measure soil moisture and ambient environmental conditions is demonstrated. The key objective of this framework is to harness TinyML for implementing transfer learning (TL) using deep neural networks (DNNs) and long short-term memory (LSTM) ML models. As a case study, this framework is employed to predict soil moisture content for smart agriculture applications, guiding optimal water utilisation for crops through time-series forecasting models. To the best of authors’ knowledge, a framework which leverages UAV-assisted TL for the edge internet of things using TinyML has not been investigated previously. The TL-based framework employs a pre-trained data model on different but similar applications and data domains. Not only do the authors demonstrate the practical deployment of the proposed framework but they also quantify its performance through real-world deployment. This is accomplished by designing a custom sensor board for soil and environmental sensing which uses an ESP32 microcontroller unit. The inference metrics (i.e. inference time and accuracy) are measured for different ML model architectures on edge devices as well as other performance metrics (i.e. mean square error and coefficient of determination [R2]), while emphasising the need for balancing accuracy and processing complexity. In summary, the results show the practical feasibility of using drones to deliver TL for DNN and LSTM models to ultra-low performance edge IoT devices for soil humidity prediction. But in general, this work also lays the foundation for further research into other applications of TinyML usage in many different aspects of smart farming.