Learning-Based Multi-Drone Network Edge Orchestration for Video Analytics

IF 5.4 2区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS IEEE Transactions on Network and Service Management Pub Date : 2024-08-08 DOI:10.1109/TNSM.2024.3440883
Chengyi Qu;Rounak Singh;Alicia Esquivel-Morel;Prasad Calyam
{"title":"Learning-Based Multi-Drone Network Edge Orchestration for Video Analytics","authors":"Chengyi Qu;Rounak Singh;Alicia Esquivel-Morel;Prasad Calyam","doi":"10.1109/TNSM.2024.3440883","DOIUrl":null,"url":null,"abstract":"Unmanned aerial vehicles (also known as drones) equipped with high-resolution video cameras have become increasingly popular for applications such as public safety and smart farming. However, inefficient configurations in drone video analytics due to misconfigured edge networks can lead to degraded video quality and inefficient resource utilization. In this paper, we propose a novel scheme for network edge orchestration that utilizes both offline and online learning-based approaches to achieve pertinent selections of network protocols and video properties in multi-drone-based video analytics. Our approach utilizes both supervised and unsupervised machine learning algorithms to make decisions regarding network protocols and video properties during the pre-takeoff stage of the drones (i.e., offline stage). Additionally, our approach incorporates a reinforcement learning-based multi-agent deep Q-network algorithm for drone trajectory optimization during flights (i.e., online stage) and a memory-to-memory multi-hop data forwarding strategy for drone swarm video transmission. Our evaluation results demonstrate that our offline orchestration approach can suitably choose network protocols (i.e., among TCP/HTTP, UDP/RTP, QUIC), while our unsupervised learning approach outperforms existing methods and achieves efficient offloading while improving network performance (i.e., throughput and round-trip time) by at least 25%, with satisfactory video quality. Furthermore, we demonstrate through trace-based and real-field experiment testbeds how our online orchestration in terms of decision-making and data forwarding strategies achieves 91% of the oracle baseline network throughput performance with comparable video quality. Overall, our approach offers a promising solution for optimizing drone video analytics and enhancing the overall performance of drone-swarm-based applications.","PeriodicalId":13423,"journal":{"name":"IEEE Transactions on Network and Service Management","volume":"21 6","pages":"6331-6348"},"PeriodicalIF":5.4000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Network and Service Management","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10631280/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Unmanned aerial vehicles (also known as drones) equipped with high-resolution video cameras have become increasingly popular for applications such as public safety and smart farming. However, inefficient configurations in drone video analytics due to misconfigured edge networks can lead to degraded video quality and inefficient resource utilization. In this paper, we propose a novel scheme for network edge orchestration that utilizes both offline and online learning-based approaches to achieve pertinent selections of network protocols and video properties in multi-drone-based video analytics. Our approach utilizes both supervised and unsupervised machine learning algorithms to make decisions regarding network protocols and video properties during the pre-takeoff stage of the drones (i.e., offline stage). Additionally, our approach incorporates a reinforcement learning-based multi-agent deep Q-network algorithm for drone trajectory optimization during flights (i.e., online stage) and a memory-to-memory multi-hop data forwarding strategy for drone swarm video transmission. Our evaluation results demonstrate that our offline orchestration approach can suitably choose network protocols (i.e., among TCP/HTTP, UDP/RTP, QUIC), while our unsupervised learning approach outperforms existing methods and achieves efficient offloading while improving network performance (i.e., throughput and round-trip time) by at least 25%, with satisfactory video quality. Furthermore, we demonstrate through trace-based and real-field experiment testbeds how our online orchestration in terms of decision-making and data forwarding strategies achieves 91% of the oracle baseline network throughput performance with comparable video quality. Overall, our approach offers a promising solution for optimizing drone video analytics and enhancing the overall performance of drone-swarm-based applications.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于视频分析的基于学习的多无人机网络边缘协调
配备高分辨率摄像机的无人驾驶飞行器(也称为无人机)在公共安全和智能农业等应用中越来越受欢迎。然而,由于边缘网络配置错误,无人机视频分析中的低效配置可能导致视频质量下降和资源利用效率低下。在本文中,我们提出了一种新的网络边缘编排方案,该方案利用基于离线和在线学习的方法,在基于多无人机的视频分析中实现网络协议和视频属性的相关选择。我们的方法利用有监督和无监督机器学习算法,在无人机起飞前(即离线阶段)就网络协议和视频属性做出决策。此外,我们的方法结合了基于强化学习的多智能体深度q -网络算法,用于飞行期间(即在线阶段)的无人机轨迹优化,以及用于无人机群视频传输的内存到内存多跳数据转发策略。我们的评估结果表明,我们的离线编排方法可以适当地选择网络协议(即TCP/HTTP, UDP/RTP, QUIC),而我们的无监督学习方法优于现有方法,并在将网络性能(即吞吐量和往返时间)提高至少25%的同时实现高效卸载,并具有令人满意的视频质量。此外,我们通过基于跟踪和现场实验的测试平台演示了我们的在线编排在决策和数据转发策略方面如何在具有可比视频质量的情况下达到oracle基线网络吞吐量性能的91%。总的来说,我们的方法为优化无人机视频分析和增强基于无人机群的应用程序的整体性能提供了一个有前途的解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Network and Service Management
IEEE Transactions on Network and Service Management Computer Science-Computer Networks and Communications
CiteScore
9.30
自引率
15.10%
发文量
325
期刊介绍: IEEE Transactions on Network and Service Management will publish (online only) peerreviewed archival quality papers that advance the state-of-the-art and practical applications of network and service management. Theoretical research contributions (presenting new concepts and techniques) and applied contributions (reporting on experiences and experiments with actual systems) will be encouraged. These transactions will focus on the key technical issues related to: Management Models, Architectures and Frameworks; Service Provisioning, Reliability and Quality Assurance; Management Functions; Enabling Technologies; Information and Communication Models; Policies; Applications and Case Studies; Emerging Technologies and Standards.
期刊最新文献
Entity-Level Autoregressive Relational Triple Extraction Toward Knowledge Graph Construction for Network Operation and Maintenance BiTrustChain: A Dual-Blockchain Empowered Dynamic Vehicle Trust Management for Malicious Detection in IoV A UAV-Aided Digital Twin Framework for IoT Networks With High Accuracy and Synchronization AI-Empowered Multivariate Probabilistic Forecasting: A Key Enabler for Sustainability in Open RAN Privacy-Preserving and Collusion-Resistant Data Query Scheme for Vehicular Platoons
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1