An intelligent fuzzy reinforcement learning-based routing algorithm with guaranteed latency and bandwidth in SDN: Application of video conferencing services

IF 5 3区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Egyptian Informatics Journal Pub Date : 2024-08-12 DOI:10.1016/j.eij.2024.100524
Zhiqun Wang , Zikai Jin , Zhen Yang , Wenchao Zhao , Mahdi Mir
{"title":"An intelligent fuzzy reinforcement learning-based routing algorithm with guaranteed latency and bandwidth in SDN: Application of video conferencing services","authors":"Zhiqun Wang ,&nbsp;Zikai Jin ,&nbsp;Zhen Yang ,&nbsp;Wenchao Zhao ,&nbsp;Mahdi Mir","doi":"10.1016/j.eij.2024.100524","DOIUrl":null,"url":null,"abstract":"<div><p>Online video conferencing services connection by multipoint control units leads to communication bottleneck and high latency. Due to the dynamic traffic in routing connection requests to video conferences, the existing routing algorithms face problems such as communication bottlenecks, high latency, congestion, path redundancy, and local optimum. In recent years, the implementation of video conferencing systems using Software-Defined Networking (SDN) provides new opportunities to improve Quality of Service (QoS) with low latency. In this paper, an <u>I</u>ntelligent <u>F</u>uzzy reinforcement learning-based <u>R</u>outing <u>A</u>lgorithm is proposed, which simultaneously <u>G</u>uarantees <u>L</u>atency and <u>B</u>andwidth for online video conferencing services in SDN (named IFRA-GLB). Fuzzy logic mainly performs online routing between an ingress–egress pair. Meanwhile, through ongoing training, reinforcement learning lowers the average number of hops on the path determined by fuzzy model. Enhancements to the convergence capability of IFRA and reduced reliance on network topology are achieved by adjusting link weights using a weighted shortest path algorithm focused on critical nodes. When the network encounters congestion, a deferral module is applied to assign higher priority to requests with lower resource demands. Experimental results demonstrate that IFRA-GLB significantly improves performance and convergence compared to existing solutions, enhancing the QoS for video conferencing services. Specifically, IFRA-GLB increases the average admission rate by 1.96% for MIRA topology and 2.71% for ANSNET topology with 3.5% lower latency.</p></div>","PeriodicalId":56010,"journal":{"name":"Egyptian Informatics Journal","volume":null,"pages":null},"PeriodicalIF":5.0000,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1110866524000872/pdfft?md5=4f2b33eca87a92aa4eaf584a59c7530f&pid=1-s2.0-S1110866524000872-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Egyptian Informatics Journal","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1110866524000872","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Online video conferencing services connection by multipoint control units leads to communication bottleneck and high latency. Due to the dynamic traffic in routing connection requests to video conferences, the existing routing algorithms face problems such as communication bottlenecks, high latency, congestion, path redundancy, and local optimum. In recent years, the implementation of video conferencing systems using Software-Defined Networking (SDN) provides new opportunities to improve Quality of Service (QoS) with low latency. In this paper, an Intelligent Fuzzy reinforcement learning-based Routing Algorithm is proposed, which simultaneously Guarantees Latency and Bandwidth for online video conferencing services in SDN (named IFRA-GLB). Fuzzy logic mainly performs online routing between an ingress–egress pair. Meanwhile, through ongoing training, reinforcement learning lowers the average number of hops on the path determined by fuzzy model. Enhancements to the convergence capability of IFRA and reduced reliance on network topology are achieved by adjusting link weights using a weighted shortest path algorithm focused on critical nodes. When the network encounters congestion, a deferral module is applied to assign higher priority to requests with lower resource demands. Experimental results demonstrate that IFRA-GLB significantly improves performance and convergence compared to existing solutions, enhancing the QoS for video conferencing services. Specifically, IFRA-GLB increases the average admission rate by 1.96% for MIRA topology and 2.71% for ANSNET topology with 3.5% lower latency.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
在 SDN 中保证延迟和带宽的基于模糊强化学习的智能路由算法:视频会议服务的应用
通过多点控制单元连接在线视频会议服务会导致通信瓶颈和高延迟。由于视频会议路由连接请求的流量是动态的,现有的路由算法面临着通信瓶颈、高延迟、拥塞、路径冗余和局部最优等问题。近年来,使用软件定义网络(Software-Defined Networking,SDN)实施视频会议系统为提高低延迟服务质量(QoS)提供了新的机遇。本文提出了一种基于模糊强化学习的智能路由算法(Intelligent Fuzzy reinforcement learning-based Routing Algorithm),可同时保证 SDN 中在线视频会议服务的延迟和带宽(命名为 IFRA-GLB)。模糊逻辑主要执行入口-出口对之间的在线路由。同时,通过持续训练,强化学习降低了模糊模型所确定路径的平均跳数。通过使用加权最短路径算法调整链路权重(侧重于关键节点),增强了 IFRA 的收敛能力,并减少了对网络拓扑结构的依赖。当网络遇到拥塞时,会应用延迟模块,为资源需求较低的请求分配更高的优先级。实验结果表明,与现有解决方案相比,IFRA-GLB 显著提高了性能和收敛性,增强了视频会议服务的 QoS。具体来说,IFRA-GLB 在 MIRA 拓扑中将平均接入率提高了 1.96%,在 ANSNET 拓扑中将平均接入率提高了 2.71%,延迟降低了 3.5%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Egyptian Informatics Journal
Egyptian Informatics Journal Decision Sciences-Management Science and Operations Research
CiteScore
11.10
自引率
1.90%
发文量
59
审稿时长
110 days
期刊介绍: The Egyptian Informatics Journal is published by the Faculty of Computers and Artificial Intelligence, Cairo University. This Journal provides a forum for the state-of-the-art research and development in the fields of computing, including computer sciences, information technologies, information systems, operations research and decision support. Innovative and not-previously-published work in subjects covered by the Journal is encouraged to be submitted, whether from academic, research or commercial sources.
期刊最新文献
HD-MVCNN: High-density ECG signal based diabetic prediction and classification using multi-view convolutional neural network A hybrid encryption algorithm based approach for secure privacy protection of big data in hospitals A new probabilistic linguistic decision-making process based on PL-BWM and improved three-way TODIM methods Interval valued inventory model with different payment strategies for green products under interval valued Grey Wolf optimizer Algorithm fitness function Intelligent SDN to enhance security in IoT networks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1