Ahmad Mohamad Mezher , Carlos Lester Dueñas Santos , Juan Pablo Astudillo Leon , Julián Cárdenas-Barrera , Julian Meng , Eduardo Castillo-Guerra
{"title":"探索智能电网通信中集成 ML 的 RPL 路由的模型可转移性:跨城市场景的比较分析","authors":"Ahmad Mohamad Mezher , Carlos Lester Dueñas Santos , Juan Pablo Astudillo Leon , Julián Cárdenas-Barrera , Julian Meng , Eduardo Castillo-Guerra","doi":"10.1016/j.adhoc.2024.103626","DOIUrl":null,"url":null,"abstract":"<div><p>Machine learning (ML) techniques have demonstrated considerable effectiveness when integrated into routing protocols to enhance the performance of Smart Grid Networks. However, their performance across diverse real-world scenarios remains a topic of exploration. In this study, we evaluate the performance and transferability of four ML models—Long Short-Term Memory (LSTM), Feedforward Neural Network (FF), Decision Trees, and Naive Bayes—across three distinct scenarios: Barcelona, Montreal, and Rome. Through rigorous experimentation and analysis, we analyze the varying efficacy of these models in different scenarios. Our results demonstrate that LSTM outperforms other models in the Montreal and Rome scenarios, highlighting its effectiveness in predicting the optimal forwarding node for packet transmission. In contrast, Ensemble of Bagged Decision Trees emerge as the optimal model for the Barcelona scenario, exhibiting strong performance in selecting the most suitable forwarding node for packet transmission. However, the transferability of these models to scenarios where they were not trained is notably limited, as evidenced by their decreased performance on datasets from other scenarios. This observation underscores the importance of considering the data characteristics when selecting ML models for real-world applications. Furthermore, we identify that the distribution of nodes within datasets significantly influences model performance, highlighting its critical role in determining model efficacy. These insights contribute to a deeper understanding of the challenges inherent in transferring ML models between real-world scenarios, providing valuable guidance for practitioners and researchers alike in optimizing ML applications in Smart Grid Networks.</p></div>","PeriodicalId":55555,"journal":{"name":"Ad Hoc Networks","volume":"164 ","pages":"Article 103626"},"PeriodicalIF":4.4000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Exploring model transferability in ML-integrated RPL routing for smart grid communication: A comparative analysis across urban scenarios\",\"authors\":\"Ahmad Mohamad Mezher , Carlos Lester Dueñas Santos , Juan Pablo Astudillo Leon , Julián Cárdenas-Barrera , Julian Meng , Eduardo Castillo-Guerra\",\"doi\":\"10.1016/j.adhoc.2024.103626\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Machine learning (ML) techniques have demonstrated considerable effectiveness when integrated into routing protocols to enhance the performance of Smart Grid Networks. However, their performance across diverse real-world scenarios remains a topic of exploration. In this study, we evaluate the performance and transferability of four ML models—Long Short-Term Memory (LSTM), Feedforward Neural Network (FF), Decision Trees, and Naive Bayes—across three distinct scenarios: Barcelona, Montreal, and Rome. Through rigorous experimentation and analysis, we analyze the varying efficacy of these models in different scenarios. Our results demonstrate that LSTM outperforms other models in the Montreal and Rome scenarios, highlighting its effectiveness in predicting the optimal forwarding node for packet transmission. In contrast, Ensemble of Bagged Decision Trees emerge as the optimal model for the Barcelona scenario, exhibiting strong performance in selecting the most suitable forwarding node for packet transmission. However, the transferability of these models to scenarios where they were not trained is notably limited, as evidenced by their decreased performance on datasets from other scenarios. This observation underscores the importance of considering the data characteristics when selecting ML models for real-world applications. Furthermore, we identify that the distribution of nodes within datasets significantly influences model performance, highlighting its critical role in determining model efficacy. These insights contribute to a deeper understanding of the challenges inherent in transferring ML models between real-world scenarios, providing valuable guidance for practitioners and researchers alike in optimizing ML applications in Smart Grid Networks.</p></div>\",\"PeriodicalId\":55555,\"journal\":{\"name\":\"Ad Hoc Networks\",\"volume\":\"164 \",\"pages\":\"Article 103626\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2024-08-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ad Hoc Networks\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1570870524002373\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ad Hoc Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1570870524002373","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
将机器学习(ML)技术集成到路由协议中以提高智能电网网络的性能,已显示出相当大的功效。然而,它们在不同现实世界场景中的表现仍是一个有待探索的课题。在本研究中,我们评估了四种 ML 模型--长短期记忆 (LSTM)、前馈神经网络 (FF)、决策树和 Naive Bayes--在三种不同场景下的性能和可移植性:巴塞罗那、蒙特利尔和罗马。通过严格的实验和分析,我们分析了这些模型在不同场景中的不同功效。我们的结果表明,在蒙特利尔和罗马场景中,LSTM 的表现优于其他模型,突出了它在预测数据包传输的最佳转发节点方面的有效性。相比之下,在巴塞罗那场景中,袋装决策树集合成为最佳模型,在为数据包传输选择最合适的转发节点方面表现出色。然而,这些模型在没有经过训练的场景中的可移植性明显受到限制,它们在其他场景的数据集上的性能下降就证明了这一点。这一观察结果强调了在为实际应用选择 ML 模型时考虑数据特征的重要性。此外,我们还发现数据集内节点的分布对模型性能有显著影响,突出了节点在决定模型功效方面的关键作用。这些见解有助于深入理解在真实世界场景之间转移 ML 模型所固有的挑战,为从业人员和研究人员优化智能电网网络中的 ML 应用提供有价值的指导。
Exploring model transferability in ML-integrated RPL routing for smart grid communication: A comparative analysis across urban scenarios
Machine learning (ML) techniques have demonstrated considerable effectiveness when integrated into routing protocols to enhance the performance of Smart Grid Networks. However, their performance across diverse real-world scenarios remains a topic of exploration. In this study, we evaluate the performance and transferability of four ML models—Long Short-Term Memory (LSTM), Feedforward Neural Network (FF), Decision Trees, and Naive Bayes—across three distinct scenarios: Barcelona, Montreal, and Rome. Through rigorous experimentation and analysis, we analyze the varying efficacy of these models in different scenarios. Our results demonstrate that LSTM outperforms other models in the Montreal and Rome scenarios, highlighting its effectiveness in predicting the optimal forwarding node for packet transmission. In contrast, Ensemble of Bagged Decision Trees emerge as the optimal model for the Barcelona scenario, exhibiting strong performance in selecting the most suitable forwarding node for packet transmission. However, the transferability of these models to scenarios where they were not trained is notably limited, as evidenced by their decreased performance on datasets from other scenarios. This observation underscores the importance of considering the data characteristics when selecting ML models for real-world applications. Furthermore, we identify that the distribution of nodes within datasets significantly influences model performance, highlighting its critical role in determining model efficacy. These insights contribute to a deeper understanding of the challenges inherent in transferring ML models between real-world scenarios, providing valuable guidance for practitioners and researchers alike in optimizing ML applications in Smart Grid Networks.
期刊介绍:
The Ad Hoc Networks is an international and archival journal providing a publication vehicle for complete coverage of all topics of interest to those involved in ad hoc and sensor networking areas. The Ad Hoc Networks considers original, high quality and unpublished contributions addressing all aspects of ad hoc and sensor networks. Specific areas of interest include, but are not limited to:
Mobile and Wireless Ad Hoc Networks
Sensor Networks
Wireless Local and Personal Area Networks
Home Networks
Ad Hoc Networks of Autonomous Intelligent Systems
Novel Architectures for Ad Hoc and Sensor Networks
Self-organizing Network Architectures and Protocols
Transport Layer Protocols
Routing protocols (unicast, multicast, geocast, etc.)
Media Access Control Techniques
Error Control Schemes
Power-Aware, Low-Power and Energy-Efficient Designs
Synchronization and Scheduling Issues
Mobility Management
Mobility-Tolerant Communication Protocols
Location Tracking and Location-based Services
Resource and Information Management
Security and Fault-Tolerance Issues
Hardware and Software Platforms, Systems, and Testbeds
Experimental and Prototype Results
Quality-of-Service Issues
Cross-Layer Interactions
Scalability Issues
Performance Analysis and Simulation of Protocols.