首页 > 最新文献

IEEE Networking Letters最新文献

英文 中文
IEEE Networking Letters Society Information IEEE网络通讯协会信息
Pub Date : 2026-01-16 DOI: 10.1109/LNET.2025.3636374
{"title":"IEEE Networking Letters Society Information","authors":"","doi":"10.1109/LNET.2025.3636374","DOIUrl":"https://doi.org/10.1109/LNET.2025.3636374","url":null,"abstract":"","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 4","pages":"C3-C3"},"PeriodicalIF":0.0,"publicationDate":"2026-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11355766","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145982350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Networking Letters Author Guidelines IEEE网络通讯作者指南
Pub Date : 2026-01-16 DOI: 10.1109/LNET.2025.3636372
{"title":"IEEE Networking Letters Author Guidelines","authors":"","doi":"10.1109/LNET.2025.3636372","DOIUrl":"https://doi.org/10.1109/LNET.2025.3636372","url":null,"abstract":"","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 4","pages":"367-368"},"PeriodicalIF":0.0,"publicationDate":"2026-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11355765","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145982366","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Networking Letters Publication Information IEEE网络通讯出版信息
Pub Date : 2025-10-17 DOI: 10.1109/LNET.2025.3615346
{"title":"IEEE Networking Letters Publication Information","authors":"","doi":"10.1109/LNET.2025.3615346","DOIUrl":"https://doi.org/10.1109/LNET.2025.3615346","url":null,"abstract":"","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 3","pages":"C2-C2"},"PeriodicalIF":0.0,"publicationDate":"2025-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11206549","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352078","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Networking Letters Author Guidelines IEEE网络通讯作者指南
Pub Date : 2025-10-17 DOI: 10.1109/LNET.2025.3615348
{"title":"IEEE Networking Letters Author Guidelines","authors":"","doi":"10.1109/LNET.2025.3615348","DOIUrl":"https://doi.org/10.1109/LNET.2025.3615348","url":null,"abstract":"","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 3","pages":"244-245"},"PeriodicalIF":0.0,"publicationDate":"2025-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11206548","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Guest Editorial Special Issue on Generative AI and Large Language Models-Enabled Edge Intelligence 客座编辑特刊:生成人工智能和大语言模型支持的边缘智能
Pub Date : 2025-10-17 DOI: 10.1109/LNET.2025.3613807
Geng Sun;Octavia A. Dobre;Adlen Ksentini;Dusit Niyato;Wen Wu;Jiacheng Wang
The IEEE Networking Letters special issue on Generative AI (GAI) and Large Language Models (LLMs)-enabled Edge Intelligence explores the latest advancements and applications of GAI and LLMs at the network edge, which aim to address the growing demand for intelligence and adaptability driven by the rapid evolution of modern communication systems. Unlike traditional artificial intelligence (AI) technologies, GAI and LLMs possess powerful self-learning, data-modeling, and context-aware capabilities. Specifically, GAI can extract deep features and semantic information from large amounts of data, which allows it to make intelligent predictions and optimize processes for a flexible response to changes in complex environments. Moreover, by simulating network behaviors under different scenarios and generating new data points, GAI can optimize network architecture and expand training datasets to improve model robustness and generalization. Additionally, LLMs can rapidly adapt to diverse tasks through a few-shot learning. Furthermore, they can incorporate techniques such as retrieval-augmented generation (RAG), thereby strengthening their capacity to handle complex text-based tasks and achieve precise information generation and intelligent interaction.
《IEEE网络快报》关于生成式人工智能(GAI)和支持边缘智能的大型语言模型(llm)的特刊探讨了GAI和llm在网络边缘的最新进展和应用,旨在满足现代通信系统快速发展对智能和适应性日益增长的需求。与传统的人工智能(AI)技术不同,GAI和llm具有强大的自我学习、数据建模和上下文感知能力。具体来说,GAI可以从大量数据中提取深层特征和语义信息,从而使其能够做出智能预测并优化流程,以灵活应对复杂环境中的变化。此外,通过模拟不同场景下的网络行为,生成新的数据点,GAI可以优化网络架构,扩展训练数据集,提高模型的鲁棒性和泛化能力。此外,法学硕士可以通过几次学习快速适应不同的任务。此外,它们还可以结合诸如检索增强生成(retrieval-augmented generation, RAG)之类的技术,从而增强它们处理复杂的基于文本的任务的能力,实现精确的信息生成和智能交互。
{"title":"Guest Editorial Special Issue on Generative AI and Large Language Models-Enabled Edge Intelligence","authors":"Geng Sun;Octavia A. Dobre;Adlen Ksentini;Dusit Niyato;Wen Wu;Jiacheng Wang","doi":"10.1109/LNET.2025.3613807","DOIUrl":"https://doi.org/10.1109/LNET.2025.3613807","url":null,"abstract":"The IEEE Networking Letters special issue on Generative AI (GAI) and Large Language Models (LLMs)-enabled Edge Intelligence explores the latest advancements and applications of GAI and LLMs at the network edge, which aim to address the growing demand for intelligence and adaptability driven by the rapid evolution of modern communication systems. Unlike traditional artificial intelligence (AI) technologies, GAI and LLMs possess powerful self-learning, data-modeling, and context-aware capabilities. Specifically, GAI can extract deep features and semantic information from large amounts of data, which allows it to make intelligent predictions and optimize processes for a flexible response to changes in complex environments. Moreover, by simulating network behaviors under different scenarios and generating new data points, GAI can optimize network architecture and expand training datasets to improve model robustness and generalization. Additionally, LLMs can rapidly adapt to diverse tasks through a few-shot learning. Furthermore, they can incorporate techniques such as retrieval-augmented generation (RAG), thereby strengthening their capacity to handle complex text-based tasks and achieve precise information generation and intelligent interaction.","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 3","pages":"157-160"},"PeriodicalIF":0.0,"publicationDate":"2025-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11206727","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Networking Letters Society Information IEEE网络通讯协会信息
Pub Date : 2025-10-17 DOI: 10.1109/LNET.2025.3615350
{"title":"IEEE Networking Letters Society Information","authors":"","doi":"10.1109/LNET.2025.3615350","DOIUrl":"https://doi.org/10.1109/LNET.2025.3615350","url":null,"abstract":"","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 3","pages":"C3-C3"},"PeriodicalIF":0.0,"publicationDate":"2025-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11206546","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AI-Driven Dynamic Network Slicing Optimization Leveraging Temporal Graph Networks 利用时间图网络的人工智能驱动的动态网络切片优化
Pub Date : 2025-10-06 DOI: 10.1109/LNET.2025.3617577
George Makropoulos;Harilaos Koumaras;Nancy Alonistioti
As 5th Generation (5G) and Beyond 5G (B5G) networks evolve, dynamic resource allocation and management is crucial for supporting the diversity of devices and the mixed data traffic types. Network slicing enables the logical segmentation of an infrastructure to meet specific Quality of Service (QoS) requirements posed by applications, but factors such as fluctuating traffic, user mobility, and cross-slice interference, pose challenges towards proactive resource allocation. Traditional methods struggle with these factors, leading to inefficiencies. Therefore, this letter explores the concept of an AI-driven network performance prediction and resource allocation framework using Temporal Graph Networks (TGNs). By integrating TGN with the NS-3 simulator, the work in this letter demonstrates an efficient approach to predict network throughput. The proposed solution advances spatiotemporal Artificial Intelligence (AI) techniques enabling more accurate prediction of network performance and adaptive resource optimization, supporting dynamic network slicing.
随着第五代(5G)和超5G (B5G)网络的发展,动态资源分配和管理对于支持设备的多样性和混合数据流量类型至关重要。网络切片使基础设施的逻辑分段能够满足应用程序提出的特定服务质量(QoS)要求,但是诸如流量波动、用户移动性和横片干扰等因素对主动资源分配提出了挑战。传统方法与这些因素作斗争,导致效率低下。因此,这封信探讨了使用时序图网络(tgn)的人工智能驱动的网络性能预测和资源分配框架的概念。通过将TGN与NS-3模拟器集成,本文的工作展示了一种预测网络吞吐量的有效方法。该解决方案推进了时空人工智能(AI)技术,能够更准确地预测网络性能和自适应资源优化,支持动态网络切片。
{"title":"AI-Driven Dynamic Network Slicing Optimization Leveraging Temporal Graph Networks","authors":"George Makropoulos;Harilaos Koumaras;Nancy Alonistioti","doi":"10.1109/LNET.2025.3617577","DOIUrl":"https://doi.org/10.1109/LNET.2025.3617577","url":null,"abstract":"As 5th Generation (5G) and Beyond 5G (B5G) networks evolve, dynamic resource allocation and management is crucial for supporting the diversity of devices and the mixed data traffic types. Network slicing enables the logical segmentation of an infrastructure to meet specific Quality of Service (QoS) requirements posed by applications, but factors such as fluctuating traffic, user mobility, and cross-slice interference, pose challenges towards proactive resource allocation. Traditional methods struggle with these factors, leading to inefficiencies. Therefore, this letter explores the concept of an AI-driven network performance prediction and resource allocation framework using Temporal Graph Networks (TGNs). By integrating TGN with the NS-3 simulator, the work in this letter demonstrates an efficient approach to predict network throughput. The proposed solution advances spatiotemporal Artificial Intelligence (AI) techniques enabling more accurate prediction of network performance and adaptive resource optimization, supporting dynamic network slicing.","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 4","pages":"362-366"},"PeriodicalIF":0.0,"publicationDate":"2025-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145982365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Toward Robust IDS in Network Security: Handling Class Imbalance With Deep Hybrid Architectures 网络安全中健壮的IDS:用深度混合体系结构处理类不平衡
Pub Date : 2025-09-16 DOI: 10.1109/LNET.2025.3610610
Saransh Shankar;Divjot Singh;Anurag Badoni;Mahendra K. Shukla;Om Jee Pandey;Nadjib Aitsaadi
The growing sophistication of cyberattacks demands Intrusion Detection Systems (IDS) that are both accurate and adaptive to diverse network threats. Traditional IDS often suffer degraded performance due to high-dimensional features and severe class imbalance in network traffic datasets. To address these issues, we propose a hybrid IDS framework integrating four optimized models (XGBoost, Long Short-Term Memory, MiniVGGNet, and AlexNet) enhanced through Random Forest Regressor-based feature selection and the Difficult Set Sampling Technique (DSSTE) for class balancing. Two integration strategies are employed: a hard-voting Ensemble and a Mixture of Experts (MoE) with a gating network for adaptive weighting. Comprehensive hyperparameter tuning via Keras Tuner and RandomizedSearchCV maximizes model performance. Evaluated on the CICIDS-2017 dataset, the system achieves detection rates above 99% with micro-average AUC values near 1.0, demonstrating strong generalization and effectiveness in detecting both majority and minority intrusions. The proposed framework holds strong relevance for security-critical domains, particularly wireless health monitoring systems, where ensuring the confidentiality and integrity of sensitive data is vital, thereby underscoring its suitability for real-world deployment.
越来越复杂的网络攻击要求入侵检测系统(IDS)既准确又能适应各种网络威胁。由于网络流量数据集中的高维特征和严重的类不平衡,传统的入侵检测系统往往会导致性能下降。为了解决这些问题,我们提出了一个混合IDS框架,该框架集成了四个优化模型(XGBoost、长短期记忆、MiniVGGNet和AlexNet),通过基于随机森林回归的特征选择和难集采样技术(DSSTE)进行类平衡。采用了两种集成策略:硬投票集成和带有自适应加权的门控网络的混合专家(MoE)。通过Keras Tuner和RandomizedSearchCV进行全面的超参数调优,使模型性能最大化。在CICIDS-2017数据集上进行评估,该系统的检测率达到99%以上,微平均AUC值接近1.0,在检测多数和少数入侵方面都表现出很强的泛化和有效性。所提议的框架与安全关键领域具有很强的相关性,特别是无线健康监测系统,在这些领域,确保敏感数据的机密性和完整性至关重要,从而强调了其适合于实际部署。
{"title":"Toward Robust IDS in Network Security: Handling Class Imbalance With Deep Hybrid Architectures","authors":"Saransh Shankar;Divjot Singh;Anurag Badoni;Mahendra K. Shukla;Om Jee Pandey;Nadjib Aitsaadi","doi":"10.1109/LNET.2025.3610610","DOIUrl":"https://doi.org/10.1109/LNET.2025.3610610","url":null,"abstract":"The growing sophistication of cyberattacks demands Intrusion Detection Systems (IDS) that are both accurate and adaptive to diverse network threats. Traditional IDS often suffer degraded performance due to high-dimensional features and severe class imbalance in network traffic datasets. To address these issues, we propose a hybrid IDS framework integrating four optimized models (XGBoost, Long Short-Term Memory, MiniVGGNet, and AlexNet) enhanced through Random Forest Regressor-based feature selection and the Difficult Set Sampling Technique (DSSTE) for class balancing. Two integration strategies are employed: a hard-voting Ensemble and a Mixture of Experts (MoE) with a gating network for adaptive weighting. Comprehensive hyperparameter tuning via Keras Tuner and RandomizedSearchCV maximizes model performance. Evaluated on the CICIDS-2017 dataset, the system achieves detection rates above 99% with micro-average AUC values near 1.0, demonstrating strong generalization and effectiveness in detecting both majority and minority intrusions. The proposed framework holds strong relevance for security-critical domains, particularly wireless health monitoring systems, where ensuring the confidentiality and integrity of sensitive data is vital, thereby underscoring its suitability for real-world deployment.","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 4","pages":"357-361"},"PeriodicalIF":0.0,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145982348","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Explaining Intrusion Detection in Industrial Control Systems Through Rule Set Learning 用规则集学习解释工业控制系统中的入侵检测
Pub Date : 2025-07-15 DOI: 10.1109/LNET.2025.3589273
Xinyu Xu;Yingxu Lai;Xiao Zhang
With the increasing openness of network environments in industrial control systems, cybersecurity threats have become increasingly severe. While rule-based intrusion detection remains widely used, such methods are limited by their reliance on expert knowledge and the complexity of rule generation, hindering effective responses. In contrast, deep learning has demonstrated strong capabilities in capturing complex attack patterns from large-scale data, but its lack of interpretability poses significant challenges for deployment in safety-critical industrial settings. To address these challenges, this letter proposes a novel method that integrates deep learning with neuro-symbolic representation to enable automated and high-quality rule generation for intrusion detection. Specifically, the approach leverages a deep neural network to learn a set of candidate rules highly correlated with attack behaviors. A heuristic search strategy is then employed to enhance the interpretability of the rules while maintaining detection effectiveness. Experiments on two public datasets demonstrate that the generated rules achieve high detection accuracy with low false positive rates, while maintaining simplicity and clarity, highlighting its strong potential for deployment in real-world industrial environments.
随着工业控制系统网络环境的日益开放,网络安全威胁日益严峻。尽管基于规则的入侵检测仍然被广泛使用,但这些方法由于依赖专家知识和规则生成的复杂性而受到限制,阻碍了有效的响应。相比之下,深度学习已经证明了从大规模数据中捕获复杂攻击模式的强大能力,但其缺乏可解释性,为在安全关键的工业环境中部署带来了重大挑战。为了应对这些挑战,这封信提出了一种将深度学习与神经符号表示相结合的新方法,以实现入侵检测的自动化和高质量规则生成。具体来说,该方法利用深度神经网络来学习一组与攻击行为高度相关的候选规则。然后采用启发式搜索策略来增强规则的可解释性,同时保持检测的有效性。在两个公共数据集上的实验表明,生成的规则在保持简单和清晰的同时实现了高检测精度和低误报率,突出了其在实际工业环境中部署的强大潜力。
{"title":"Explaining Intrusion Detection in Industrial Control Systems Through Rule Set Learning","authors":"Xinyu Xu;Yingxu Lai;Xiao Zhang","doi":"10.1109/LNET.2025.3589273","DOIUrl":"https://doi.org/10.1109/LNET.2025.3589273","url":null,"abstract":"With the increasing openness of network environments in industrial control systems, cybersecurity threats have become increasingly severe. While rule-based intrusion detection remains widely used, such methods are limited by their reliance on expert knowledge and the complexity of rule generation, hindering effective responses. In contrast, deep learning has demonstrated strong capabilities in capturing complex attack patterns from large-scale data, but its lack of interpretability poses significant challenges for deployment in safety-critical industrial settings. To address these challenges, this letter proposes a novel method that integrates deep learning with neuro-symbolic representation to enable automated and high-quality rule generation for intrusion detection. Specifically, the approach leverages a deep neural network to learn a set of candidate rules highly correlated with attack behaviors. A heuristic search strategy is then employed to enhance the interpretability of the rules while maintaining detection effectiveness. Experiments on two public datasets demonstrate that the generated rules achieve high detection accuracy with low false positive rates, while maintaining simplicity and clarity, highlighting its strong potential for deployment in real-world industrial environments.","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 3","pages":"234-238"},"PeriodicalIF":0.0,"publicationDate":"2025-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145351978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
GSHetero - Grouping and Heterogeneity-Aware Data Placement to Improve MapReduce Performance in Hadoop GSHetero -分组和异构感知数据放置,以提高Hadoop中的MapReduce性能
Pub Date : 2025-07-08 DOI: 10.1109/LNET.2025.3586883
S. Vengadeswaran;P. Dhavakumar;Viji Viswanathan
The execution of MapReduce (MR) applications in Hadoop cluster poses significant challenges due to the non consideration of 1. Grouping semantics in Data-intensive applications, 2. Heterogeneity in the computing nodes resulting in suboptimal block distribution, concentrating execution on fewer nodes, thereby increasing processing time and reducing data locality. This letter proposes improved data placement by exploiting grouping semantics and heterogeneity (GSHetero) to boost MR performance. Initially, the execution traces will be analyzed to identify the data access pattern. The grouping semantics are extracted by applying the MCL algorithm. Then GSHetero algorithm is proposed which re-organises the default data layouts based on grouping semantics to ensure higher parallelism. The efficiency of the GSHetero is demonstrated by the 10-node Hadoop cluster deployed on the cloud by executing the Linear Regression over the weather dataset. The results show that GSHetero improves data locality by 27.4% and CPU utilization by 47%. The efficiency of the GSHetero is also demonstrated by executing Hadoop benchmark (WordCount) on varying cluster sizes (15, 20 nodes) for varying workloads.
由于没有考虑到1. MapReduce (MR)应用程序在Hadoop集群中的执行带来了巨大的挑战。数据密集型应用程序中的分组语义,2。计算节点的异构性导致块分布不理想,将执行集中在较少的节点上,从而增加处理时间并降低数据局部性。这封信建议通过利用分组语义和异构性(GSHetero)来改进数据放置,以提高MR性能。最初,将分析执行跟踪以确定数据访问模式。采用MCL算法提取分组语义。然后提出了GSHetero算法,该算法基于分组语义对默认数据布局进行重新组织,以保证更高的并行度。通过对天气数据集执行线性回归,部署在云上的10节点Hadoop集群证明了GSHetero的效率。结果表明,GSHetero将数据局域性提高了27.4%,CPU利用率提高了47%。GSHetero的效率还通过在不同的集群大小(15、20个节点)上执行Hadoop基准测试(WordCount)来证明。
{"title":"GSHetero - Grouping and Heterogeneity-Aware Data Placement to Improve MapReduce Performance in Hadoop","authors":"S. Vengadeswaran;P. Dhavakumar;Viji Viswanathan","doi":"10.1109/LNET.2025.3586883","DOIUrl":"https://doi.org/10.1109/LNET.2025.3586883","url":null,"abstract":"The execution of MapReduce (MR) applications in Hadoop cluster poses significant challenges due to the non consideration of 1. Grouping semantics in Data-intensive applications, 2. Heterogeneity in the computing nodes resulting in suboptimal block distribution, concentrating execution on fewer nodes, thereby increasing processing time and reducing data locality. This letter proposes improved data placement by exploiting grouping semantics and heterogeneity (GSHetero) to boost MR performance. Initially, the execution traces will be analyzed to identify the data access pattern. The grouping semantics are extracted by applying the MCL algorithm. Then GSHetero algorithm is proposed which re-organises the default data layouts based on grouping semantics to ensure higher parallelism. The efficiency of the GSHetero is demonstrated by the 10-node Hadoop cluster deployed on the cloud by executing the Linear Regression over the weather dataset. The results show that GSHetero improves data locality by 27.4% and CPU utilization by 47%. The efficiency of the GSHetero is also demonstrated by executing Hadoop benchmark (WordCount) on varying cluster sizes (15, 20 nodes) for varying workloads.","PeriodicalId":100628,"journal":{"name":"IEEE Networking Letters","volume":"7 3","pages":"229-233"},"PeriodicalIF":0.0,"publicationDate":"2025-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Networking Letters
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1