Jun-ichi Kani;Takahiro Suzuki;Yasutaka Kimura;Shin Kaneko;Sang-Yuep Kim;Tomoaki Yoshida
Future access and metro networks are expected to provide advanced broadband services and the evolution of mobile x-haul in a flexible manner. This paper first reviews the progress and challenges of disaggregation and virtualization technologies to meet this expectation with a focus on their application to optical access networks. Next, it describes future access and metro integrated networking in which disaggregation and virtualization technologies will play important roles.
{"title":"Disaggregation and virtualization for future access and metro networks [Invited Tutorial]","authors":"Jun-ichi Kani;Takahiro Suzuki;Yasutaka Kimura;Shin Kaneko;Sang-Yuep Kim;Tomoaki Yoshida","doi":"10.1364/JOCN.534303","DOIUrl":"https://doi.org/10.1364/JOCN.534303","url":null,"abstract":"Future access and metro networks are expected to provide advanced broadband services and the evolution of mobile x-haul in a flexible manner. This paper first reviews the progress and challenges of disaggregation and virtualization technologies to meet this expectation with a focus on their application to optical access networks. Next, it describes future access and metro integrated networking in which disaggregation and virtualization technologies will play important roles.","PeriodicalId":50103,"journal":{"name":"Journal of Optical Communications and Networking","volume":"17 1","pages":"A1-A12"},"PeriodicalIF":4.0,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10734083","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142517860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The increasing complexity and dynamicity of future optical networks will necessitate accurate, fast, and low-cost quality-of-transmission (QoT) estimation. Machine learning-based QoT estimation models have shown promise in ensuring the reliability and efficiency of optical networks. However, the data-driven nature of these models impedes their application in practical settings. To address the problem of limited data availability in the target domain, known as the few-shot learning problem, we propose a domain adversarial adaptation method that aligns the distributions of representations from different source and target domains by minimizing the domain discrepancy quantified by the approximate Wasserstein distance. We demonstrate the method’s effectiveness through a theoretical proof and two example adaptations, i.e., from simulation to experimental data and from experimental to real network data. Our method consistently outperforms commonly used artificial neural networks (ANNs) and more advanced transfer learning approaches for various target domain data sizes. More profoundly, we show two ways to further improve the prediction accuracy, i.e., incorporating unlabeled target domain data in the training stage and utilizing the learned representations after training to train a new ANN with a reweighting strategy. In the adaptation to actual field data, our model, trained with only eight labeled network data samples, outperforms an ANN trained with 300 samples, thus reducing the labeled target domain data burden by more than 97%. The proposed method’s adaptability and generalizability make it a promising solution for accurate QoT estimation with low data requirements in future intelligent optical networks.
{"title":"Domain adversarial adaptation framework for few-shot QoT estimation in optical networks","authors":"Zhuojun Cai;Qihang Wang;Yubin Deng;Peng Zhang;Gai Zhou;Yang Li;Faisal Nadeem Khan","doi":"10.1364/JOCN.530915","DOIUrl":"https://doi.org/10.1364/JOCN.530915","url":null,"abstract":"The increasing complexity and dynamicity of future optical networks will necessitate accurate, fast, and low-cost quality-of-transmission (QoT) estimation. Machine learning-based QoT estimation models have shown promise in ensuring the reliability and efficiency of optical networks. However, the data-driven nature of these models impedes their application in practical settings. To address the problem of limited data availability in the target domain, known as the few-shot learning problem, we propose a domain adversarial adaptation method that aligns the distributions of representations from different source and target domains by minimizing the domain discrepancy quantified by the approximate Wasserstein distance. We demonstrate the method’s effectiveness through a theoretical proof and two example adaptations, i.e., from simulation to experimental data and from experimental to real network data. Our method consistently outperforms commonly used artificial neural networks (ANNs) and more advanced transfer learning approaches for various target domain data sizes. More profoundly, we show two ways to further improve the prediction accuracy, i.e., incorporating unlabeled target domain data in the training stage and utilizing the learned representations after training to train a new ANN with a reweighting strategy. In the adaptation to actual field data, our model, trained with only eight labeled network data samples, outperforms an ANN trained with 300 samples, thus reducing the labeled target domain data burden by more than 97%. The proposed method’s adaptability and generalizability make it a promising solution for accurate QoT estimation with low data requirements in future intelligent optical networks.","PeriodicalId":50103,"journal":{"name":"Journal of Optical Communications and Networking","volume":"16 11","pages":"1133-1144"},"PeriodicalIF":4.0,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142518221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jose Manuel Rivas-Moscoso;Farhad Arpanaei;Gabriel Otero Perez;Jose David Martinez Jimenez;Juan Pedro Fernandez-Palacios;Oscar Gonzalez de Dios;Luis Miguel Contreras;Alfonso Sanchez-Macian;Jose Alberto Hernandez;David Larrabeiti;Jesus Folgueira
In this paper, we introduce TEFNET24, a reference multi-layer hierarchical network topology that spans from access to core networks, specifically designed to meet the demands of beyond 5G and prepared for next-generation 6G communication systems. This topology, inspired by the actual network deployments of Telefónica in medium-sized countries (or large federal states) in Europe and America, integrates both IP and optical (DWDM) layers to provide a comprehensive framework for network design, optimization, and analysis. Our primary contribution is the development of an open-source benchmarking network, accessible to both researchers and industry professionals. This resource aims to facilitate the study and advancement of integrated IP and optical networks, allowing researchers to address key challenges such as traffic aggregation, latency reduction, cost efficiency, and support for advanced applications. We provide guidelines for utilizing this benchmark network, enabling users to evaluate and enhance their solutions for AI-driven network management, ultra-reliable low-latency communication, enhanced mobile broadband, and massive machine-type communication. By sharing this detailed and practical benchmarking network, we seek to foster innovation and collaboration within the optical network community, driving forward the capabilities and performance of future communication networks. A dataset with TEFNET24 details is provided.
在本文中,我们介绍了 TEFNET24,这是一种从接入网到核心网的参考多层分级网络拓扑结构,专为满足 5G 之后的需求而设计,并为下一代 6G 通信系统做好了准备。该拓扑受西班牙电信公司在欧洲和美洲中型国家(或大型联邦州)实际网络部署的启发,集成了 IP 层和光(DWDM)层,为网络设计、优化和分析提供了一个全面的框架。我们的主要贡献是开发了一个开源基准网络,供研究人员和行业专业人员使用。该资源旨在促进对集成 IP 和光网络的研究和发展,使研究人员能够应对流量聚合、降低延迟、成本效率和支持高级应用等关键挑战。我们提供了使用该基准网络的指南,使用户能够评估和改进其解决方案,以实现人工智能驱动的网络管理、超可靠的低延迟通信、增强型移动宽带和大规模机器型通信。通过共享这一详细而实用的基准网络,我们力求促进光网络社区内的创新与合作,推动未来通信网络的能力和性能向前发展。我们提供了包含 TEFNET24 详细信息的数据集。
{"title":"TEFNET24: reference packet optical network topology for edge to core transport","authors":"Jose Manuel Rivas-Moscoso;Farhad Arpanaei;Gabriel Otero Perez;Jose David Martinez Jimenez;Juan Pedro Fernandez-Palacios;Oscar Gonzalez de Dios;Luis Miguel Contreras;Alfonso Sanchez-Macian;Jose Alberto Hernandez;David Larrabeiti;Jesus Folgueira","doi":"10.1364/JOCN.533131","DOIUrl":"https://doi.org/10.1364/JOCN.533131","url":null,"abstract":"In this paper, we introduce TEFNET24, a reference multi-layer hierarchical network topology that spans from access to core networks, specifically designed to meet the demands of beyond 5G and prepared for next-generation 6G communication systems. This topology, inspired by the actual network deployments of Telefónica in medium-sized countries (or large federal states) in Europe and America, integrates both IP and optical (DWDM) layers to provide a comprehensive framework for network design, optimization, and analysis. Our primary contribution is the development of an open-source benchmarking network, accessible to both researchers and industry professionals. This resource aims to facilitate the study and advancement of integrated IP and optical networks, allowing researchers to address key challenges such as traffic aggregation, latency reduction, cost efficiency, and support for advanced applications. We provide guidelines for utilizing this benchmark network, enabling users to evaluate and enhance their solutions for AI-driven network management, ultra-reliable low-latency communication, enhanced mobile broadband, and massive machine-type communication. By sharing this detailed and practical benchmarking network, we seek to foster innovation and collaboration within the optical network community, driving forward the capabilities and performance of future communication networks. A dataset with TEFNET24 details is provided.","PeriodicalId":50103,"journal":{"name":"Journal of Optical Communications and Networking","volume":"16 11","pages":"G28-G39"},"PeriodicalIF":4.0,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142518162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yue Pang;Min Zhang;Yanli Liu;Xiangbin Li;Yidi Wang;Yahang Huan;Zhuo Liu;Jin Li;Danshi Wang
The optical network encompasses numerous devices and links, generating a significant volume of logs. Analyzing these logs is significant for network optimization, failure diagnosis, and health monitoring. However, the large-scale and diverse formats of optical network logs present several challenges, including the high cost and difficulty of manual processing, insufficient semantic understanding in existing analysis methods, and the strict requirements for data security and privacy. Generative artificial intelligence (GAI) with powerful language understanding and generation capabilities has the potential to address these challenges. Large language models (LLMs) as a concrete realization of GAI are well-suited for analyzing DCI logs, replacing human experts and enhancing accuracy. Additionally, LLMs enable intelligent interactions with network administrators, automating tasks and improving operational efficiency. Moreover, fine-tuning with open-source LLMs protects data privacy and enhances log analysis accuracy. Therefore, we introduce LLMs and propose a log analysis method with instruction tuning using LLaMA2 for log parsing, anomaly detection and classification, anomaly analysis, and report generation. Real log data extracted from the field-deployed network was used to design and construct instruction tuning datasets. We utilized the dataset for instruction tuning and demonstrated and evaluated the effectiveness of the proposed scheme. The results indicate that this scheme improves the performance of log analysis tasks, especially a 14% improvement in exact match rate for log parsing, a 13% improvement in F1-score for anomaly detection and classification, and a 23% improvement in usability for anomaly analysis, compared with the best baselines.
光网络包含众多设备和链路,会产生大量日志。分析这些日志对网络优化、故障诊断和健康监控意义重大。然而,光网络日志规模庞大、格式多样,这给我们带来了诸多挑战,包括人工处理成本高、难度大,现有分析方法对语义的理解不足,以及对数据安全和隐私的严格要求。具有强大语言理解和生成能力的生成人工智能(GAI)有望应对这些挑战。大型语言模型(LLMs)作为 GAI 的具体实现形式,非常适合分析 DCI 日志,可替代人类专家并提高准确性。此外,LLM 还能与网络管理员进行智能互动,实现任务自动化并提高运行效率。此外,使用开源 LLM 进行微调可保护数据隐私并提高日志分析的准确性。因此,我们引入了 LLM,并提出了一种使用 LLaMA2 进行指令调整的日志分析方法,用于日志解析、异常检测和分类、异常分析以及报告生成。从现场部署的网络中提取的真实日志数据被用于设计和构建指令调整数据集。我们利用该数据集进行了指令调整,并演示和评估了建议方案的有效性。结果表明,与最佳基线相比,该方案提高了日志分析任务的性能,特别是日志解析的精确匹配率提高了 14%,异常检测和分类的 F1 分数提高了 13%,异常分析的可用性提高了 23%。
{"title":"Large language model-based optical network log analysis using LLaMA2 with instruction tuning","authors":"Yue Pang;Min Zhang;Yanli Liu;Xiangbin Li;Yidi Wang;Yahang Huan;Zhuo Liu;Jin Li;Danshi Wang","doi":"10.1364/JOCN.527874","DOIUrl":"https://doi.org/10.1364/JOCN.527874","url":null,"abstract":"The optical network encompasses numerous devices and links, generating a significant volume of logs. Analyzing these logs is significant for network optimization, failure diagnosis, and health monitoring. However, the large-scale and diverse formats of optical network logs present several challenges, including the high cost and difficulty of manual processing, insufficient semantic understanding in existing analysis methods, and the strict requirements for data security and privacy. Generative artificial intelligence (GAI) with powerful language understanding and generation capabilities has the potential to address these challenges. Large language models (LLMs) as a concrete realization of GAI are well-suited for analyzing DCI logs, replacing human experts and enhancing accuracy. Additionally, LLMs enable intelligent interactions with network administrators, automating tasks and improving operational efficiency. Moreover, fine-tuning with open-source LLMs protects data privacy and enhances log analysis accuracy. Therefore, we introduce LLMs and propose a log analysis method with instruction tuning using LLaMA2 for log parsing, anomaly detection and classification, anomaly analysis, and report generation. Real log data extracted from the field-deployed network was used to design and construct instruction tuning datasets. We utilized the dataset for instruction tuning and demonstrated and evaluated the effectiveness of the proposed scheme. The results indicate that this scheme improves the performance of log analysis tasks, especially a 14% improvement in exact match rate for log parsing, a 13% improvement in F1-score for anomaly detection and classification, and a 23% improvement in usability for anomaly analysis, compared with the best baselines.","PeriodicalId":50103,"journal":{"name":"Journal of Optical Communications and Networking","volume":"16 11","pages":"1116-1132"},"PeriodicalIF":4.0,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142517897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Some data center networks have already started to use optical circuit switching (OCS) with potential performance benefits, including high capacity, low latency, and energy efficiency. This paper addresses a switching network design to maximize the network radix, i.e., the number of terminals connected to the network under the condition that a specified number of identical switches with the size $N times N$