Yue Pang;Min Zhang;Yanli Liu;Xiangbin Li;Yidi Wang;Yahang Huan;Zhuo Liu;Jin Li;Danshi Wang
The optical network encompasses numerous devices and links, generating a significant volume of logs. Analyzing these logs is significant for network optimization, failure diagnosis, and health monitoring. However, the large-scale and diverse formats of optical network logs present several challenges, including the high cost and difficulty of manual processing, insufficient semantic understanding in existing analysis methods, and the strict requirements for data security and privacy. Generative artificial intelligence (GAI) with powerful language understanding and generation capabilities has the potential to address these challenges. Large language models (LLMs) as a concrete realization of GAI are well-suited for analyzing DCI logs, replacing human experts and enhancing accuracy. Additionally, LLMs enable intelligent interactions with network administrators, automating tasks and improving operational efficiency. Moreover, fine-tuning with open-source LLMs protects data privacy and enhances log analysis accuracy. Therefore, we introduce LLMs and propose a log analysis method with instruction tuning using LLaMA2 for log parsing, anomaly detection and classification, anomaly analysis, and report generation. Real log data extracted from the field-deployed network was used to design and construct instruction tuning datasets. We utilized the dataset for instruction tuning and demonstrated and evaluated the effectiveness of the proposed scheme. The results indicate that this scheme improves the performance of log analysis tasks, especially a 14% improvement in exact match rate for log parsing, a 13% improvement in F1-score for anomaly detection and classification, and a 23% improvement in usability for anomaly analysis, compared with the best baselines.
光网络包含众多设备和链路,会产生大量日志。分析这些日志对网络优化、故障诊断和健康监控意义重大。然而,光网络日志规模庞大、格式多样,这给我们带来了诸多挑战,包括人工处理成本高、难度大,现有分析方法对语义的理解不足,以及对数据安全和隐私的严格要求。具有强大语言理解和生成能力的生成人工智能(GAI)有望应对这些挑战。大型语言模型(LLMs)作为 GAI 的具体实现形式,非常适合分析 DCI 日志,可替代人类专家并提高准确性。此外,LLM 还能与网络管理员进行智能互动,实现任务自动化并提高运行效率。此外,使用开源 LLM 进行微调可保护数据隐私并提高日志分析的准确性。因此,我们引入了 LLM,并提出了一种使用 LLaMA2 进行指令调整的日志分析方法,用于日志解析、异常检测和分类、异常分析以及报告生成。从现场部署的网络中提取的真实日志数据被用于设计和构建指令调整数据集。我们利用该数据集进行了指令调整,并演示和评估了建议方案的有效性。结果表明,与最佳基线相比,该方案提高了日志分析任务的性能,特别是日志解析的精确匹配率提高了 14%,异常检测和分类的 F1 分数提高了 13%,异常分析的可用性提高了 23%。
{"title":"Large language model-based optical network log analysis using LLaMA2 with instruction tuning","authors":"Yue Pang;Min Zhang;Yanli Liu;Xiangbin Li;Yidi Wang;Yahang Huan;Zhuo Liu;Jin Li;Danshi Wang","doi":"10.1364/JOCN.527874","DOIUrl":"https://doi.org/10.1364/JOCN.527874","url":null,"abstract":"The optical network encompasses numerous devices and links, generating a significant volume of logs. Analyzing these logs is significant for network optimization, failure diagnosis, and health monitoring. However, the large-scale and diverse formats of optical network logs present several challenges, including the high cost and difficulty of manual processing, insufficient semantic understanding in existing analysis methods, and the strict requirements for data security and privacy. Generative artificial intelligence (GAI) with powerful language understanding and generation capabilities has the potential to address these challenges. Large language models (LLMs) as a concrete realization of GAI are well-suited for analyzing DCI logs, replacing human experts and enhancing accuracy. Additionally, LLMs enable intelligent interactions with network administrators, automating tasks and improving operational efficiency. Moreover, fine-tuning with open-source LLMs protects data privacy and enhances log analysis accuracy. Therefore, we introduce LLMs and propose a log analysis method with instruction tuning using LLaMA2 for log parsing, anomaly detection and classification, anomaly analysis, and report generation. Real log data extracted from the field-deployed network was used to design and construct instruction tuning datasets. We utilized the dataset for instruction tuning and demonstrated and evaluated the effectiveness of the proposed scheme. The results indicate that this scheme improves the performance of log analysis tasks, especially a 14% improvement in exact match rate for log parsing, a 13% improvement in F1-score for anomaly detection and classification, and a 23% improvement in usability for anomaly analysis, compared with the best baselines.","PeriodicalId":50103,"journal":{"name":"Journal of Optical Communications and Networking","volume":"16 11","pages":"1116-1132"},"PeriodicalIF":4.0,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142517897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Some data center networks have already started to use optical circuit switching (OCS) with potential performance benefits, including high capacity, low latency, and energy efficiency. This paper addresses a switching network design to maximize the network radix, i.e., the number of terminals connected to the network under the condition that a specified number of identical switches with the size $N times N$