不再有数据孤岛:利用时态知识图谱统一微服务故障诊断

IF 5.5 2区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS IEEE Transactions on Services Computing Pub Date : 2024-10-31 DOI:10.1109/TSC.2024.3489444
Shenglin Zhang;Yongxin Zhao;Sibo Xia;Shirui Wei;Yongqian Sun;Chenyu Zhao;Shiyu Ma;Junhua Kuang;Bolin Zhu;Lemeng Pan;Yicheng Guo;Dan Pei
{"title":"不再有数据孤岛:利用时态知识图谱统一微服务故障诊断","authors":"Shenglin Zhang;Yongxin Zhao;Sibo Xia;Shirui Wei;Yongqian Sun;Chenyu Zhao;Shiyu Ma;Junhua Kuang;Bolin Zhu;Lemeng Pan;Yicheng Guo;Dan Pei","doi":"10.1109/TSC.2024.3489444","DOIUrl":null,"url":null,"abstract":"Microservices improve the scalability and flexibility of monolithic architectures to accommodate the evolution of software systems, but the complexity and dynamics of microservices challenge system reliability. Ensuring microservice quality requires efficient failure diagnosis, including detection and triage. Failure detection involves identifying anomalous behavior within the system, while triage entails classifying the failure type and directing it to the engineering team for resolution. Unfortunately, current approaches reliant on single-modal monitoring data, such as metrics, logs, or traces, cannot capture all failures and neglect interconnections among multimodal data, leading to erroneous diagnoses. Recent multimodal data fusion studies struggle to achieve deep integration, limiting diagnostic accuracy due to insufficiently captured interdependencies. Therefore, we propose \n<italic>UniDiag</i>\n, which leverages temporal knowledge graphs to fuse multimodal data for effective failure diagnosis. \n<italic>UniDiag</i>\n applies a simple yet effective stream-based anomaly detection method to reduce computational cost and a novel microservice-oriented graph embedding method to represent the state of systems comprehensively. To assess the performance of \n<italic>UniDiag</i>\n, we conduct extensive evaluation experiments using datasets from two benchmark microservice systems, demonstrating its superiority over existing methods and affirming the efficacy of multimodal data fusion. Additionally, we have publicly made the code and data available to facilitate further research.","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"17 6","pages":"4013-4026"},"PeriodicalIF":5.5000,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"No More Data Silos: Unified Microservice Failure Diagnosis With Temporal Knowledge Graph\",\"authors\":\"Shenglin Zhang;Yongxin Zhao;Sibo Xia;Shirui Wei;Yongqian Sun;Chenyu Zhao;Shiyu Ma;Junhua Kuang;Bolin Zhu;Lemeng Pan;Yicheng Guo;Dan Pei\",\"doi\":\"10.1109/TSC.2024.3489444\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Microservices improve the scalability and flexibility of monolithic architectures to accommodate the evolution of software systems, but the complexity and dynamics of microservices challenge system reliability. Ensuring microservice quality requires efficient failure diagnosis, including detection and triage. Failure detection involves identifying anomalous behavior within the system, while triage entails classifying the failure type and directing it to the engineering team for resolution. Unfortunately, current approaches reliant on single-modal monitoring data, such as metrics, logs, or traces, cannot capture all failures and neglect interconnections among multimodal data, leading to erroneous diagnoses. Recent multimodal data fusion studies struggle to achieve deep integration, limiting diagnostic accuracy due to insufficiently captured interdependencies. Therefore, we propose \\n<italic>UniDiag</i>\\n, which leverages temporal knowledge graphs to fuse multimodal data for effective failure diagnosis. \\n<italic>UniDiag</i>\\n applies a simple yet effective stream-based anomaly detection method to reduce computational cost and a novel microservice-oriented graph embedding method to represent the state of systems comprehensively. To assess the performance of \\n<italic>UniDiag</i>\\n, we conduct extensive evaluation experiments using datasets from two benchmark microservice systems, demonstrating its superiority over existing methods and affirming the efficacy of multimodal data fusion. Additionally, we have publicly made the code and data available to facilitate further research.\",\"PeriodicalId\":13255,\"journal\":{\"name\":\"IEEE Transactions on Services Computing\",\"volume\":\"17 6\",\"pages\":\"4013-4026\"},\"PeriodicalIF\":5.5000,\"publicationDate\":\"2024-10-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Services Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10740010/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Services Computing","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10740010/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

微服务提高了单片架构的可扩展性和灵活性,以适应软件系统的发展,但微服务的复杂性和动态性挑战了系统的可靠性。确保微服务质量需要有效的故障诊断,包括检测和分类。故障检测涉及识别系统中的异常行为,而分类则需要对故障类型进行分类,并将其指导给工程团队以解决问题。不幸的是,目前依赖于单模态监测数据(如指标、日志或轨迹)的方法无法捕获所有故障,并且忽略了多模态数据之间的相互联系,从而导致错误诊断。最近的多模态数据融合研究努力实现深度集成,由于没有充分捕获相互依赖关系,限制了诊断的准确性。因此,我们提出了UniDiag,它利用时间知识图来融合多模态数据以进行有效的故障诊断。UniDiag采用一种简单有效的基于流的异常检测方法来降低计算成本,采用一种新颖的面向服务的微图嵌入方法来全面表征系统状态。为了评估UniDiag的性能,我们使用两个基准微服务系统的数据集进行了广泛的评估实验,展示了其优于现有方法的优势,并肯定了多模态数据融合的有效性。此外,我们已经公开了代码和数据,以方便进一步的研究。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
No More Data Silos: Unified Microservice Failure Diagnosis With Temporal Knowledge Graph
Microservices improve the scalability and flexibility of monolithic architectures to accommodate the evolution of software systems, but the complexity and dynamics of microservices challenge system reliability. Ensuring microservice quality requires efficient failure diagnosis, including detection and triage. Failure detection involves identifying anomalous behavior within the system, while triage entails classifying the failure type and directing it to the engineering team for resolution. Unfortunately, current approaches reliant on single-modal monitoring data, such as metrics, logs, or traces, cannot capture all failures and neglect interconnections among multimodal data, leading to erroneous diagnoses. Recent multimodal data fusion studies struggle to achieve deep integration, limiting diagnostic accuracy due to insufficiently captured interdependencies. Therefore, we propose UniDiag , which leverages temporal knowledge graphs to fuse multimodal data for effective failure diagnosis. UniDiag applies a simple yet effective stream-based anomaly detection method to reduce computational cost and a novel microservice-oriented graph embedding method to represent the state of systems comprehensively. To assess the performance of UniDiag , we conduct extensive evaluation experiments using datasets from two benchmark microservice systems, demonstrating its superiority over existing methods and affirming the efficacy of multimodal data fusion. Additionally, we have publicly made the code and data available to facilitate further research.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Services Computing
IEEE Transactions on Services Computing COMPUTER SCIENCE, INFORMATION SYSTEMS-COMPUTER SCIENCE, SOFTWARE ENGINEERING
CiteScore
11.50
自引率
6.20%
发文量
278
审稿时长
>12 weeks
期刊介绍: IEEE Transactions on Services Computing encompasses the computing and software aspects of the science and technology of services innovation research and development. It places emphasis on algorithmic, mathematical, statistical, and computational methods central to services computing. Topics covered include Service Oriented Architecture, Web Services, Business Process Integration, Solution Performance Management, and Services Operations and Management. The transactions address mathematical foundations, security, privacy, agreement, contract, discovery, negotiation, collaboration, and quality of service for web services. It also covers areas like composite web service creation, business and scientific applications, standards, utility models, business process modeling, integration, collaboration, and more in the realm of Services Computing.
期刊最新文献
Lightweight and Privacy-Preserving Reconfigurable Authentication Scheme for IoT Devices Online Service Placement, Task Scheduling, and Resource Allocation in Hierarchical Collaborative MEC Systems Towards Cost-Optimal Policies for DAGs to Utilize IaaS Clouds with Online Learning Enhancing Federated Learning through Layer-wise Aggregation over Non-IID Data TrustPay: A Dual-Layer Blockchain-based Framework for Trusted Service Transaction
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1