首页 > 最新文献

IEEE Systems Journal最新文献

英文 中文
Caching for Doubly Selective Fading Channels via Model-Agnostic Meta-Reinforcement Learning 通过模型诊断元强化学习实现双选择性衰减信道缓存
IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-22 DOI: 10.1109/JSYST.2024.3442958
Weibao He;Fasheng Zhou;Dong Tang;Fang Fang;Wei Chen
Edge caching is expected to alleviate the traffic consumption in next-generation communications. In this article, we consider the transmission delay in wideband communications deteriorated by rapid user movements, where the frequency-selective wideband fading channels become fast time-varying and hence doubly-selective due to the user movements. To preferably allocate the caching resource in such circumstance, we introduce a coordinated caching network and accordingly formulate an allocation problem. However, the formulated problem is shown to be NP-hard. By considering the extremely high computational complexity to solve the NP-hard problem by traditional optimization algorithm, and considering only a few samples can be obtained for each training instance due to shortened coherence-time in the dynamical doubly selective fading channels, we propose a model-agnostic meta-reinforcement learning method to address the formulated problem. Particularly, the proposed method can efficiently recognize the unstable mobile channels and accordingly cache to reduce the overall transmission delay while only requires a few training samples. Numerical simulations are performed to verify the effectiveness of the proposed method and results show that the proposed one outperforms the commonly adopted existing method of deep-deterministic-policy-gradient learning in terms of average delay and cache hit rate.
边缘缓存有望缓解下一代通信的流量消耗。在本文中,我们考虑了宽带通信中因用户快速移动而恶化的传输延迟问题,在这种情况下,频率选择性宽带衰落信道会因用户移动而变得快速时变,从而产生双重选择性。在这种情况下,为了更好地分配缓存资源,我们引入了协调缓存网络,并相应地提出了一个分配问题。然而,所提出的问题被证明是 NP 难的。考虑到用传统优化算法解决 NP 难问题的计算复杂度极高,并且由于动态双选择性衰落信道的相干时间缩短,每个训练实例只能获得少量样本,我们提出了一种与模型无关的元强化学习方法来解决所提出的问题。特别是,所提出的方法能有效识别不稳定的移动信道,并相应地缓存以减少整体传输延迟,同时只需要少量的训练样本。为了验证所提方法的有效性,我们进行了数值模拟,结果表明,所提方法在平均延迟和缓存命中率方面优于目前普遍采用的深度-确定性-策略梯度学习方法。
{"title":"Caching for Doubly Selective Fading Channels via Model-Agnostic Meta-Reinforcement Learning","authors":"Weibao He;Fasheng Zhou;Dong Tang;Fang Fang;Wei Chen","doi":"10.1109/JSYST.2024.3442958","DOIUrl":"https://doi.org/10.1109/JSYST.2024.3442958","url":null,"abstract":"Edge caching is expected to alleviate the traffic consumption in next-generation communications. In this article, we consider the transmission delay in wideband communications deteriorated by rapid user movements, where the frequency-selective wideband fading channels become fast time-varying and hence \u0000<italic>doubly-selective</i>\u0000 due to the user movements. To preferably allocate the caching resource in such circumstance, we introduce a coordinated caching network and accordingly formulate an allocation problem. However, the formulated problem is shown to be NP-hard. By considering the extremely high computational complexity to solve the NP-hard problem by traditional optimization algorithm, and considering only a few samples can be obtained for each training instance due to shortened coherence-time in the dynamical doubly selective fading channels, we propose a model-agnostic meta-reinforcement learning method to address the formulated problem. Particularly, the proposed method can efficiently recognize the unstable mobile channels and accordingly cache to reduce the overall transmission delay while only requires a few training samples. Numerical simulations are performed to verify the effectiveness of the proposed method and results show that the proposed one outperforms the commonly adopted existing method of deep-deterministic-policy-gradient learning in terms of average delay and cache hit rate.","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"18 3","pages":"1776-1785"},"PeriodicalIF":4.0,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cell-Free Massive MIMO-NOMA Systems With Nonreciprocal Channels: Performance Analysis and Calibration Method Design 具有非互易信道的无小区大规模 MIMO-NOMA 系统:性能分析与校准方法设计
IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-21 DOI: 10.1109/JSYST.2024.3437769
Siyi Li;Xiaojie Fang;Heng Dong;Wei Wu;Fugang Liu;Zhuoming Li
The integration of communication technologies is regarded as a potential direction of future network. Combining cell-free massive multiple-input multiple-output (CF-mMIMO) with nonorthogonal multiple access (NOMA) can achieve substantial access and uniform coverage, but it also poses challenges on channel state information (CSI) acquisition. Although systems operating in time division duplex can approximate uplink CSI for downlink precoding design, the performance degradation resulting from nonreciprocity is still nonnegligible. This article proposes a calibration method to improve system sum rate of CF-mMIMO-NOMA with nonreciprocal channels. The proposed method exploits the impact of all access points (APs) on achievable rate to provide a prioritization and calibrates the selected APs orderly, finding an optimal compromise between pilot overhead and performance gain. The order and number of calibrated APs can be adjusted according to the parameters including coherence interval, number of users, etc. Based on the calibration method, a power allocation algorithm focusing on maximizing the minimum rate is presented. The nonconvex initial model is transformed into a standard second-order cone programming problem through slack variables for bisection solution. Simulation results validate the importance of calibration and indicate that the proposed method provides enhanced achievable rate with flexibility and adaptability.
通信技术的整合被视为未来网络的一个潜在发展方向。将无小区大规模多输入多输出(CF-mMIMO)与非正交多址(NOMA)相结合,可以实现大量接入和均匀覆盖,但也给信道状态信息(CSI)获取带来了挑战。虽然以时分双工方式运行的系统可以近似上行 CSI 来进行下行预编码设计,但非互易性导致的性能下降仍然不可忽视。本文提出了一种校准方法,以提高具有非互易信道的 CF-mMIMO-NOMA 的系统总和率。所提方法利用所有接入点(AP)对可实现速率的影响来提供优先级,并有序地校准所选的接入点,在试点开销和性能增益之间找到最佳折中方案。校准接入点的顺序和数量可根据相干性间隔、用户数量等参数进行调整。根据校准方法,提出了一种功率分配算法,重点是最大化最小速率。通过松弛变量将非凸初始模型转化为标准的二阶圆锥编程问题,从而实现分段求解。仿真结果验证了校准的重要性,并表明所提出的方法具有灵活性和适应性,可提高可实现速率。
{"title":"Cell-Free Massive MIMO-NOMA Systems With Nonreciprocal Channels: Performance Analysis and Calibration Method Design","authors":"Siyi Li;Xiaojie Fang;Heng Dong;Wei Wu;Fugang Liu;Zhuoming Li","doi":"10.1109/JSYST.2024.3437769","DOIUrl":"https://doi.org/10.1109/JSYST.2024.3437769","url":null,"abstract":"The integration of communication technologies is regarded as a potential direction of future network. Combining cell-free massive multiple-input multiple-output (CF-mMIMO) with nonorthogonal multiple access (NOMA) can achieve substantial access and uniform coverage, but it also poses challenges on channel state information (CSI) acquisition. Although systems operating in time division duplex can approximate uplink CSI for downlink precoding design, the performance degradation resulting from nonreciprocity is still nonnegligible. This article proposes a calibration method to improve system sum rate of CF-mMIMO-NOMA with nonreciprocal channels. The proposed method exploits the impact of all access points (APs) on achievable rate to provide a prioritization and calibrates the selected APs orderly, finding an optimal compromise between pilot overhead and performance gain. The order and number of calibrated APs can be adjusted according to the parameters including coherence interval, number of users, etc. Based on the calibration method, a power allocation algorithm focusing on maximizing the minimum rate is presented. The nonconvex initial model is transformed into a standard second-order cone programming problem through slack variables for bisection solution. Simulation results validate the importance of calibration and indicate that the proposed method provides enhanced achievable rate with flexibility and adaptability.","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"18 3","pages":"1729-1740"},"PeriodicalIF":4.0,"publicationDate":"2024-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169673","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Classifying Interoperability Problems in Cyber-Physical Systems: Empirical Cases From OpenWrt 网络物理系统中互操作性问题的分类:来自 OpenWrt 的经验案例
IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-19 DOI: 10.1109/JSYST.2024.3426541
Joana L. F. P. Cardoso;Paul T. Grogan;Michael J. Pennock
Reuse of cyber-physical modules is critical to accelerate the development times and reduce design costs of cyber-physical systems (CPS). Successful module reuse depends on the ability to mitigate interoperability problems. Over the years, different communities have worked to understand and mitigate these problems leading to different interoperability models, oftentimes tied to particular domains. One important question, tackled in this article, is whether these models can help with the design of CPS. Specifically, this article evaluates a real-world example of a CPS against the levels of conceptual interoperability model (LCIM). The approach followed leverages natural language processing techniques to narrow an initial set of system changes down to a subset of problems, some of which are interoperability problems. This effort enables a comparison between the empirical evidence found and the interoperability model considered. The results obtained show that the observed interoperability problems fit well under the multilevel categories proposed by the LCIM. Furthermore, the LCIM seems to provide a complete description for the interoperability problems found, checking for fit and completeness. A significant impact of the results obtained is the enabling of more focused discussions of the key attributes of said problems and subsequent identification and assessment of the effectiveness of existing mitigation approaches.
网络物理模块的重复使用对于加快网络物理系统(CPS)的开发时间和降低设计成本至关重要。模块的成功重用取决于缓解互操作性问题的能力。多年来,不同的团体一直致力于了解和缓解这些问题,从而形成了不同的互操作性模型,这些模型通常与特定领域相关。本文探讨的一个重要问题是,这些模型是否有助于 CPS 的设计。具体来说,本文将根据概念互操作性模型(LCIM)的等级评估一个真实世界中的 CPS 实例。所采用的方法是利用自然语言处理技术,将最初的系统更改范围缩小到问题子集,其中一些是互操作性问题。通过这项工作,可以对所发现的经验证据和所考虑的互操作性模型进行比较。结果表明,观察到的互操作性问题与 LCIM 提出的多层次类别非常吻合。此外,LCIM 似乎对发现的互操作性问题提供了完整的描述,并检查了其适合性和完整性。所获结果的一个重要影响是,可以对上述问题的关键属性进行更有针对性的讨论,并随后确定和评估现有缓解方法的有效性。
{"title":"Classifying Interoperability Problems in Cyber-Physical Systems: Empirical Cases From OpenWrt","authors":"Joana L. F. P. Cardoso;Paul T. Grogan;Michael J. Pennock","doi":"10.1109/JSYST.2024.3426541","DOIUrl":"https://doi.org/10.1109/JSYST.2024.3426541","url":null,"abstract":"Reuse of cyber-physical modules is critical to accelerate the development times and reduce design costs of cyber-physical systems (CPS). Successful module reuse depends on the ability to mitigate interoperability problems. Over the years, different communities have worked to understand and mitigate these problems leading to different interoperability models, oftentimes tied to particular domains. One important question, tackled in this article, is whether these models can help with the design of CPS. Specifically, this article evaluates a real-world example of a CPS against the levels of conceptual interoperability model (LCIM). The approach followed leverages natural language processing techniques to narrow an initial set of system changes down to a subset of problems, some of which are interoperability problems. This effort enables a comparison between the empirical evidence found and the interoperability model considered. The results obtained show that the observed interoperability problems fit well under the multilevel categories proposed by the LCIM. Furthermore, the LCIM seems to provide a complete description for the interoperability problems found, checking for fit and completeness. A significant impact of the results obtained is the enabling of more focused discussions of the key attributes of said problems and subsequent identification and assessment of the effectiveness of existing mitigation approaches.","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"18 3","pages":"1658-1668"},"PeriodicalIF":4.0,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fine-Grained Analysis of Cache-Enabled Multiantenna Networks With Interference Nulling 利用干扰归零对支持高速缓存的多天线网络进行精细分析
IF 4.4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-15 DOI: 10.1109/jsyst.2024.3435687
Tianming Feng, Chenyu Wu, Xiaodong Zheng, Peilin Chen, Yilong Liu, Shuai Han
{"title":"Fine-Grained Analysis of Cache-Enabled Multiantenna Networks With Interference Nulling","authors":"Tianming Feng, Chenyu Wu, Xiaodong Zheng, Peilin Chen, Yilong Liu, Shuai Han","doi":"10.1109/jsyst.2024.3435687","DOIUrl":"https://doi.org/10.1109/jsyst.2024.3435687","url":null,"abstract":"","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"35 1","pages":""},"PeriodicalIF":4.4,"publicationDate":"2024-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142183283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Competition-Awareness Partial Task Offloading and UAV Deployment for Multitier Parallel Computational Internet of Vehicles 多层并行计算车联网的竞争意识部分任务卸载和无人机部署
IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-15 DOI: 10.1109/JSYST.2024.3439746
Peng Qin;Yang Fu;Rui Ding;Haoting He
Vehicular edge computing is poised to meet the requirements of emerging applications in Internet of Vehicles (IoV) by offloading computation tasks from resource-limited vehicles to edge. However, the space-time-dynamic offloading demands of vehicle users (VUs) can hardly be satisfied only by road side units (RSUs) due to their fixed resource deployment and incomplete coverage. To this end, in this article, we design a multitier IoV system, where RSU, parked cars, and unmanned aerial vehicles (UAVs) serve as edge platforms to offer computing services. To fully utilize the multitier resources, the tasks generated by VUs can be split into multiple parts and executed in parallel on local processors as well as edge servers. Under this arrangement, we formulate a joint UAV deployment and partial task offloading problem to minimize the system cost, which includes processing delay, energy consumption, and rental price. We then develop a heuristic UAV deployment method to optimize the coverage of multitier network. Moreover, a distributed task offloading approach based on multiagent deep reinforcement learning is proposed to achieve cooperative decision makings and load balancing, thereby overcoming the adversarial competition among VUs. Experimental evaluations reveal that compared to state-of-the-art schemes that rely on a centralized controller, the proposed approach achieves superior performance with higher implementation efficiency while avoiding extra information exchange overhead.
通过将计算任务从资源有限的车辆卸载到边缘,车载边缘计算有望满足车联网(IoV)新兴应用的要求。然而,由于路侧单元(RSU)的固定资源部署和不完全覆盖,仅靠路侧单元很难满足车辆用户(VU)的时空动态卸载需求。为此,本文设计了一种多层物联网系统,将 RSU、停放的汽车和无人机(UAV)作为提供计算服务的边缘平台。为了充分利用多层资源,可以将 VU 生成的任务分成多个部分,在本地处理器和边缘服务器上并行执行。在这种安排下,我们提出了一个联合无人机部署和部分任务卸载问题,以最小化系统成本,其中包括处理延迟、能耗和租赁价格。然后,我们开发了一种启发式无人机部署方法,以优化多层网络的覆盖范围。此外,我们还提出了一种基于多代理深度强化学习的分布式任务卸载方法,以实现合作决策和负载平衡,从而克服无人机之间的对抗性竞争。实验评估表明,与依赖于集中控制器的最先进方案相比,所提出的方法在避免额外信息交换开销的同时,以更高的实施效率实现了更优越的性能。
{"title":"Competition-Awareness Partial Task Offloading and UAV Deployment for Multitier Parallel Computational Internet of Vehicles","authors":"Peng Qin;Yang Fu;Rui Ding;Haoting He","doi":"10.1109/JSYST.2024.3439746","DOIUrl":"https://doi.org/10.1109/JSYST.2024.3439746","url":null,"abstract":"Vehicular edge computing is poised to meet the requirements of emerging applications in Internet of Vehicles (IoV) by offloading computation tasks from resource-limited vehicles to edge. However, the space-time-dynamic offloading demands of vehicle users (VUs) can hardly be satisfied only by road side units (RSUs) due to their fixed resource deployment and incomplete coverage. To this end, in this article, we design a multitier IoV system, where RSU, parked cars, and unmanned aerial vehicles (UAVs) serve as edge platforms to offer computing services. To fully utilize the multitier resources, the tasks generated by VUs can be split into multiple parts and executed in parallel on local processors as well as edge servers. Under this arrangement, we formulate a joint UAV deployment and partial task offloading problem to minimize the system cost, which includes processing delay, energy consumption, and rental price. We then develop a heuristic UAV deployment method to optimize the coverage of multitier network. Moreover, a distributed task offloading approach based on multiagent deep reinforcement learning is proposed to achieve cooperative decision makings and load balancing, thereby overcoming the adversarial competition among VUs. Experimental evaluations reveal that compared to state-of-the-art schemes that rely on a centralized controller, the proposed approach achieves superior performance with higher implementation efficiency while avoiding extra information exchange overhead.","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"18 3","pages":"1753-1764"},"PeriodicalIF":4.0,"publicationDate":"2024-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Intelligent Secure Fault Classification and Identification Scheme for Mining Valuable Information in IIoT 用于挖掘物联网有价值信息的智能安全故障分类和识别方案
IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-14 DOI: 10.1109/JSYST.2024.3437185
Ying Zhang;Wenyuan Zhang;Xiaoyu Jiang;Yuzhong Sun;Baiming Feng;Naixue Xiong;Tianyu Wo
As a pivotal component of Industry 4.0, the Industrial Internet of Things has significantly propelled the intelligent evolution of industrial systems. However, this advancement has led to increased system complexity and scale, consequently increasing the likelihood of operational failures and potential security threats. Performing an effective analysis of log information and accurately identifying system fault categories has become a substantial challenge for system administrators. To extract valuable insights from edge device logs more efficiently and ensure system security, we propose an intelligent method for system fault detection and localization. Our approach begins with an analysis of the system's source code to extract message and fault classification templates. Subsequently, real-time preprocessing of the log stream occurs, employing techniques, such as pattern matching and statistical grouping, to construct a feature vector–matrix. The detection and identification module then discerns abnormal feature vectors, using a fast classification algorithm to categorize these anomalies and determine fault types. The proposed methodology undergoes testing on our edge cloud platform. The experimental results demonstrate that the method achieves a fault detection and localization accuracy that exceeds 98%.
作为工业 4.0 的重要组成部分,工业物联网极大地推动了工业系统的智能化发展。然而,这一进步也导致了系统复杂性和规模的增加,从而增加了发生运行故障和潜在安全威胁的可能性。对日志信息进行有效分析并准确识别系统故障类别已成为系统管理员面临的巨大挑战。为了更有效地从边缘设备日志中提取有价值的信息并确保系统安全,我们提出了一种用于系统故障检测和定位的智能方法。我们的方法首先分析系统源代码,提取信息和故障分类模板。随后,利用模式匹配和统计分组等技术对日志流进行实时预处理,以构建特征向量矩阵。然后,检测和识别模块会识别异常特征向量,使用快速分类算法对这些异常进行分类,并确定故障类型。所提出的方法在我们的边缘云平台上进行了测试。实验结果表明,该方法的故障检测和定位精度超过 98%。
{"title":"An Intelligent Secure Fault Classification and Identification Scheme for Mining Valuable Information in IIoT","authors":"Ying Zhang;Wenyuan Zhang;Xiaoyu Jiang;Yuzhong Sun;Baiming Feng;Naixue Xiong;Tianyu Wo","doi":"10.1109/JSYST.2024.3437185","DOIUrl":"https://doi.org/10.1109/JSYST.2024.3437185","url":null,"abstract":"As a pivotal component of Industry 4.0, the Industrial Internet of Things has significantly propelled the intelligent evolution of industrial systems. However, this advancement has led to increased system complexity and scale, consequently increasing the likelihood of operational failures and potential security threats. Performing an effective analysis of log information and accurately identifying system fault categories has become a substantial challenge for system administrators. To extract valuable insights from edge device logs more efficiently and ensure system security, we propose an intelligent method for system fault detection and localization. Our approach begins with an analysis of the system's source code to extract message and fault classification templates. Subsequently, real-time preprocessing of the log stream occurs, employing techniques, such as pattern matching and statistical grouping, to construct a feature vector–matrix. The detection and identification module then discerns abnormal feature vectors, using a fast classification algorithm to categorize these anomalies and determine fault types. The proposed methodology undergoes testing on our edge cloud platform. The experimental results demonstrate that the method achieves a fault detection and localization accuracy that exceeds 98%.","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"18 3","pages":"1705-1716"},"PeriodicalIF":4.0,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169660","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adaptive Reinforcement Learning for Fault-Tolerant Optimal Consensus Control of Nonlinear Canonical Multiagent Systems With Actuator Loss of Effectiveness 执行器失效情况下非线性典型多代理系统的容错优化共识控制的自适应强化学习
IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-13 DOI: 10.1109/JSYST.2024.3433023
Boyan Zhu;Liang Zhang;Ben Niu;Ning Zhao
This article addresses the adaptive optimized consensus tracking control problem of nonlinear multiagent systems (MASs) via a reinforcement learning (RL) algorithm. Specifically, the nonlinear high-order MASs are formulated in a canonical form, with considerations for both actuator effectiveness loss and time-varying bias faults. First, neural networks (NNs) are utilized to approximate unknown nonlinear dynamics, and a state identifier and a fault estimator based on NNs are established, both of which are essential for evaluating state information and bias faults, respectively. Second, to achieve a high-order canonical dynamic consensus and enhance the efficiency of the consensus control strategy, a sliding-mode mechanism is employed to regulate tracking errors. Moreover, we develop an adaptive NN-based fault-tolerant optimal control method by integrating the sliding-mode mechanism with an actor–critic structured RL algorithm. It is proved that the outputs of the MASs precisely align with the desired reference signals, while ensuring the boundedness of all closed-loop signals. Finally, the proposed control methodology's effectiveness is validated through a simulation example.
本文通过强化学习(RL)算法解决了非线性多代理系统(MAS)的自适应优化共识跟踪控制问题。具体来说,非线性高阶 MAS 采用典型形式,同时考虑了执行器效力损失和时变偏差故障。首先,利用神经网络(NN)来逼近未知的非线性动力学,并建立了基于 NN 的状态识别器和故障估计器,这两者分别对评估状态信息和偏差故障至关重要。其次,为了实现高阶典型动态共识并提高共识控制策略的效率,我们采用了滑模机制来调节跟踪误差。此外,我们还将滑模机制与行为批判结构化 RL 算法相结合,开发了一种基于 NN 的自适应容错优化控制方法。事实证明,MAS 的输出与所需的参考信号精确一致,同时确保所有闭环信号的有界性。最后,通过一个仿真实例验证了所提出的控制方法的有效性。
{"title":"Adaptive Reinforcement Learning for Fault-Tolerant Optimal Consensus Control of Nonlinear Canonical Multiagent Systems With Actuator Loss of Effectiveness","authors":"Boyan Zhu;Liang Zhang;Ben Niu;Ning Zhao","doi":"10.1109/JSYST.2024.3433023","DOIUrl":"https://doi.org/10.1109/JSYST.2024.3433023","url":null,"abstract":"This article addresses the adaptive optimized consensus tracking control problem of nonlinear multiagent systems (MASs) via a reinforcement learning (RL) algorithm. Specifically, the nonlinear high-order MASs are formulated in a canonical form, with considerations for both actuator effectiveness loss and time-varying bias faults. First, neural networks (NNs) are utilized to approximate unknown nonlinear dynamics, and a state identifier and a fault estimator based on NNs are established, both of which are essential for evaluating state information and bias faults, respectively. Second, to achieve a high-order canonical dynamic consensus and enhance the efficiency of the consensus control strategy, a sliding-mode mechanism is employed to regulate tracking errors. Moreover, we develop an adaptive NN-based fault-tolerant optimal control method by integrating the sliding-mode mechanism with an actor–critic structured RL algorithm. It is proved that the outputs of the MASs precisely align with the desired reference signals, while ensuring the boundedness of all closed-loop signals. Finally, the proposed control methodology's effectiveness is validated through a simulation example.","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"18 3","pages":"1681-1692"},"PeriodicalIF":4.0,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169659","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multiple Reconfigurable Intelligent Surface-Based Index Modulation With Optimal Combination 基于优化组合的多重可重构智能面基指数调制
IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-13 DOI: 10.1109/JSYST.2024.3425866
Nadhira Azizah Suwanda;Hye Yeong Lee;Soo Young Shin
This study proposes multiple reconfigurable intelligent surface (RIS)-based index modulation (IM), called MRB-IM, to improve channel capacity by activating one or more RISs within multiple RIS (MRIS). Generally, MRIS suffers from the secondary reflection that, in imperfect condition, can be considered as inter-RIS interference (IRI) within MRIS. On the other hand, the proposed MRB-IM has a larger capacity but less of an effect on IRI because it only happens between the active MRIS. The optimal combination algorithm is applied to select the best possible RIS combinations for the activation bits in IM. The simulation is done to support the analytical channel capacity based on mutual information and bit error rate. The results show that the proposed system offers higher capacity and a lower bit error rate compared to the conventional MRIS. The complexity of the system is mentioned as another benefit of MRB-IM.
本研究提出了基于多重可重构智能表面(RIS)的索引调制(IM),称为 MRB-IM,通过激活多重 RIS(MRIS)中的一个或多个 RIS 来提高信道容量。一般来说,MRIS 会受到二次反射的影响,在不完善的条件下,二次反射可被视为 MRIS 内的 RIS 间干扰(IRI)。另一方面,拟议的 MRB-IM 容量更大,但对 IRI 的影响较小,因为 IRI 只发生在活动的 MRIS 之间。优化组合算法用于为 IM 中的激活比特选择最佳可能的 RIS 组合。仿真支持基于互信息和误码率的分析信道容量。结果表明,与传统的 MRIS 相比,提议的系统具有更高的容量和更低的误码率。系统的复杂性是 MRB-IM 的另一个优点。
{"title":"Multiple Reconfigurable Intelligent Surface-Based Index Modulation With Optimal Combination","authors":"Nadhira Azizah Suwanda;Hye Yeong Lee;Soo Young Shin","doi":"10.1109/JSYST.2024.3425866","DOIUrl":"https://doi.org/10.1109/JSYST.2024.3425866","url":null,"abstract":"This study proposes multiple reconfigurable intelligent surface (RIS)-based index modulation (IM), called MRB-IM, to improve channel capacity by activating one or more RISs within multiple RIS (MRIS). Generally, MRIS suffers from the secondary reflection that, in imperfect condition, can be considered as inter-RIS interference (IRI) within MRIS. On the other hand, the proposed MRB-IM has a larger capacity but less of an effect on IRI because it only happens between the active MRIS. The optimal combination algorithm is applied to select the best possible RIS combinations for the activation bits in IM. The simulation is done to support the analytical channel capacity based on mutual information and bit error rate. The results show that the proposed system offers higher capacity and a lower bit error rate compared to the conventional MRIS. The complexity of the system is mentioned as another benefit of MRB-IM.","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"18 3","pages":"1651-1657"},"PeriodicalIF":4.0,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Roadmap to the Integration Between Systems Engineering and Circular Design to Develop Sustainable Industrial Product 系统工程与循环设计相结合开发可持续工业产品的路线图
IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-06 DOI: 10.1109/JSYST.2024.3435025
Eugenio Brusa;Chiara Gastaldi;Cristiana Delprete;Lorenzo Giorio
The achievement of sustainable development goals requires implementing a design approach to the industrial product development aimed to reduce waste, and to increase value, in accordance to principles of the “circular economy.” To mitigate the product obsolescence rate, the design activity aims at making the product multifunctional, its life longer and its maintainability more effective. Moreover, the product must be easily reparable, adaptable to operating conditions, friendly updatable, and reusable after decommissioning. Those targets affect the design methodology, and require some suitable tools. This article investigates how the “model-based systems engineering” is applied to the “circular design,” to provide a sustainable product life, and to regenerate the system, while decommissioning. Particularly, the direct experience of machine designer of industrial product, being the result of material processing and manufacturing, is considered. Are matter of discussion the identification of some issues related to sustainability and decommissioning, the methodologic tools useful to integrate the two approaches, the impact on the metamodeling activity, and the interoperable tool chain exploited. An industrial test case, as the automated guided vehicle, is preliminarily discussed to describe the implementation of the above-mentioned concepts and to identify any potential critical issues.
要实现可持续发展目标,就必须根据 "循环经济 "原则,在工业产品开发中采用旨在减少浪费和提高价值的设计方法。为了降低产品淘汰率,设计活动的目标是使产品具有多功能性,延长其使用寿命,提高其可维护性。此外,产品还必须易于维修、适应运行条件、可友好更新、退役后可重复使用。这些目标影响着设计方法,需要一些合适的工具。本文研究了如何将 "基于模型的系统工程 "应用到 "循环设计 "中,以提供可持续的产品寿命,并在退役时使系统再生。特别是考虑了作为材料加工和制造结果的工业产品的机械设计师的直接经验。讨论的主题包括:确定与可持续性和退役相关的一些问题、整合两种方法的有用方法工具、对元建模活动的影响以及所利用的可互操作工具链。初步讨论了一个工业测试案例,如自动导引车,以描述上述概念的实施情况,并确定任何潜在的关键问题。
{"title":"A Roadmap to the Integration Between Systems Engineering and Circular Design to Develop Sustainable Industrial Product","authors":"Eugenio Brusa;Chiara Gastaldi;Cristiana Delprete;Lorenzo Giorio","doi":"10.1109/JSYST.2024.3435025","DOIUrl":"10.1109/JSYST.2024.3435025","url":null,"abstract":"The achievement of sustainable development goals requires implementing a design approach to the industrial product development aimed to reduce waste, and to increase value, in accordance to principles of the “circular economy.” To mitigate the product obsolescence rate, the design activity aims at making the product multifunctional, its life longer and its maintainability more effective. Moreover, the product must be easily reparable, adaptable to operating conditions, friendly updatable, and reusable after decommissioning. Those targets affect the design methodology, and require some suitable tools. This article investigates how the “model-based systems engineering” is applied to the “circular design,” to provide a sustainable product life, and to regenerate the system, while decommissioning. Particularly, the direct experience of machine designer of industrial product, being the result of material processing and manufacturing, is considered. Are matter of discussion the identification of some issues related to sustainability and decommissioning, the methodologic tools useful to integrate the two approaches, the impact on the metamodeling activity, and the interoperable tool chain exploited. An industrial test case, as the automated guided vehicle, is preliminarily discussed to describe the implementation of the above-mentioned concepts and to identify any potential critical issues.","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"18 3","pages":"1693-1704"},"PeriodicalIF":4.0,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141932722","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Approximate Optimal Strategy for Multiagent System Pursuit–Evasion Game 多代理系统追逐-入侵博弈的近似最优策略
IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-02 DOI: 10.1109/JSYST.2024.3432796
Zhiqiang Xu;Dengxiu Yu;Yan-Jun Liu;Zhen Wang
In this article, we propose an approximate optimal control strategy for a class of nonlinear multiagent system pursuit–evasion games. Herein, multiple pursuers aim to capture multiple evaders trying to evade capture. Under the competitive framework, agents not only pursue their individual goals but also consider coordination with their teammates to achieve collective objectives. However, maintaining cohesion with teammates in existing distributed control methods has always been a challenge. To enhance team coordination, we employ a graph-theoretic approach to represent the relationships between agents. Based on this, we design a dynamic target graph algorithm to enhance the coordination among pursuers. The approximate optimal strategies for each agent are solved by utilizing the Hamilton–Jacobi–Isaacs equations of the system. As solving these equations becomes computationally intensive in multiagent scenarios, we propose a value-based single network adaptive critic network architecture. In addition, we consider scenarios where the numbers of agents on both sides are inconsistent and address the phenomenon of input saturation. Moreover, we provide sufficient conditions to prove the system's stability. Finally, simulations conducted in two representative scenarios, multiple-pursuer-one-evader and multiple-pursuer-multiple-evader, demonstrate the effectiveness of our proposed algorithm.
本文提出了一类非线性多代理系统追逐-逃避博弈的近似最优控制策略。在这种博弈中,多个追逐者的目标是捕获试图逃避捕获的多个逃避者。在竞争框架下,代理不仅要追求个人目标,还要考虑与队友协调以实现集体目标。然而,在现有的分布式控制方法中,如何保持与队友的凝聚力一直是个难题。为了加强团队协调,我们采用图论方法来表示代理之间的关系。在此基础上,我们设计了一种动态目标图算法来加强追逐者之间的协调。通过利用系统的汉密尔顿-雅各比-伊萨克方程来求解每个代理的近似最优策略。由于在多代理场景中求解这些方程需要大量计算,我们提出了一种基于价值的单网络自适应批判网络架构。此外,我们还考虑了双方代理数量不一致的情况,并解决了输入饱和现象。此外,我们还提供了证明系统稳定性的充分条件。最后,我们在两个具有代表性的场景--多追逐者-一追逐者和多追逐者-多追逐者-中进行了模拟,证明了我们提出的算法的有效性。
{"title":"Approximate Optimal Strategy for Multiagent System Pursuit–Evasion Game","authors":"Zhiqiang Xu;Dengxiu Yu;Yan-Jun Liu;Zhen Wang","doi":"10.1109/JSYST.2024.3432796","DOIUrl":"10.1109/JSYST.2024.3432796","url":null,"abstract":"In this article, we propose an approximate optimal control strategy for a class of nonlinear multiagent system pursuit–evasion games. Herein, multiple pursuers aim to capture multiple evaders trying to evade capture. Under the competitive framework, agents not only pursue their individual goals but also consider coordination with their teammates to achieve collective objectives. However, maintaining cohesion with teammates in existing distributed control methods has always been a challenge. To enhance team coordination, we employ a graph-theoretic approach to represent the relationships between agents. Based on this, we design a dynamic target graph algorithm to enhance the coordination among pursuers. The approximate optimal strategies for each agent are solved by utilizing the Hamilton–Jacobi–Isaacs equations of the system. As solving these equations becomes computationally intensive in multiagent scenarios, we propose a value-based single network adaptive critic network architecture. In addition, we consider scenarios where the numbers of agents on both sides are inconsistent and address the phenomenon of input saturation. Moreover, we provide sufficient conditions to prove the system's stability. Finally, simulations conducted in two representative scenarios, multiple-pursuer-one-evader and multiple-pursuer-multiple-evader, demonstrate the effectiveness of our proposed algorithm.","PeriodicalId":55017,"journal":{"name":"IEEE Systems Journal","volume":"18 3","pages":"1669-1680"},"PeriodicalIF":4.0,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141886175","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Systems Journal
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1