首页 > 最新文献

2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)最新文献

英文 中文
Adversarial Machine Learning Against False Data Injection Attack Detection for Smart Grid Demand Response 面向智能电网需求响应的对抗机器学习对抗假数据注入攻击检测
Zhang Guihai, B. Sikdar
Distributed demand response (DR) is used in smart grids to allow utilities to balance the power supply with the demand by modulating the consumer's behavior by varying the price according to consumption patterns and forecasts. False data injection (FDI) attacks of DR can cause large economical losses for utilities, equipment damage, and issues with power flows. Recently, FDI attack detection methods based on deep learning models have been proposed and these methods have better detection performance as compared to traditional approaches. However, deep learning based models may be vulnerable to adversarial machine learning (AML) attacks. In this paper, we demonstrate the vulnerability of state-of-the-art deep learning based FDI attack detectors in DR scenarios to AML attacks. We propose a new black-box FDI attack framework to fabricate power demands in distributed DR scenarios that is capable of deceiving deep learning based FDI attack detection. The evaluation results show that the proposed AML framework can significantly decrease the FDI detection models accuracy and outperforms other AML techniques proposed in literature.
分布式需求响应(DR)用于智能电网,允许公用事业公司通过根据消费模式和预测改变价格来调节消费者的行为,从而平衡电力供应和需求。虚假数据注入(FDI)式容灾攻击会给公用事业造成巨大的经济损失、设备损坏和电力流问题。近年来,人们提出了基于深度学习模型的FDI攻击检测方法,与传统方法相比,这些方法具有更好的检测性能。然而,基于深度学习的模型可能容易受到对抗性机器学习(AML)攻击。在本文中,我们展示了最先进的基于深度学习的FDI攻击检测器在DR场景中对AML攻击的脆弱性。我们提出了一种新的黑箱FDI攻击框架,用于在分布式DR场景中伪造电力需求,该框架能够欺骗基于深度学习的FDI攻击检测。评估结果表明,所提出的反洗钱框架可以显著降低FDI检测模型的准确性,优于文献中提出的其他反洗钱技术。
{"title":"Adversarial Machine Learning Against False Data Injection Attack Detection for Smart Grid Demand Response","authors":"Zhang Guihai, B. Sikdar","doi":"10.1109/SmartGridComm51999.2021.9632316","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9632316","url":null,"abstract":"Distributed demand response (DR) is used in smart grids to allow utilities to balance the power supply with the demand by modulating the consumer's behavior by varying the price according to consumption patterns and forecasts. False data injection (FDI) attacks of DR can cause large economical losses for utilities, equipment damage, and issues with power flows. Recently, FDI attack detection methods based on deep learning models have been proposed and these methods have better detection performance as compared to traditional approaches. However, deep learning based models may be vulnerable to adversarial machine learning (AML) attacks. In this paper, we demonstrate the vulnerability of state-of-the-art deep learning based FDI attack detectors in DR scenarios to AML attacks. We propose a new black-box FDI attack framework to fabricate power demands in distributed DR scenarios that is capable of deceiving deep learning based FDI attack detection. The evaluation results show that the proposed AML framework can significantly decrease the FDI detection models accuracy and outperforms other AML techniques proposed in literature.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121570165","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Deep Reinforcement Learning For Online Distribution Power System Cybersecurity Protection 基于深度强化学习的在线配电系统网络安全保护
T. Bailey, Jay Johnson, Drew Levin
The sophistication and regularity of power system cybersecurity attacks has been growing in the last decade, leading researchers to investigate new innovative, cyber-resilient tools to help grid operators defend their networks and power systems. One promising approach is to apply recent advances in deep reinforcement learning (DRL) to aid grid operators in making real-time changes to the power system equipment to counteract malicious actions. While multiple transmission studies have been conducted in the past, in this work we investigate the possibility of defending distribution power systems using a DRL agent who has control of a collection of utility-owned distributed energy resources (DER). A game board using a modified version of the IEEE 13-bus model was simulated using OpenDSS to train the DRL agent and compare its performance to a random agent, a greedy agent, and human players. Both the DRL agent and the greedy approach performed well, suggesting a greedy approach can be appropriate for computationally tractable system configurations and a DRL agent is a viable path forward for systems of increased complexity. This work paves the way to create multi-player distribution system control games which could be designed to defend the power grid under a sophisticated cyber-attack.
在过去十年中,电力系统网络安全攻击的复杂性和规律性一直在增长,这促使研究人员研究新的创新、网络弹性工具,以帮助电网运营商保护其网络和电力系统。一种有希望的方法是应用深度强化学习(DRL)的最新进展,帮助电网运营商实时更改电力系统设备,以抵消恶意行为。虽然过去已经进行了多次传输研究,但在本工作中,我们研究了使用控制公用事业拥有的分布式能源(DER)集合的DRL代理来保护配电系统的可能性。采用改进的IEEE 13总线模型,利用OpenDSS对游戏棋盘进行仿真,训练DRL智能体,并将其性能与随机智能体、贪婪智能体和人类玩家进行比较。DRL代理和贪心方法都表现良好,这表明贪心方法适用于计算可处理的系统配置,而DRL代理是增加复杂性的系统的可行路径。这项工作为创建多人配电系统控制游戏铺平了道路,该游戏可以设计用于在复杂的网络攻击下保护电网。
{"title":"Deep Reinforcement Learning For Online Distribution Power System Cybersecurity Protection","authors":"T. Bailey, Jay Johnson, Drew Levin","doi":"10.1109/SmartGridComm51999.2021.9631991","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9631991","url":null,"abstract":"The sophistication and regularity of power system cybersecurity attacks has been growing in the last decade, leading researchers to investigate new innovative, cyber-resilient tools to help grid operators defend their networks and power systems. One promising approach is to apply recent advances in deep reinforcement learning (DRL) to aid grid operators in making real-time changes to the power system equipment to counteract malicious actions. While multiple transmission studies have been conducted in the past, in this work we investigate the possibility of defending distribution power systems using a DRL agent who has control of a collection of utility-owned distributed energy resources (DER). A game board using a modified version of the IEEE 13-bus model was simulated using OpenDSS to train the DRL agent and compare its performance to a random agent, a greedy agent, and human players. Both the DRL agent and the greedy approach performed well, suggesting a greedy approach can be appropriate for computationally tractable system configurations and a DRL agent is a viable path forward for systems of increased complexity. This work paves the way to create multi-player distribution system control games which could be designed to defend the power grid under a sophisticated cyber-attack.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"97 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123398356","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Data-Driven Frequency Regulation Reserve Prediction Based on Deep Learning Approach 基于深度学习方法的数据驱动频率调节储备预测
Shiyao Zhang, Ka-Cheong Leung
Day-ahead frequency regulation reserves can be procured to compensate power imbalance capacity for the purpose of stabilizing the power system. Due to the intermittency and uncertainty characteristics of renewable generations in a general power system, the dynamic nature of multi-scale system features cannot be fully captured through the existing approaches. This further causes inaccurate prediction and ineffective system operation. To tackle this issue, we propose, in this paper, a deep learning approach to accurately predict the amount of frequency regulation reserves of a general power system through the consideration of network information and power reserves. First, we use the power flow model to generate the net active power imbalance, frequency regulation reserves, and power matrix of a general power system. Second, we combine multiple dynamic system features into a complete input dataset and perform data pre-processing before model training and testing. Third, the proposed deep long short-term memory (DLSTM) model is developed to accurately predict the net active power imbalance in the system, as well as predicting the frequency regulation reserves. Our simulation results show that, when considering the entire power network information, our proposed deep learning approach outperforms the four baseline techniques on predicting the frequency regulation reserves in a general power system. These promising results contribute to large economical benefits in power system operations.
日前调频储备可用于补偿电力不平衡容量,达到稳定电力系统的目的。由于一般电力系统中可再生能源发电机组的间歇性和不确定性特点,现有方法无法充分捕捉多尺度系统特征的动态性。这进一步导致预测不准确,系统运行效率低下。为了解决这一问题,本文提出了一种深度学习方法,通过考虑电网信息和电力储备,准确预测一般电力系统的调频储备量。首先,我们利用潮流模型得到了一般电力系统的净有功不平衡、调频储备和功率矩阵。其次,我们将多个动态系统特征组合成一个完整的输入数据集,并在模型训练和测试之前进行数据预处理。第三,建立深度长短期记忆(DLSTM)模型,准确预测系统的净有功不平衡,并预测频率调节储备。仿真结果表明,当考虑整个电网信息时,我们提出的深度学习方法在预测一般电力系统的频率调节储备方面优于四种基线技术。这些有希望的结果有助于电力系统运行的巨大经济效益。
{"title":"Data-Driven Frequency Regulation Reserve Prediction Based on Deep Learning Approach","authors":"Shiyao Zhang, Ka-Cheong Leung","doi":"10.1109/SmartGridComm51999.2021.9632284","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9632284","url":null,"abstract":"Day-ahead frequency regulation reserves can be procured to compensate power imbalance capacity for the purpose of stabilizing the power system. Due to the intermittency and uncertainty characteristics of renewable generations in a general power system, the dynamic nature of multi-scale system features cannot be fully captured through the existing approaches. This further causes inaccurate prediction and ineffective system operation. To tackle this issue, we propose, in this paper, a deep learning approach to accurately predict the amount of frequency regulation reserves of a general power system through the consideration of network information and power reserves. First, we use the power flow model to generate the net active power imbalance, frequency regulation reserves, and power matrix of a general power system. Second, we combine multiple dynamic system features into a complete input dataset and perform data pre-processing before model training and testing. Third, the proposed deep long short-term memory (DLSTM) model is developed to accurately predict the net active power imbalance in the system, as well as predicting the frequency regulation reserves. Our simulation results show that, when considering the entire power network information, our proposed deep learning approach outperforms the four baseline techniques on predicting the frequency regulation reserves in a general power system. These promising results contribute to large economical benefits in power system operations.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"73 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114040116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Reliability-Security Trade-Off for Distributed Reactive Power Control in Transactive Grid 交易电网分布式无功控制的可靠性与安全性权衡
Muhammad Ramadan Bin Mohamad Saifuddin, David K. Y. Yau, Xin Lou
Under the trend of deregulated Volt/VAR ancillary service market, power distribution grid (PDG) is seeing a growing demand for personally owned distributed energy resources (DERs) installed behind-the-meter as value adding participants. A trustworthy cyber-physical network thus becomes essential for coordinating these decentralized participants (e.g., by aggregators) in supporting Volt/VAR optimisation, a critical conservation voltage reduction (CVR) operation. Meanwhile, oversized inverters, which reserve a larger reactive power (VAR) capacity than needed for real power generation, provide incentive payouts during market participation; they are thus likely to be adopted by future customers. This adoption, as our findings show however, inaugurates a fundamental reliability-security tradeoff, when the surplus VAR capacity, in the wrong hands of cyber attackers, can become a stronger weapon for damaging voltage control as a malicious intent. This paper presents novel analysis of key mechanisms and impacts of a class of data integrity attacks against voltage control during CVR. Evaluation results using a realistic 118-bus test system show that tampering with Volt/VAR control in prosumer-side DER and metering devices, which service D-STATCOM, can cause harmful power quality degradation (e.g., excessive voltage dips) or even power interruption. The results also quantify (i) trade-offs between better Volt/VAR control (i.e., increased reliability) and heightened potency of data integrity attacks (i.e. weakened security) under DER inverter oversizing; and (ii) impacts of these attacks under salient global trends such as increasing DER adoption.
在Volt/VAR辅助服务市场放松管制的趋势下,配电电网(PDG)对安装在电表后的个人拥有的分布式能源(DERs)作为增值参与者的需求日益增长。因此,一个值得信赖的网络物理网络对于协调这些分散的参与者(例如通过聚合器)在支持Volt/VAR优化(关键的保护电压降低(CVR)操作中变得至关重要。同时,超大逆变器的无功功率(VAR)容量大于实际发电所需的容量,在市场参与期间提供了激励支出;因此,它们很可能被未来的客户采用。然而,正如我们的研究结果所显示的那样,这种采用开启了一种基本的可靠性和安全性权衡,当多余的VAR容量落入网络攻击者的错误手中时,可以成为恶意破坏电压控制的更强大武器。本文对CVR过程中针对电压控制的一类数据完整性攻击的关键机制和影响进行了新颖的分析。使用实际118总线测试系统的评估结果表明,在为D-STATCOM服务的产消端DER和计量设备中篡改Volt/VAR控制可能会导致有害的电能质量下降(例如,电压过低)甚至电源中断。结果还量化了(i)在DER逆变器过大的情况下,更好的伏特/VAR控制(即提高可靠性)和更高的数据完整性攻击效力(即削弱安全性)之间的权衡;以及(ii)这些攻击在显著的全球趋势下的影响,例如越来越多地采用DER。
{"title":"Reliability-Security Trade-Off for Distributed Reactive Power Control in Transactive Grid","authors":"Muhammad Ramadan Bin Mohamad Saifuddin, David K. Y. Yau, Xin Lou","doi":"10.1109/SmartGridComm51999.2021.9632313","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9632313","url":null,"abstract":"Under the trend of deregulated Volt/VAR ancillary service market, power distribution grid (PDG) is seeing a growing demand for personally owned distributed energy resources (DERs) installed behind-the-meter as value adding participants. A trustworthy cyber-physical network thus becomes essential for coordinating these decentralized participants (e.g., by aggregators) in supporting Volt/VAR optimisation, a critical conservation voltage reduction (CVR) operation. Meanwhile, oversized inverters, which reserve a larger reactive power (VAR) capacity than needed for real power generation, provide incentive payouts during market participation; they are thus likely to be adopted by future customers. This adoption, as our findings show however, inaugurates a fundamental reliability-security tradeoff, when the surplus VAR capacity, in the wrong hands of cyber attackers, can become a stronger weapon for damaging voltage control as a malicious intent. This paper presents novel analysis of key mechanisms and impacts of a class of data integrity attacks against voltage control during CVR. Evaluation results using a realistic 118-bus test system show that tampering with Volt/VAR control in prosumer-side DER and metering devices, which service D-STATCOM, can cause harmful power quality degradation (e.g., excessive voltage dips) or even power interruption. The results also quantify (i) trade-offs between better Volt/VAR control (i.e., increased reliability) and heightened potency of data integrity attacks (i.e. weakened security) under DER inverter oversizing; and (ii) impacts of these attacks under salient global trends such as increasing DER adoption.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127684572","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cyber-Physical Disaster Response of Power Supply Using a Centralised-to-Distributed Framework 基于集中式到分布式框架的电源网络物理灾害响应
Pudong Ge, Charalambos Konstantinou, Fei Teng
This paper proposes a cyber-physical cooperative recovery framework to maintain critical power supply, enhancing power systems resilience under extreme events such as earthquakes and hurricanes. Extreme events can possibly damage critical infrastructure in terms of power supply, on both cyber and physical layers. Microgrid (MG) has been widely recognised as the physical-side response to such blackouts, however, the recovery of cyber side is yet fully investigated, especially the cooperatively recovery of cyber-physical power supply. Therefore, a centralised-to-distributed resilient control framework is designed to maintain the power supply of critical loads. In such resilient control, controller-to-controller (C2C) wireless network is utilised to form the emergency distributed communication without a centralised base station. Owing to the limited reliable bandwidth that can be employed in C2C networks, the inevitable delay is considered in designing a discrete control framework, and the corresponding stability criteria are given quantitatively. Finally, the cyber-physical recovery framework is demonstrated effectively through simulations in MATLAB/Simulink.
本文提出了一种网络物理协同恢复框架,以维持关键电力供应,增强电力系统在地震和飓风等极端事件下的弹性。极端事件可能会在网络和物理层破坏电力供应方面的关键基础设施。微电网(MG)已被广泛认为是对此类停电的物理侧响应,然而,网络侧的恢复尚未得到充分研究,特别是网络-物理电力供应的协同恢复。因此,设计了一个集中式到分布式的弹性控制框架来维持关键负载的电力供应。在这种弹性控制中,利用控制器对控制器(C2C)无线网络,在没有集中基站的情况下形成应急分布式通信。由于C2C网络可使用的可靠带宽有限,在设计离散控制框架时考虑了不可避免的时延,并定量给出了相应的稳定性判据。最后,通过MATLAB/Simulink仿真,对网络物理恢复框架进行了有效的验证。
{"title":"Cyber-Physical Disaster Response of Power Supply Using a Centralised-to-Distributed Framework","authors":"Pudong Ge, Charalambos Konstantinou, Fei Teng","doi":"10.1109/SmartGridComm51999.2021.9632299","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9632299","url":null,"abstract":"This paper proposes a cyber-physical cooperative recovery framework to maintain critical power supply, enhancing power systems resilience under extreme events such as earthquakes and hurricanes. Extreme events can possibly damage critical infrastructure in terms of power supply, on both cyber and physical layers. Microgrid (MG) has been widely recognised as the physical-side response to such blackouts, however, the recovery of cyber side is yet fully investigated, especially the cooperatively recovery of cyber-physical power supply. Therefore, a centralised-to-distributed resilient control framework is designed to maintain the power supply of critical loads. In such resilient control, controller-to-controller (C2C) wireless network is utilised to form the emergency distributed communication without a centralised base station. Owing to the limited reliable bandwidth that can be employed in C2C networks, the inevitable delay is considered in designing a discrete control framework, and the corresponding stability criteria are given quantitatively. Finally, the cyber-physical recovery framework is demonstrated effectively through simulations in MATLAB/Simulink.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127257698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Securing SCADA networks for smart grids via a distributed evaluation of local sensor data 通过对本地传感器数据的分布式评估来保护智能电网的SCADA网络
Verena Menzel, J. Hurink, Anne Remke
Within smart grids the safe and dependable distribution of electric power highly depends on the security of Supervisory Control and Data Acquisition (SCADA) systems and their underlying communication protocols. Existing network-based intrusion detection systems for Industrial Control Systems (ICS) are usually centrally applied at the SCADA server and do not take the underlying physical process into account. A recent line of work proposes an additional layer of security via a process-aware approach applied locally at the field stations. This paper broadens the scope of process-aware monitoring by considering the interaction between neighboring field stations, which facilitates upcoming trends of decentralized energy management (DEM). Local security monitoring is lifted to monitoring neighborhoods of field stations, therefore achieving a broader grid coverage w.r.t. security. We provide a distributed monitoring algorithm of the generated sensory readings for this extended setting. The feasibility of the approach is shown via a prototype simulation testbed and a scenario with two subgrids.
在智能电网中,安全可靠的电力分配高度依赖于监控和数据采集(SCADA)系统及其底层通信协议的安全性。现有的基于网络的工业控制系统(ICS)入侵检测系统通常集中应用于SCADA服务器,而没有考虑底层的物理过程。最近的一项工作建议通过在外地站当地应用的进程感知方法增加一层安全。本文通过考虑相邻现场站之间的相互作用,拓宽了过程感知监测的范围,促进了分散能源管理(DEM)的发展趋势。本地安全监测提升到监测外地监测站的小区,从而实现更广泛的电网覆盖。我们为这种扩展设置提供了生成的感官读数的分布式监测算法。通过一个原型仿真试验台和两个子网格的场景验证了该方法的可行性。
{"title":"Securing SCADA networks for smart grids via a distributed evaluation of local sensor data","authors":"Verena Menzel, J. Hurink, Anne Remke","doi":"10.1109/SmartGridComm51999.2021.9632283","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9632283","url":null,"abstract":"Within smart grids the safe and dependable distribution of electric power highly depends on the security of Supervisory Control and Data Acquisition (SCADA) systems and their underlying communication protocols. Existing network-based intrusion detection systems for Industrial Control Systems (ICS) are usually centrally applied at the SCADA server and do not take the underlying physical process into account. A recent line of work proposes an additional layer of security via a process-aware approach applied locally at the field stations. This paper broadens the scope of process-aware monitoring by considering the interaction between neighboring field stations, which facilitates upcoming trends of decentralized energy management (DEM). Local security monitoring is lifted to monitoring neighborhoods of field stations, therefore achieving a broader grid coverage w.r.t. security. We provide a distributed monitoring algorithm of the generated sensory readings for this extended setting. The feasibility of the approach is shown via a prototype simulation testbed and a scenario with two subgrids.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121788292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
A World Model Based Reinforcement Learning Architecture for Autonomous Power System Control 基于世界模型的电力系统自主控制强化学习体系
Magnus Tarle, Mårten Björkman, M. Larsson, L. Nordström, G. Ingeström
Renewable generation is leading to rapidly shifting power flows and it is anticipated that traditional power system control may soon be inadequate to cope with these fluctuations. Traditional control include human-in-the-loop-control schemes while more autonomous control methods can be categorized into Wide-Area Monitoring, Protection and Control systems (WAMPAC). Within this latter group of more advanced systems, reinforcement learning (RL) is a potential candidate to facilitate power system control facing these new challenges. In this paper we demonstrate how a model based reinforcement learning (MBRL) algorithm, which learns and uses an internal model of the world, can be used for autonomous power system control. The proposed RL agent, called the World Model for Autonomous Power System Control (WMAP), includes a safety shield to minimize risk of poor decisions at high uncertainty. The shield can be configured to permit WMAP to take actions with the condition that WMAP asks for guidance, e.g. from a human operator, when in doubt. As an alternative, WMAP could be run in full decision support mode which would require the operator to take all the active decisions. A case study is performed on a IEEE 14-bus system where WMAP is setup to control setpoints of two FACTS devices to emulate grid stability improvements. Results show that improved grid stability is achieved using WMAP while staying within voltage limits. Furthermore, a disastrous situation is avoided when WMAP asks for help in a test scenario event that it had not been trained for.
可再生能源发电正在导致电力流动的迅速变化,预计传统的电力系统控制可能很快就不足以应付这些波动。传统的控制包括人在环控制方案,而更自主的控制方法可以分类为广域监测,保护和控制系统(WAMPAC)。在后一组更先进的系统中,强化学习(RL)是促进面对这些新挑战的电力系统控制的潜在候选者。在本文中,我们展示了一种基于模型的强化学习(MBRL)算法,它学习和使用世界的内部模型,可以用于自主电力系统控制。提出的RL代理,称为自主电力系统控制世界模型(WMAP),包括一个安全屏蔽,以最大限度地降低在高不确定性下错误决策的风险。屏蔽可以配置为允许WMAP在WMAP请求指导的条件下采取行动,例如,当有疑问时,来自人类操作员。作为替代方案,WMAP可以在完全决策支持模式下运行,这将要求运营商采取所有主动决策。在IEEE 14总线系统上进行了案例研究,其中WMAP设置为控制两个FACTS设备的设定值,以模拟电网稳定性的改善。结果表明,在保持电压限制的情况下,WMAP提高了电网的稳定性。此外,当WMAP在没有经过训练的测试场景事件中请求帮助时,可以避免灾难性的情况。
{"title":"A World Model Based Reinforcement Learning Architecture for Autonomous Power System Control","authors":"Magnus Tarle, Mårten Björkman, M. Larsson, L. Nordström, G. Ingeström","doi":"10.1109/SmartGridComm51999.2021.9632332","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9632332","url":null,"abstract":"Renewable generation is leading to rapidly shifting power flows and it is anticipated that traditional power system control may soon be inadequate to cope with these fluctuations. Traditional control include human-in-the-loop-control schemes while more autonomous control methods can be categorized into Wide-Area Monitoring, Protection and Control systems (WAMPAC). Within this latter group of more advanced systems, reinforcement learning (RL) is a potential candidate to facilitate power system control facing these new challenges. In this paper we demonstrate how a model based reinforcement learning (MBRL) algorithm, which learns and uses an internal model of the world, can be used for autonomous power system control. The proposed RL agent, called the World Model for Autonomous Power System Control (WMAP), includes a safety shield to minimize risk of poor decisions at high uncertainty. The shield can be configured to permit WMAP to take actions with the condition that WMAP asks for guidance, e.g. from a human operator, when in doubt. As an alternative, WMAP could be run in full decision support mode which would require the operator to take all the active decisions. A case study is performed on a IEEE 14-bus system where WMAP is setup to control setpoints of two FACTS devices to emulate grid stability improvements. Results show that improved grid stability is achieved using WMAP while staying within voltage limits. Furthermore, a disastrous situation is avoided when WMAP asks for help in a test scenario event that it had not been trained for.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130560353","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A Generalized Nash Equilibrium analysis of the interaction between a peer-to-peer financial market and the distribution grid 点对点金融市场与配电网相互作用的广义纳什均衡分析
I. Shilov, H. L. Cadre, A. Bušić
We consider the interaction between the distribution grid (physical level) managed by the distributed system operator (DSO), and a financial market in which prosumers optimize their demand, generation, and bilateral trades in order to minimize their costs subject to local constraints and bilateral trading reciprocity coupling constraints. We model the interaction problem between the physical and financial levels as a noncooperative generalized Nash equilibrium problem. We compare two designs of the financial level prosumer market: a centralized design and a peer-to-peer fully distributed design. We prove the Pareto efficiency of the equilibria under homogeneity of the trading cost preferences. In addition, we prove that the pricing structure of our noncooperative game does not permit free-lunch behavior. Finally, in the numerical section we provide additional insights on the efficiency loss with respect to the different levels of agents' flexibility and amount of renewables in the network. We also quantify the impact of the prosumers' pricing on the noncooperative game social cost.
我们考虑了分布式系统运营商(DSO)管理的配电网(物理层)与金融市场之间的相互作用,在金融市场中,产消者在本地约束和双边交易互惠耦合约束下优化其需求、发电和双边交易,以最小化其成本。我们将物理层和金融层之间的相互作用问题建模为非合作的广义纳什均衡问题。我们比较了金融级产消市场的两种设计:集中式设计和点对点全分布式设计。证明了交易成本偏好同质性条件下均衡的帕累托效率。此外,我们证明了非合作博弈的定价结构不允许免费午餐行为。最后,在数值部分,我们提供了与网络中不同级别的代理灵活性和可再生能源数量有关的效率损失的额外见解。我们还量化了产消定价对非合作博弈社会成本的影响。
{"title":"A Generalized Nash Equilibrium analysis of the interaction between a peer-to-peer financial market and the distribution grid","authors":"I. Shilov, H. L. Cadre, A. Bušić","doi":"10.1109/SmartGridComm51999.2021.9632331","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9632331","url":null,"abstract":"We consider the interaction between the distribution grid (physical level) managed by the distributed system operator (DSO), and a financial market in which prosumers optimize their demand, generation, and bilateral trades in order to minimize their costs subject to local constraints and bilateral trading reciprocity coupling constraints. We model the interaction problem between the physical and financial levels as a noncooperative generalized Nash equilibrium problem. We compare two designs of the financial level prosumer market: a centralized design and a peer-to-peer fully distributed design. We prove the Pareto efficiency of the equilibria under homogeneity of the trading cost preferences. In addition, we prove that the pricing structure of our noncooperative game does not permit free-lunch behavior. Finally, in the numerical section we provide additional insights on the efficiency loss with respect to the different levels of agents' flexibility and amount of renewables in the network. We also quantify the impact of the prosumers' pricing on the noncooperative game social cost.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116598847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
A Multigraph Modeling Approach to Enable Ecological Network Analysis of Cyber Physical Power Networks 基于多图建模的网络物理电网生态网络分析方法
Abheek Chatterjee, Hao Huang, K. Davis, A. Layton
The design of resilient power grids is a critical engineering challenge for the smooth functioning of society. Bioinspired design, using a framework called the Ecological Network Analysis (ENA), is a promising solution for improving the resilience of power grids. However, the existing ENA framework can only account or for one type of flow in a network. Thus, the previous applications of ENA in power grid design were limited to the design and evaluation of the power flows only and could not account for the monitoring and control systems and their interactions that are critical to the operation of energy infrastructure. The present work addresses this limitation by proposing a multigraph modeling approach and modified ENA metrics that enable evaluation of the network organization and comparison to biological ecosystems for design inspiration. This work also compares the modeling features of the proposed model and the conventional graphical model of Cyber Physical Power Networks found in the literature to understand the implications of the different modeling approaches.
弹性电网的设计是社会平稳运行的关键工程挑战。采用生态网络分析(ENA)框架的生物启发设计是提高电网弹性的一种有希望的解决方案。但是,现有的ENA框架只能解释网络中的一种类型的流。因此,以往的ENA在电网设计中的应用仅限于潮流的设计和评估,而不能考虑对能源基础设施运行至关重要的监测和控制系统及其相互作用。目前的工作通过提出一种多图建模方法和修改的ENA指标来解决这一限制,这些指标能够评估网络组织并与生物生态系统进行比较,以获得设计灵感。这项工作还比较了所提出的模型的建模特征和文献中发现的网络物理电网的传统图形模型,以了解不同建模方法的含义。
{"title":"A Multigraph Modeling Approach to Enable Ecological Network Analysis of Cyber Physical Power Networks","authors":"Abheek Chatterjee, Hao Huang, K. Davis, A. Layton","doi":"10.1109/SmartGridComm51999.2021.9631989","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9631989","url":null,"abstract":"The design of resilient power grids is a critical engineering challenge for the smooth functioning of society. Bioinspired design, using a framework called the Ecological Network Analysis (ENA), is a promising solution for improving the resilience of power grids. However, the existing ENA framework can only account or for one type of flow in a network. Thus, the previous applications of ENA in power grid design were limited to the design and evaluation of the power flows only and could not account for the monitoring and control systems and their interactions that are critical to the operation of energy infrastructure. The present work addresses this limitation by proposing a multigraph modeling approach and modified ENA metrics that enable evaluation of the network organization and comparison to biological ecosystems for design inspiration. This work also compares the modeling features of the proposed model and the conventional graphical model of Cyber Physical Power Networks found in the literature to understand the implications of the different modeling approaches.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130046929","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Capturing Battery Flexibility in a General and Scalable Way Using the FlexOffer Model 使用FlexOffer模型以通用和可扩展的方式捕获电池灵活性
F. Lilliu, T. Pedersen, Laurynas Siksnys
To solve the problems caused by the intermittent generation of Renewable Energy Sources, the concept of energy flexibility is of utmost importance, and batteries are devices with high potential in this regard. However, current exact mathematical models specifying battery flexibility cannot scale (exponentially growing runtime) with long time horizons and many batteries. In this paper, we propose to use the FlexOffer (FO) model for this purpose, because: 1) FO is a general model, capturing all types of flexible assets in a unified format and 2) being approximate, it scales very well in terms of number of devices and time horizons. First, we describe the different types of FOs: standard, total-energy constraint and dependency-based (DFOs). Then, we present and discuss FO generation techniques, and provide an analytic method for generating DFOs. Finally, we perform simulations for measuring flexibility in economic terms and time needed for optimization and aggregation. We show that DFOs retain most of the flexibility, while vastly outperforming exact models in optimization and aggregation speed.
为了解决可再生能源间歇性发电所带来的问题,能源灵活性的概念至关重要,而电池是这方面具有高潜力的设备。然而,当前精确的数学模型不能在长时间和多电池的情况下扩展(指数增长的运行时间)。在本文中,我们建议为此目的使用FlexOffer (FO)模型,因为:1)FO是一个通用模型,以统一的格式捕获所有类型的灵活资产;2)是近似的,它在设备数量和时间范围方面扩展得非常好。首先,我们描述了不同类型的FOs:标准、总能量约束和基于依赖的(dfo)。然后,我们介绍和讨论了FO的生成技术,并提供了一种生成dfo的解析方法。最后,我们执行模拟,以衡量经济方面的灵活性以及优化和聚合所需的时间。我们表明,dfo保留了大部分的灵活性,同时在优化和聚合速度上大大优于精确模型。
{"title":"Capturing Battery Flexibility in a General and Scalable Way Using the FlexOffer Model","authors":"F. Lilliu, T. Pedersen, Laurynas Siksnys","doi":"10.1109/SmartGridComm51999.2021.9631999","DOIUrl":"https://doi.org/10.1109/SmartGridComm51999.2021.9631999","url":null,"abstract":"To solve the problems caused by the intermittent generation of Renewable Energy Sources, the concept of energy flexibility is of utmost importance, and batteries are devices with high potential in this regard. However, current exact mathematical models specifying battery flexibility cannot scale (exponentially growing runtime) with long time horizons and many batteries. In this paper, we propose to use the FlexOffer (FO) model for this purpose, because: 1) FO is a general model, capturing all types of flexible assets in a unified format and 2) being approximate, it scales very well in terms of number of devices and time horizons. First, we describe the different types of FOs: standard, total-energy constraint and dependency-based (DFOs). Then, we present and discuss FO generation techniques, and provide an analytic method for generating DFOs. Finally, we perform simulations for measuring flexibility in economic terms and time needed for optimization and aggregation. We show that DFOs retain most of the flexibility, while vastly outperforming exact models in optimization and aggregation speed.","PeriodicalId":378884,"journal":{"name":"2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130079208","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
期刊
2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1