首页 > 最新文献

arXiv - EE - Systems and Control最新文献

英文 中文
Quantifying Aleatoric and Epistemic Dynamics Uncertainty via Local Conformal Calibration 通过局部共形校准量化 Aleatoric 和 Epistemic 动力学的不确定性
Pub Date : 2024-09-12 DOI: arxiv-2409.08249
Luís Marques, Dmitry Berenson
Whether learned, simulated, or analytical, approximations of a robot'sdynamics can be inaccurate when encountering novel environments. Manyapproaches have been proposed to quantify the aleatoric uncertainty of suchmethods, i.e. uncertainty resulting from stochasticity, however these estimatesalone are not enough to properly estimate the uncertainty of a model in a novelenvironment, where the actual dynamics can change. Such changes can induceepistemic uncertainty, i.e. uncertainty due to a lack of information/data.Accounting for both epistemic and aleatoric dynamics uncertainty in atheoretically-grounded way remains an open problem. We introduce LocalUncertainty Conformal Calibration (LUCCa), a conformal prediction-basedapproach that calibrates the aleatoric uncertainty estimates provided bydynamics models to generate probabilistically-valid prediction regions of thesystem's state. We account for both epistemic and aleatoric uncertaintynon-asymptotically, without strong assumptions about the form of the truedynamics or how it changes. The calibration is performed locally in thestate-action space, leading to uncertainty estimates that are useful forplanning. We validate our method by constructing probabilistically-safe plansfor a double-integrator under significant changes in dynamics.
无论是学习、模拟还是分析,机器人动力学的近似值在遇到新环境时都可能不准确。已经提出了许多方法来量化这些方法的不确定性,即随机性导致的不确定性,但这些估计本身不足以正确估计模型在新环境中的不确定性,因为新环境中的实际动态可能会发生变化。以无理论依据的方式计算认识动态不确定性和估计动态不确定性仍然是一个未决问题。我们引入了局部不确定性保形校准(LUCCa),这是一种基于保形预测的方法,它校准动力学模型提供的不确定性估计值,以生成概率上有效的系统状态预测区域。我们非渐进地考虑了认识不确定性和估计不确定性,而不对真实动力学的形式或其如何变化做出强烈假设。校准在状态-行动空间中局部进行,从而得出对规划有用的不确定性估计。我们通过在动力学发生重大变化的情况下构建双积分器的概率安全计划来验证我们的方法。
{"title":"Quantifying Aleatoric and Epistemic Dynamics Uncertainty via Local Conformal Calibration","authors":"Luís Marques, Dmitry Berenson","doi":"arxiv-2409.08249","DOIUrl":"https://doi.org/arxiv-2409.08249","url":null,"abstract":"Whether learned, simulated, or analytical, approximations of a robot's\u0000dynamics can be inaccurate when encountering novel environments. Many\u0000approaches have been proposed to quantify the aleatoric uncertainty of such\u0000methods, i.e. uncertainty resulting from stochasticity, however these estimates\u0000alone are not enough to properly estimate the uncertainty of a model in a novel\u0000environment, where the actual dynamics can change. Such changes can induce\u0000epistemic uncertainty, i.e. uncertainty due to a lack of information/data.\u0000Accounting for both epistemic and aleatoric dynamics uncertainty in a\u0000theoretically-grounded way remains an open problem. We introduce Local\u0000Uncertainty Conformal Calibration (LUCCa), a conformal prediction-based\u0000approach that calibrates the aleatoric uncertainty estimates provided by\u0000dynamics models to generate probabilistically-valid prediction regions of the\u0000system's state. We account for both epistemic and aleatoric uncertainty\u0000non-asymptotically, without strong assumptions about the form of the true\u0000dynamics or how it changes. The calibration is performed locally in the\u0000state-action space, leading to uncertainty estimates that are useful for\u0000planning. We validate our method by constructing probabilistically-safe plans\u0000for a double-integrator under significant changes in dynamics.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"11 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217801","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Linear energy storage and flexibility model with ramp rate, ramping, deadline and capacity constraints 具有斜率、斜坡、截止日期和容量限制的线性储能和灵活性模型
Pub Date : 2024-09-12 DOI: arxiv-2409.08084
Md Umar Hashmi, Dirk Van Hertem, Aleen van der Meer, Andrew Keane
The power networks are evolving with increased active components such asenergy storage and flexibility derived from loads such as electric vehicles,heat pumps, industrial processes, etc. Better models are needed to accuratelyrepresent these assets; otherwise, their true capabilities might be over orunder-estimated. In this work, we propose a new energy storage and flexibilityarbitrage model that accounts for both ramp (power) and capacity (energy)limits, while accurately modelling the ramp rate constraint. The proposedmodels are linear in structure and efficiently solved using off-the-shelfsolvers as a linear programming problem. We also provide an online repositoryfor wider application and benchmarking. Finally, numerical case studies areperformed to quantify the sensitivity of ramp rate constraint on theoperational goal of profit maximization for energy storage and flexibility. Theresults are encouraging for assets with a slow ramp rate limit. We observe thatfor resources with a ramp rate limit of 10% of the maximum ramp limit, themarginal value of performing energy arbitrage using such resources exceeds 65%and up to 90% of the maximum profit compared to the case with no ramp ratelimitations.
电力网络在不断发展,有源元件不断增加,如储能以及来自电动汽车、热泵、工业流程等负载的灵活性。我们需要更好的模型来准确反映这些资产;否则,它们的真实能力可能会被高估或低估。在这项工作中,我们提出了一种新的储能和灵活性套利模型,该模型同时考虑了斜率(功率)和容量(能量)限制,并对斜率约束进行了精确建模。所提模型为线性结构,可作为线性规划问题使用现成的求解器高效求解。我们还提供了一个在线资源库,以便进行更广泛的应用和基准测试。最后,我们进行了数值案例研究,以量化斜率约束对储能和灵活性利润最大化运营目标的敏感性。对于具有慢斜率限制的资产,研究结果令人鼓舞。我们观察到,与无斜率限制的情况相比,对于斜率限制为最大斜率限制 10%的资源,使用此类资源进行能源套利的边际价值超过最大利润的 65%,最高可达 90%。
{"title":"Linear energy storage and flexibility model with ramp rate, ramping, deadline and capacity constraints","authors":"Md Umar Hashmi, Dirk Van Hertem, Aleen van der Meer, Andrew Keane","doi":"arxiv-2409.08084","DOIUrl":"https://doi.org/arxiv-2409.08084","url":null,"abstract":"The power networks are evolving with increased active components such as\u0000energy storage and flexibility derived from loads such as electric vehicles,\u0000heat pumps, industrial processes, etc. Better models are needed to accurately\u0000represent these assets; otherwise, their true capabilities might be over or\u0000under-estimated. In this work, we propose a new energy storage and flexibility\u0000arbitrage model that accounts for both ramp (power) and capacity (energy)\u0000limits, while accurately modelling the ramp rate constraint. The proposed\u0000models are linear in structure and efficiently solved using off-the-shelf\u0000solvers as a linear programming problem. We also provide an online repository\u0000for wider application and benchmarking. Finally, numerical case studies are\u0000performed to quantify the sensitivity of ramp rate constraint on the\u0000operational goal of profit maximization for energy storage and flexibility. The\u0000results are encouraging for assets with a slow ramp rate limit. We observe that\u0000for resources with a ramp rate limit of 10% of the maximum ramp limit, the\u0000marginal value of performing energy arbitrage using such resources exceeds 65%\u0000and up to 90% of the maximum profit compared to the case with no ramp rate\u0000limitations.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"10 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Resilient Learning-Based Control Under Denial-of-Service Attacks 拒绝服务攻击下基于学习的弹性控制
Pub Date : 2024-09-12 DOI: arxiv-2409.07766
Sayan Chakraborty, Weinan Gao, Kyriakos G. Vamvoudakis, Zhong-Ping Jiang
In this paper, we have proposed a resilient reinforcement learning method fordiscrete-time linear systems with unknown parameters, under denial-of-service(DoS) attacks. The proposed method is based on policy iteration that learns theoptimal controller from input-state data amidst DoS attacks. We achieve anupper bound for the DoS duration to ensure closed-loop stability. Theresilience of the closed-loop system, when subjected to DoS attacks with thelearned controller and an internal model, has been thoroughly examined. Theeffectiveness of the proposed methodology is demonstrated on an invertedpendulum on a cart.
本文针对具有未知参数的离散时间线性系统,提出了一种在拒绝服务(DoS)攻击下的弹性强化学习方法。该方法基于策略迭代,在 DoS 攻击中通过输入状态数据学习最优控制器。我们实现了 DoS 持续时间的上限,以确保闭环稳定性。在使用学习到的控制器和内部模型遭受 DoS 攻击时,我们对闭环系统的复原力进行了深入研究。在小车倒立摆上演示了所提方法的有效性。
{"title":"Resilient Learning-Based Control Under Denial-of-Service Attacks","authors":"Sayan Chakraborty, Weinan Gao, Kyriakos G. Vamvoudakis, Zhong-Ping Jiang","doi":"arxiv-2409.07766","DOIUrl":"https://doi.org/arxiv-2409.07766","url":null,"abstract":"In this paper, we have proposed a resilient reinforcement learning method for\u0000discrete-time linear systems with unknown parameters, under denial-of-service\u0000(DoS) attacks. The proposed method is based on policy iteration that learns the\u0000optimal controller from input-state data amidst DoS attacks. We achieve an\u0000upper bound for the DoS duration to ensure closed-loop stability. The\u0000resilience of the closed-loop system, when subjected to DoS attacks with the\u0000learned controller and an internal model, has been thoroughly examined. The\u0000effectiveness of the proposed methodology is demonstrated on an inverted\u0000pendulum on a cart.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"10 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Learning Communities from Equilibria of Nonlinear Opinion Dynamics 从非线性意见动态平衡中学习社群
Pub Date : 2024-09-12 DOI: arxiv-2409.08004
Yu Xing, Anastasia Bizyaeva, Karl H. Johansson
This paper studies community detection for a nonlinear opinion dynamics modelfrom its equilibria. It is assumed that the underlying network is generatedfrom a stochastic block model with two communities, where agents are assignedwith community labels and edges are added independently based on these labels.Agents update their opinions following a nonlinear rule that incorporatessaturation effects on interactions. It is shown that clustering based on asingle equilibrium can detect most community labels (i.e., achieving almostexact recovery), if the two communities differ in size and link probabilities.When the two communities are identical in size and link probabilities, and theinter-community connections are denser than intra-community ones, the algorithmcan achieve almost exact recovery under negative influence weights but failsunder positive influence weights. Utilizing the fixed point equation andspectral methods, we also propose a detection algorithm based on multipleequilibria, which can detect communities with positive influence weights.Numerical experiments demonstrate the performance of the proposed algorithms.
本文从非线性意见动力学模型的均衡点出发,研究了该模型的社群检测。假设底层网络是由具有两个社群的随机块模型生成的,其中代理被分配了社群标签,并根据这些标签独立添加边。代理根据非线性规则更新其观点,该规则包含了互动的饱和效应。研究表明,如果两个社群的规模和链接概率不同,基于单一均衡的聚类可以检测到大多数社群标签(即实现几乎精确的恢复)。当两个社群的规模和链接概率相同,且社群间的连接比社群内的连接更密集时,该算法在负影响权重下可以实现几乎精确的恢复,但在正影响权重下则失败。利用定点方程和光谱方法,我们还提出了一种基于多重均衡的检测算法,该算法可以检测出具有正影响权重的群落。
{"title":"Learning Communities from Equilibria of Nonlinear Opinion Dynamics","authors":"Yu Xing, Anastasia Bizyaeva, Karl H. Johansson","doi":"arxiv-2409.08004","DOIUrl":"https://doi.org/arxiv-2409.08004","url":null,"abstract":"This paper studies community detection for a nonlinear opinion dynamics model\u0000from its equilibria. It is assumed that the underlying network is generated\u0000from a stochastic block model with two communities, where agents are assigned\u0000with community labels and edges are added independently based on these labels.\u0000Agents update their opinions following a nonlinear rule that incorporates\u0000saturation effects on interactions. It is shown that clustering based on a\u0000single equilibrium can detect most community labels (i.e., achieving almost\u0000exact recovery), if the two communities differ in size and link probabilities.\u0000When the two communities are identical in size and link probabilities, and the\u0000inter-community connections are denser than intra-community ones, the algorithm\u0000can achieve almost exact recovery under negative influence weights but fails\u0000under positive influence weights. Utilizing the fixed point equation and\u0000spectral methods, we also propose a detection algorithm based on multiple\u0000equilibria, which can detect communities with positive influence weights.\u0000Numerical experiments demonstrate the performance of the proposed algorithms.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"5 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Critically Damped Third-Order Langevin Dynamics 临界阻尼三阶朗文动力学
Pub Date : 2024-09-12 DOI: arxiv-2409.07697
Benjamin Sterling, Monica Bugallo
While systems analysis has been studied for decades in the context of controltheory, it has only been recently used to improve the convergence of DenoisingDiffusion Probabilistic Models. This work describes a novel improvement toThird- Order Langevin Dynamics (TOLD), a recent diffusion method that performsbetter than its predecessors. This improvement, abbreviated TOLD++, is carriedout by critically damping the TOLD forward transition matrix similarly toDockhorn's Critically-Damped Langevin Dynamics (CLD). Specifically, it exploitseigen-analysis of the forward transition matrix to derive the optimal set ofdynamics under the original TOLD scheme. TOLD++ is theoretically guaranteed toconverge faster than TOLD, and its faster convergence is verified on the SwissRoll toy dataset and CIFAR-10 dataset according to the FID metric.
虽然系统分析在控制理论中已被研究了几十年,但直到最近才被用于改善去噪扩散概率模型的收敛性。这项工作描述了对三阶朗格文动力学(TOLD)的一种新改进,这是一种最新的扩散方法,其性能优于其前辈。这种改进(缩写为 TOLD++)是通过对 TOLD 前向过渡矩阵进行临界阻尼来实现的,类似于多克霍恩的临界阻尼朗格文动力学(CLD)。具体来说,它利用前向过渡矩阵的特征分析,得出原始 TOLD 方案下的最优动力学集。理论上保证 TOLD++ 的收敛速度比 TOLD 更快,而且根据 FID 指标,其收敛速度在 SwissRoll 玩具数据集和 CIFAR-10 数据集上得到了验证。
{"title":"Critically Damped Third-Order Langevin Dynamics","authors":"Benjamin Sterling, Monica Bugallo","doi":"arxiv-2409.07697","DOIUrl":"https://doi.org/arxiv-2409.07697","url":null,"abstract":"While systems analysis has been studied for decades in the context of control\u0000theory, it has only been recently used to improve the convergence of Denoising\u0000Diffusion Probabilistic Models. This work describes a novel improvement to\u0000Third- Order Langevin Dynamics (TOLD), a recent diffusion method that performs\u0000better than its predecessors. This improvement, abbreviated TOLD++, is carried\u0000out by critically damping the TOLD forward transition matrix similarly to\u0000Dockhorn's Critically-Damped Langevin Dynamics (CLD). Specifically, it exploits\u0000eigen-analysis of the forward transition matrix to derive the optimal set of\u0000dynamics under the original TOLD scheme. TOLD++ is theoretically guaranteed to\u0000converge faster than TOLD, and its faster convergence is verified on the Swiss\u0000Roll toy dataset and CIFAR-10 dataset according to the FID metric.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"26 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217831","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimal Operation of Distribution System Operator and the Impact of Peer-to-Peer Transactions 配电系统运营商的优化运行及点对点交易的影响
Pub Date : 2024-09-12 DOI: arxiv-2409.08191
Hanyang Lin, Ye Guo, Firdous Ul Nazir, Jianguo Zhou, Chi Yung Chung, Nikos Hatziargyriou
Peer-to-peer (P2P) energy trading, commonly recognized as a decentralizedapproach, has emerged as a popular way to better utilize distributed energyresources (DERs). In order to better manage this user-side decentralizedapproach from a system operator's point of view, this paper proposes an optimaloperation approach for distribution system operators (DSO), comprising internalprosumers who engage in P2P transactions. The DSO is assumed to be a financialneutral entity, holding the responsibility of aggregating the surplus energyand deficit demand of prosumers after their P2P transactions while dispatchingDERs and considering network integrity. Impacts of P2P transactions on DSO'soptimal operation have been studied. Results indicate that energy matching P2Ptrading where only the total amount of energy over a given period of time isdefined may affect quantities of energy exchanged between the DSO and thewholesale market, but not internal dispatch decisions of the DSO. Differentlevels of real-time power consistency may lead to different total surpluses inthe distribution network. For the real-time power matching P2P trading, as aspecial case of energy matching P2P trading, the provided energy and totalsurplus are not affected. In other words, DSO can safely ignore P2Ptransactions if they follow the format defined in this paper. Case studiesverify these conclusions and further demonstrate that P2P trading will notaffect physical power flow of the whole system, but the financial distributionbetween the DSO and prosumers.
点对点(P2P)能源交易通常被认为是一种去中心化方法,已成为更好地利用分布式能源(DER)的一种流行方式。为了从系统运营商的角度更好地管理这种用户端去中心化方法,本文提出了一种由参与 P2P 交易的内部消费者组成的配电系统运营商(DSO)的优化运营方法。假定 DSO 是一个财务中立的实体,负责在 P2P 交易后汇集用户的剩余能源和赤字需求,同时调度 DER 并考虑网络的完整性。研究了 P2P 交易对 DSO 最佳运行的影响。结果表明,只定义特定时间段内能源总量的能源匹配 P2P 交易可能会影响 DSO 与批发市场之间的能源交换量,但不会影响 DSO 的内部调度决策。不同程度的实时功率一致性可能会导致配电网内不同的总盈余。对于实时功率匹配 P2P 交易,作为能量匹配 P2P 交易的特殊情况,所提供的能量和总盈余不受影响。换句话说,如果 P2P 交易遵循本文定义的格式,DSO 可以安全地忽略它们。案例研究验证了这些结论,并进一步证明 P2P 交易不会影响整个系统的物理电力流,但会影响 DSO 和用户之间的财务分配。
{"title":"Optimal Operation of Distribution System Operator and the Impact of Peer-to-Peer Transactions","authors":"Hanyang Lin, Ye Guo, Firdous Ul Nazir, Jianguo Zhou, Chi Yung Chung, Nikos Hatziargyriou","doi":"arxiv-2409.08191","DOIUrl":"https://doi.org/arxiv-2409.08191","url":null,"abstract":"Peer-to-peer (P2P) energy trading, commonly recognized as a decentralized\u0000approach, has emerged as a popular way to better utilize distributed energy\u0000resources (DERs). In order to better manage this user-side decentralized\u0000approach from a system operator's point of view, this paper proposes an optimal\u0000operation approach for distribution system operators (DSO), comprising internal\u0000prosumers who engage in P2P transactions. The DSO is assumed to be a financial\u0000neutral entity, holding the responsibility of aggregating the surplus energy\u0000and deficit demand of prosumers after their P2P transactions while dispatching\u0000DERs and considering network integrity. Impacts of P2P transactions on DSO's\u0000optimal operation have been studied. Results indicate that energy matching P2P\u0000trading where only the total amount of energy over a given period of time is\u0000defined may affect quantities of energy exchanged between the DSO and the\u0000wholesale market, but not internal dispatch decisions of the DSO. Different\u0000levels of real-time power consistency may lead to different total surpluses in\u0000the distribution network. For the real-time power matching P2P trading, as a\u0000special case of energy matching P2P trading, the provided energy and total\u0000surplus are not affected. In other words, DSO can safely ignore P2P\u0000transactions if they follow the format defined in this paper. Case studies\u0000verify these conclusions and further demonstrate that P2P trading will not\u0000affect physical power flow of the whole system, but the financial distribution\u0000between the DSO and prosumers.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"299 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217789","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimizing Falsification for Learning-Based Control Systems: A Multi-Fidelity Bayesian Approach 优化基于学习的控制系统的证伪:多保真度贝叶斯方法
Pub Date : 2024-09-12 DOI: arxiv-2409.08097
Zahra Shahrooei, Mykel J. Kochenderfer, Ali Baheri
Testing controllers in safety-critical systems is vital for ensuring theirsafety and preventing failures. In this paper, we address the falsificationproblem within learning-based closed-loop control systems through simulation.This problem involves the identification of counterexamples that violate systemsafety requirements and can be formulated as an optimization task based onthese requirements. Using full-fidelity simulator data in this optimizationproblem can be computationally expensive. To improve efficiency, we propose amulti-fidelity Bayesian optimization falsification framework that harnessessimulators with varying levels of accuracy. Our proposed framework cantransition between different simulators and establish meaningful relationshipsbetween them. Through multi-fidelity Bayesian optimization, we determine boththe optimal system input likely to be a counterexample and the appropriatefidelity level for assessment. We evaluated our approach across various Gymenvironments, each featuring different levels of fidelity. Our experimentsdemonstrate that multi-fidelity Bayesian optimization is more computationallyefficient than full-fidelity Bayesian optimization and other baseline methodsin detecting counterexamples. A Python implementation of the algorithm isavailable at https://github.com/SAILRIT/MFBO_Falsification.
测试安全关键型系统中的控制器对于确保其安全性和防止故障至关重要。在本文中,我们通过仿真解决了基于学习的闭环控制系统中的证伪问题。这个问题涉及识别违反系统安全要求的反例,并可根据这些要求制定优化任务。在这一优化问题中使用全保真模拟器数据的计算成本很高。为了提高效率,我们提出了多保真度贝叶斯优化证伪框架,利用不同精度的模拟器。我们提出的框架可以在不同的模拟器之间转换,并在它们之间建立有意义的关系。通过多保真度贝叶斯优化,我们确定了可能成为反例的最佳系统输入以及评估的适当保真度级别。我们在各种体育馆环境中评估了我们的方法,每种环境都具有不同的保真度。我们的实验证明,在检测反例方面,多保真度贝叶斯优化比全保真度贝叶斯优化和其他基线方法的计算效率更高。该算法的 Python 实现请访问 https://github.com/SAILRIT/MFBO_Falsification。
{"title":"Optimizing Falsification for Learning-Based Control Systems: A Multi-Fidelity Bayesian Approach","authors":"Zahra Shahrooei, Mykel J. Kochenderfer, Ali Baheri","doi":"arxiv-2409.08097","DOIUrl":"https://doi.org/arxiv-2409.08097","url":null,"abstract":"Testing controllers in safety-critical systems is vital for ensuring their\u0000safety and preventing failures. In this paper, we address the falsification\u0000problem within learning-based closed-loop control systems through simulation.\u0000This problem involves the identification of counterexamples that violate system\u0000safety requirements and can be formulated as an optimization task based on\u0000these requirements. Using full-fidelity simulator data in this optimization\u0000problem can be computationally expensive. To improve efficiency, we propose a\u0000multi-fidelity Bayesian optimization falsification framework that harnesses\u0000simulators with varying levels of accuracy. Our proposed framework can\u0000transition between different simulators and establish meaningful relationships\u0000between them. Through multi-fidelity Bayesian optimization, we determine both\u0000the optimal system input likely to be a counterexample and the appropriate\u0000fidelity level for assessment. We evaluated our approach across various Gym\u0000environments, each featuring different levels of fidelity. Our experiments\u0000demonstrate that multi-fidelity Bayesian optimization is more computationally\u0000efficient than full-fidelity Bayesian optimization and other baseline methods\u0000in detecting counterexamples. A Python implementation of the algorithm is\u0000available at https://github.com/SAILRIT/MFBO_Falsification.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"13 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving Initial Transients of Online Learning Echo State Network Control System via Feedback Adjustment 通过反馈调整改进在线学习回声状态网络控制系统的初始瞬态
Pub Date : 2024-09-12 DOI: arxiv-2409.08228
Junyi Shen
Echo state networks (ESNs) have gained popularity in online learning controlsystems due to their easy training. However, online learning ESN controllersoften undergo slow convergence and produce unexpected outputs during theinitial transient phase. Existing solutions, such as prior training or controlmode switching, can be complex and have drawbacks. This work offers a simpleyet effective method to address these initial transients by integrating afeedback proportional-differential (P-D) controller. Simulation results showthat the proposed control system exhibits fast convergence and strongrobustness against plant dynamics and hyperparameter changes. This work isexpected to offer practical benefits for engineers seeking to implement onlinelearning ESN control systems.
回声状态网络(ESN)由于易于训练,在在线学习控制系统中颇受欢迎。然而,在线学习 ESN 控制器往往收敛缓慢,并在初始瞬态阶段产生意外输出。现有的解决方案,如事先训练或控制模式切换,可能会很复杂,而且存在缺点。本研究提供了一种简单而有效的方法,通过集成反馈比例-微分 (P-D) 控制器来解决这些初始瞬态问题。仿真结果表明,所提出的控制系统收敛速度快,对工厂动态和超参数变化具有很强的稳健性。这项工作有望为寻求实施在线学习 ESN 控制系统的工程师带来实际好处。
{"title":"Improving Initial Transients of Online Learning Echo State Network Control System via Feedback Adjustment","authors":"Junyi Shen","doi":"arxiv-2409.08228","DOIUrl":"https://doi.org/arxiv-2409.08228","url":null,"abstract":"Echo state networks (ESNs) have gained popularity in online learning control\u0000systems due to their easy training. However, online learning ESN controllers\u0000often undergo slow convergence and produce unexpected outputs during the\u0000initial transient phase. Existing solutions, such as prior training or control\u0000mode switching, can be complex and have drawbacks. This work offers a simple\u0000yet effective method to address these initial transients by integrating a\u0000feedback proportional-differential (P-D) controller. Simulation results show\u0000that the proposed control system exhibits fast convergence and strong\u0000robustness against plant dynamics and hyperparameter changes. This work is\u0000expected to offer practical benefits for engineers seeking to implement online\u0000learning ESN control systems.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"96 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217788","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Disinfectant Control in Drinking Water Networks: Integrating Advection-Dispersion-Reaction Models and Byproduct Constraints 饮用水网络中的消毒剂控制:平流-分散-反作用模型与副产品约束的整合
Pub Date : 2024-09-12 DOI: arxiv-2409.08157
Salma M. Elsherif, Ahmad F. Taha, Ahmed A. Abokifa
Effective disinfection is essential for maintaining water quality standardsin distribution networks. Chlorination, as the most used technique, ensuressafe water by maintaining sufficient chlorine residuals but also leads to theformation of disinfection byproducts (DBPs). These DBPs pose health risks,highlighting the need for chlorine injection control (CIC) by booster stationsto balance safety and DBPs formation. Prior studies have followed variousapproaches to address this research problem. However, most of these studiesoverlook the changing flow conditions and their influence on the evolution ofthe chlorine and DBPs concentrations by integrating simplifiedtransport-reaction models into CIC. In contrast, this paper proposes a novelCIC method that: (i) integrates multi-species dynamics, (ii) allows for a moreaccurate representation of the reaction dynamics of chlorine, other substances,and the resulting DBPs formation, and (iii) optimizes for the regulation ofchlorine concentrations subject to EPA mandates thereby mitigating network-wideDBPs formation. The novelty of this study lies in its incorporation oftime-dependent controllability analysis that captures the control coverage ofeach booster station. The effectiveness of the proposed CIC method isdemonstrated through its application and validation via numerical case studieson different water networks with varying scales, initial conditions, andparameters.
有效的消毒对维持输水管网的水质标准至关重要。加氯作为最常用的技术,可通过保持足够的余氯确保水质安全,但同时也会导致消毒副产物(DBPs)的产生。这些 DBPs 会对健康造成危害,因此需要通过增压站进行注氯控制 (CIC),以平衡安全性和 DBPs 的形成。之前的研究采用了不同的方法来解决这一研究问题。然而,这些研究大多忽略了流量条件的变化及其对氯和 DBPs 浓度变化的影响,将简化的传输反应模型整合到 CIC 中。相比之下,本文提出了一种新颖的 CIC 方法,该方法具有以下优点(i) 整合多物种动力学,(ii) 更准确地表示氯、其他物质以及由此形成的 DBPs 的反应动力学,(iii) 根据 EPA 的要求优化氯浓度的调节,从而减少全网 DBPs 的形成。本研究的新颖之处在于纳入了与时间相关的可控性分析,从而捕捉到每个增压站的控制范围。通过对不同规模、初始条件和参数的不同水网进行数值案例研究,证明了所提出的 CIC 方法的有效性。
{"title":"Disinfectant Control in Drinking Water Networks: Integrating Advection-Dispersion-Reaction Models and Byproduct Constraints","authors":"Salma M. Elsherif, Ahmad F. Taha, Ahmed A. Abokifa","doi":"arxiv-2409.08157","DOIUrl":"https://doi.org/arxiv-2409.08157","url":null,"abstract":"Effective disinfection is essential for maintaining water quality standards\u0000in distribution networks. Chlorination, as the most used technique, ensures\u0000safe water by maintaining sufficient chlorine residuals but also leads to the\u0000formation of disinfection byproducts (DBPs). These DBPs pose health risks,\u0000highlighting the need for chlorine injection control (CIC) by booster stations\u0000to balance safety and DBPs formation. Prior studies have followed various\u0000approaches to address this research problem. However, most of these studies\u0000overlook the changing flow conditions and their influence on the evolution of\u0000the chlorine and DBPs concentrations by integrating simplified\u0000transport-reaction models into CIC. In contrast, this paper proposes a novel\u0000CIC method that: (i) integrates multi-species dynamics, (ii) allows for a more\u0000accurate representation of the reaction dynamics of chlorine, other substances,\u0000and the resulting DBPs formation, and (iii) optimizes for the regulation of\u0000chlorine concentrations subject to EPA mandates thereby mitigating network-wide\u0000DBPs formation. The novelty of this study lies in its incorporation of\u0000time-dependent controllability analysis that captures the control coverage of\u0000each booster station. The effectiveness of the proposed CIC method is\u0000demonstrated through its application and validation via numerical case studies\u0000on different water networks with varying scales, initial conditions, and\u0000parameters.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"37 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Impacts of EPA Power Plant Emissions Regulations on the US Electricity Sector 美国环保局发电厂排放法规对美国电力行业的影响
Pub Date : 2024-09-12 DOI: arxiv-2409.08093
Qian Luo, Jesse Jenkins
Taking aim at one of the largest greenhouse gas emitting sectors, the USEnvironmental Protection Agency (EPA) finalized new regulations on power plantgreenhouse gas emissions in May 2024. These rules take the form of differentemissions performance standards for different classes of power planttechnologies, creating a complex set of regulations that make it difficult tounderstand their consequential impacts on power system capacity, operations,and emissions without dedicated and sophisticated modeling. Here, we enhance astate-of-the-art power system capacity expansion model by incorporating newdetailed operational constraints tailored to different technologies torepresent the EPA's rules. Our results show that adopting these new regulationscould reduce US power sector emissions in 2040 to 51% below the 2022 level (vs26% without the rules). Regulations on coal-fired power plants drive thelargest share of reductions. Regulations on new gas turbines incrementallyreduce emissions but lower overall efficiency of the gas fleet, increasing theaverage cost of carbon mitigation. Therefore, we explore several alternativeemission mitigation strategies. By comparing these alternatives withregulations finalized by EPA, we highlight the importance of accelerating theretirement of inefficient fossil fuel-fired generators and applying consistentand strict emissions regulations to all gas generators, regardless of theirvintage, to cost-effectively achieve deep decarbonization and avoid biasinginvestment decisions towards less efficient generators.
作为最大的温室气体排放行业之一,美国环境保护局(EPA)于 2024 年 5 月最终确定了关于发电厂温室气体排放的新法规。这些法规针对不同等级的发电厂技术制定了不同的排放性能标准,形成了一套复杂的法规,如果没有专门的复杂建模,很难理解这些法规对电力系统容量、运营和排放的影响。在此,我们将针对不同技术量身定制的新的详细运行约束条件纳入到 EPA 规则中,从而增强了最先进的电力系统容量扩展模型。我们的研究结果表明,如果采用这些新法规,2040 年美国电力行业的排放量将比 2022 年减少 51%(相比之下,如果没有这些法规,排放量将减少 26%)。对燃煤电厂的规定将推动最大份额的减排。对新燃气轮机的规定可逐步减少排放,但会降低燃气机组的整体效率,增加碳减排的平均成本。因此,我们探讨了几种可供选择的减排策略。通过将这些替代方案与 EPA 最终确定的法规进行比较,我们强调了加速淘汰低效化石燃料发电机组的重要性,并对所有燃气发电机组(无论其使用年限长短)实施一致而严格的排放法规,以经济有效地实现深度脱碳,避免投资决策偏向于效率较低的发电机组。
{"title":"Impacts of EPA Power Plant Emissions Regulations on the US Electricity Sector","authors":"Qian Luo, Jesse Jenkins","doi":"arxiv-2409.08093","DOIUrl":"https://doi.org/arxiv-2409.08093","url":null,"abstract":"Taking aim at one of the largest greenhouse gas emitting sectors, the US\u0000Environmental Protection Agency (EPA) finalized new regulations on power plant\u0000greenhouse gas emissions in May 2024. These rules take the form of different\u0000emissions performance standards for different classes of power plant\u0000technologies, creating a complex set of regulations that make it difficult to\u0000understand their consequential impacts on power system capacity, operations,\u0000and emissions without dedicated and sophisticated modeling. Here, we enhance a\u0000state-of-the-art power system capacity expansion model by incorporating new\u0000detailed operational constraints tailored to different technologies to\u0000represent the EPA's rules. Our results show that adopting these new regulations\u0000could reduce US power sector emissions in 2040 to 51% below the 2022 level (vs\u000026% without the rules). Regulations on coal-fired power plants drive the\u0000largest share of reductions. Regulations on new gas turbines incrementally\u0000reduce emissions but lower overall efficiency of the gas fleet, increasing the\u0000average cost of carbon mitigation. Therefore, we explore several alternative\u0000emission mitigation strategies. By comparing these alternatives with\u0000regulations finalized by EPA, we highlight the importance of accelerating the\u0000retirement of inefficient fossil fuel-fired generators and applying consistent\u0000and strict emissions regulations to all gas generators, regardless of their\u0000vintage, to cost-effectively achieve deep decarbonization and avoid biasing\u0000investment decisions towards less efficient generators.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"60 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
arXiv - EE - Systems and Control
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1