首页 > 最新文献

Proceedings of the ... American Control Conference. American Control Conference最新文献

英文 中文
Enhanced Social Cognitive Theory Dynamic Modeling and Simulation Towards Improving the Estimation of "Just-In-Time" States. 改进社会认知理论动态建模与仿真以改进“及时”状态的估计。
Pub Date : 2022-06-01 DOI: 10.23919/acc53348.2022.9867493
Mohamed El Mistiri, Daniel E Rivera, Predrag Klasnja, Junghwan Park, Eric Hekler

Insufficient physical activity (PA) is commonplace in society, in spite of its significant impact on personal health and well-being. Improved interventions are clearly needed. One of the challenges faced in behavioral interventions is a lack of understanding of multi-timescale dynamics. In this paper we rely on a dynamical model of Social Cognitive Theory (SCT) to gain insights regarding a control-oriented experimental design for a behavioral intervention to improve PA. The intervention (Just Walk JITAI) is designed with the aim to better understand and estimate ideal times for intervention and support based on the concept of "just-in-time" states. An innovative input signal design strategy is used to study the just-in-time state dynamics through the use of decision rules based on conditions of need, opportunity and receptivity. Model simulations featuring within-day effects are used to assess input signal effectiveness. Scenarios for adherent and non-adherent participants are presented, with the proposed experimental design showing significant potential for reducing notification burden while providing informative data to support future system identification and control design efforts.

身体活动不足(PA)在社会上很普遍,尽管它对个人健康和福祉有重大影响。显然需要改进干预措施。行为干预面临的挑战之一是缺乏对多时间尺度动力学的理解。在本文中,我们依靠社会认知理论(SCT)的动态模型来获得关于行为干预改善PA的面向控制的实验设计的见解。干预(Just Walk JITAI)的设计目的是基于“及时”状态的概念,更好地理解和估计干预和支持的理想时间。采用一种创新的输入信号设计策略,通过基于需求、机会和可接受性条件的决策规则来研究实时状态动力学。模型模拟具有日内效应,用于评估输入信号的有效性。提出了依从性和非依从性参与者的场景,所提出的实验设计显示了减少通知负担的巨大潜力,同时提供了信息数据,以支持未来的系统识别和控制设计工作。
{"title":"Enhanced Social Cognitive Theory Dynamic Modeling and Simulation Towards Improving the Estimation of \"Just-In-Time\" States.","authors":"Mohamed El Mistiri,&nbsp;Daniel E Rivera,&nbsp;Predrag Klasnja,&nbsp;Junghwan Park,&nbsp;Eric Hekler","doi":"10.23919/acc53348.2022.9867493","DOIUrl":"https://doi.org/10.23919/acc53348.2022.9867493","url":null,"abstract":"<p><p>Insufficient physical activity (PA) is commonplace in society, in spite of its significant impact on personal health and well-being. Improved interventions are clearly needed. One of the challenges faced in behavioral interventions is a lack of understanding of multi-timescale dynamics. In this paper we rely on a dynamical model of Social Cognitive Theory (SCT) to gain insights regarding a control-oriented experimental design for a behavioral intervention to improve PA. The intervention (<i>Just Walk JITAI</i>) is designed with the aim to better understand and estimate ideal times for intervention and support based on the concept of \"just-in-time\" states. An innovative input signal design strategy is used to study the just-in-time state dynamics through the use of decision rules based on conditions of need, opportunity and receptivity. Model simulations featuring within-day effects are used to assess input signal effectiveness. Scenarios for adherent and non-adherent participants are presented, with the proposed experimental design showing significant potential for reducing notification burden while providing informative data to support future system identification and control design efforts.</p>","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"2022 ","pages":"468-473"},"PeriodicalIF":0.0,"publicationDate":"2022-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9634811/pdf/nihms-1816579.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9765780","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Model Personalization in Behavioral Interventions using Model-on-Demand Estimation and Discrete Simultaneous Perturbation Stochastic Approximation. 基于模型按需估计和离散同步摄动随机逼近的行为干预模型个性化。
Pub Date : 2022-06-01 DOI: 10.23919/acc53348.2022.9867669
Rachael T Kha, Daniel E Rivera, Predrag Klasnja, Eric Hekler

This paper presents the use of discrete Simultaneous Perturbation Stochastic Approximation (DSPSA) to optimize dynamical models meaningful for personalized interventions in behavioral medicine, with emphasis on physical activity. DSPSA is used to determine an optimal set of model features and parameter values which would otherwise be chosen either through exhaustive search or be specified a priori. The modeling technique examined in this study is Model-on-Demand (MoD) estimation, which synergistically manages local and global modeling, and represents an appealing alternative to traditional approaches such as ARX estimation. The combination of DSPSA and MoD in behavioral medicine can provide individualized models for participant-specific interventions. MoD estimation, enhanced with a DSPSA search, can be formulated to provide not only better explanatory information about a participant's physical behavior but also predictive power, providing greater insight into environmental and mental states that may be most conducive for participants to benefit from the actions of the intervention. A case study from data collected from a representative participant of the Just Walk intervention is presented in support of these conclusions.

本文介绍了使用离散同步摄动随机逼近(DSPSA)来优化行为医学中个性化干预的动力学模型,重点是身体活动。DSPSA用于确定一组最优的模型特征和参数值,否则这些特征和参数值将通过穷穷搜索或先验指定来选择。本研究中检验的建模技术是模型-按需(MoD)估计,它协同管理局部和全局建模,代表了传统方法(如ARX估计)的一种有吸引力的替代方法。DSPSA和MoD在行为医学中的结合可以为参与者的干预提供个性化的模型。通过DSPSA搜索增强的MoD估计不仅可以更好地解释参与者的身体行为,还可以提供预测能力,更深入地了解环境和精神状态,这可能是最有利于参与者从干预行动中受益的。本研究从“Just Walk”干预的一位有代表性的参与者那里收集了数据,并提出了一个案例研究来支持这些结论。
{"title":"Model Personalization in Behavioral Interventions using Model-on-Demand Estimation and Discrete Simultaneous Perturbation Stochastic Approximation.","authors":"Rachael T Kha,&nbsp;Daniel E Rivera,&nbsp;Predrag Klasnja,&nbsp;Eric Hekler","doi":"10.23919/acc53348.2022.9867669","DOIUrl":"https://doi.org/10.23919/acc53348.2022.9867669","url":null,"abstract":"<p><p>This paper presents the use of discrete Simultaneous Perturbation Stochastic Approximation (DSPSA) to optimize dynamical models meaningful for personalized interventions in behavioral medicine, with emphasis on physical activity. DSPSA is used to determine an optimal set of model features and parameter values which would otherwise be chosen either through exhaustive search or be specified <i>a priori</i>. The modeling technique examined in this study is Model-on-Demand (MoD) estimation, which synergistically manages local and global modeling, and represents an appealing alternative to traditional approaches such as ARX estimation. The combination of DSPSA and MoD in behavioral medicine can provide individualized models for participant-specific interventions. MoD estimation, enhanced with a DSPSA search, can be formulated to provide not only better explanatory information about a participant's physical behavior but also predictive power, providing greater insight into environmental and mental states that may be most conducive for participants to benefit from the actions of the intervention. A case study from data collected from a representative participant of the <i>Just Walk</i> intervention is presented in support of these conclusions.</p>","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"2022 ","pages":"671-676"},"PeriodicalIF":0.0,"publicationDate":"2022-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9634813/pdf/nihms-1816578.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9765777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Spacecraft Attitude Control using Derivative-free Purely Adaptive Controller 无导数纯自适应航天器姿态控制
Pub Date : 2022-01-01 DOI: 10.23919/ACC53348.2022.9867258
Irene Grace Karot Polson, D. Giri
{"title":"Spacecraft Attitude Control using Derivative-free Purely Adaptive Controller","authors":"Irene Grace Karot Polson, D. Giri","doi":"10.23919/ACC53348.2022.9867258","DOIUrl":"https://doi.org/10.23919/ACC53348.2022.9867258","url":null,"abstract":"","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"290 1","pages":"735-740"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74995284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Heat Exchanger Simulator for Testing and Demonstrating Automation Algorithms 用于测试和演示自动化算法的热交换器模拟器
Pub Date : 2022-01-01 DOI: 10.23919/ACC53348.2022.9867196
R. Rhinehart
— This offers a simulation model of a process heat exchanger, which can be used for testing and demonstration of automation algorithms such as: control techniques, controller tuning, data reconciliation, steady state detection, model adaption, noise filtering, constraint prediction, fault detection, NN or fuzzy modeling, etc. Based on a full-scale exchanger, the simulator is nonlinear, with variable transport delay, third-order lags, and subject to both unmeasurable and measurable disturbances. Although rich in the expression of process features, the simulator is relatively simple to code. A VBA version of the simulator and user guide are accessible to the public on www.r3eda.com. (Note to reviewers, this might not be posted, but other simulators are.)
-这提供了一个过程热交换器的仿真模型,可用于测试和演示自动化算法,如:控制技术、控制器调谐、数据协调、稳态检测、模型自适应、噪声过滤、约束预测、故障检测、神经网络或模糊建模等。基于全尺寸交换器,模拟器是非线性的,具有可变传输延迟,三阶滞后,并且受到不可测量和可测量的干扰。虽然丰富的过程特征的表达,模拟器是相对简单的代码。VBA版本的模拟器和用户指南可供公众访问www.r3eda.com。(评论者注意,这可能不会发布,但其他模拟器会。)
{"title":"A Heat Exchanger Simulator for Testing and Demonstrating Automation Algorithms","authors":"R. Rhinehart","doi":"10.23919/ACC53348.2022.9867196","DOIUrl":"https://doi.org/10.23919/ACC53348.2022.9867196","url":null,"abstract":"— This offers a simulation model of a process heat exchanger, which can be used for testing and demonstration of automation algorithms such as: control techniques, controller tuning, data reconciliation, steady state detection, model adaption, noise filtering, constraint prediction, fault detection, NN or fuzzy modeling, etc. Based on a full-scale exchanger, the simulator is nonlinear, with variable transport delay, third-order lags, and subject to both unmeasurable and measurable disturbances. Although rich in the expression of process features, the simulator is relatively simple to code. A VBA version of the simulator and user guide are accessible to the public on www.r3eda.com. (Note to reviewers, this might not be posted, but other simulators are.)","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"69 1","pages":"3789-3794"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81718717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
PDE-Based Modeling and Non-collocated Feedback Control of Electrosurgical-Probe/Tissue Interaction. 基于pde的电外科-探针/组织相互作用建模与非配置反馈控制。
Pub Date : 2021-05-01 Epub Date: 2021-07-28 DOI: 10.23919/acc50511.2021.9483240
Hamza El-Kebir, Joseph Bentsman

The first control-oriented model of the interaction of an electrosurgical probe with organic tissue, based on a 1-D PDE with a moving boundary, is introduced. To attain the desired electrosurgically-induced tissue changes using this model, a non-collocated output feedback moving boundary control law is proposed. The latter is realized through a novel non-collocated pointwise temperature-based state observer for the two-phase Stefan problem. Simulation demonstrates that the controller proposed meets the performance objective. The controller implementation is also discussed.

介绍了基于带移动边界的一维PDE的第一个面向控制的电手术探针与有机组织相互作用模型。为了利用该模型获得理想的电手术诱导组织变化,提出了一种非并置输出反馈移动边界控制律。后者是通过一种新颖的非配位点温度状态观测器来实现的。仿真结果表明,所提出的控制器达到了性能目标。文中还讨论了控制器的实现。
{"title":"PDE-Based Modeling and Non-collocated Feedback Control of Electrosurgical-Probe/Tissue Interaction.","authors":"Hamza El-Kebir,&nbsp;Joseph Bentsman","doi":"10.23919/acc50511.2021.9483240","DOIUrl":"https://doi.org/10.23919/acc50511.2021.9483240","url":null,"abstract":"<p><p>The first control-oriented model of the interaction of an electrosurgical probe with organic tissue, based on a 1-D PDE with a moving boundary, is introduced. To attain the desired electrosurgically-induced tissue changes using this model, a non-collocated output feedback moving boundary control law is proposed. The latter is realized through a novel non-collocated pointwise temperature-based state observer for the two-phase Stefan problem. Simulation demonstrates that the controller proposed meets the performance objective. The controller implementation is also discussed.</p>","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"2021 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8341030/pdf/nihms-1692368.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39299968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Tracking Multiple Diffusing Particles Using Information Optimal Control. 基于信息最优控制的多扩散粒子跟踪。
Pub Date : 2021-05-01 Epub Date: 2021-07-28 DOI: 10.23919/acc50511.2021.9482619
Samuel C Pinto, Nicholas A Vickers, Fatemeh Sharifi, Sean B Andersson

We study the problem of tracking multiple diffusing particles using a laser scanning fluorescence microscope. The goal is to design trajectories for the laser to maximize the information contained in the measured intensity signal about the particles' trajectories. Our approach consists of a two level scheme: in the lower level we use an extremum seeking controller to track a single particle by first seeking it then orbiting around it. In the higher level controller, we decide which particle should be observed at each instant, with the goal of efficiently estimating each particle position while not losing track of any of them. Using simulations, we show that this technique is able to collect photons efficiently and to track multiple particles with low position estimation error.

利用激光扫描荧光显微镜研究了多个扩散粒子的跟踪问题。目标是设计激光的轨迹,以最大限度地利用测量强度信号中包含的关于粒子轨迹的信息。我们的方法由两级方案组成:在较低的级别,我们使用极值搜索控制器来跟踪单个粒子,首先搜索它,然后绕它运行。在高级控制器中,我们决定在每个瞬间应该观察哪个粒子,目标是有效地估计每个粒子的位置,同时不丢失它们中的任何一个。通过仿真,我们证明了该技术能够有效地收集光子,并以低的位置估计误差跟踪多个粒子。
{"title":"Tracking Multiple Diffusing Particles Using Information Optimal Control.","authors":"Samuel C Pinto,&nbsp;Nicholas A Vickers,&nbsp;Fatemeh Sharifi,&nbsp;Sean B Andersson","doi":"10.23919/acc50511.2021.9482619","DOIUrl":"https://doi.org/10.23919/acc50511.2021.9482619","url":null,"abstract":"<p><p>We study the problem of tracking multiple diffusing particles using a laser scanning fluorescence microscope. The goal is to design trajectories for the laser to maximize the information contained in the measured intensity signal about the particles' trajectories. Our approach consists of a two level scheme: in the lower level we use an extremum seeking controller to track a single particle by first seeking it then orbiting around it. In the higher level controller, we decide which particle should be observed at each instant, with the goal of efficiently estimating each particle position while not losing track of any of them. Using simulations, we show that this technique is able to collect photons efficiently and to track multiple particles with low position estimation error.</p>","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"2021 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.23919/acc50511.2021.9482619","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39366462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
EM-based algorithms for single particle tracking of Ornstein-Uhlenbeck motion from sCMOS camera data. 基于em的基于sCMOS相机数据的Ornstein-Uhlenbeck运动单粒子跟踪算法。
Pub Date : 2021-05-01 Epub Date: 2021-07-28 DOI: 10.23919/acc50511.2021.9483034
Ye Lin, Sean B Andersson

Single particle tracking plays an important role in studying physical and kinetic properties of biomolecules. In this work, we introduce the application of Expectation Maximization (EM) based algorithms for solving localization and parameter estimation problems in SPT using data captured from scientific complementary metal-oxide semiconductor (sCMOS) camera sensors. Two representative methods are considered for generating the filtered and smoothed distributions needed by EM: Sequential Monte Carlo - EM, and Unscented - EM. The SMC method uses particle filtering and particle smoothing to handle general distributions, while the U scheme reduces the computational burden through the use of an unscented Kalman Filter and an unscented Rauch-Tung Striebel Smoother. We also investigate the influence of the number of images in the dataset on the final estimates through intensive simulations as well as the computational efficiency of the two methods.

单粒子跟踪在研究生物分子的物理和动力学特性方面起着重要的作用。在这项工作中,我们介绍了基于期望最大化(EM)算法的应用,该算法使用从科学互补金属氧化物半导体(sCMOS)相机传感器捕获的数据来解决SPT中的定位和参数估计问题。考虑了两种具有代表性的方法来生成EM所需的滤波和平滑分布:顺序蒙特卡罗- EM和Unscented - EM。SMC方法使用粒子滤波和粒子平滑来处理一般分布,而U方案通过使用Unscented卡尔曼滤波器和Unscented Rauch-Tung Striebel平滑来减少计算量。我们还通过密集的模拟研究了数据集中图像数量对最终估计的影响以及两种方法的计算效率。
{"title":"EM-based algorithms for single particle tracking of Ornstein-Uhlenbeck motion from sCMOS camera data.","authors":"Ye Lin,&nbsp;Sean B Andersson","doi":"10.23919/acc50511.2021.9483034","DOIUrl":"https://doi.org/10.23919/acc50511.2021.9483034","url":null,"abstract":"<p><p>Single particle tracking plays an important role in studying physical and kinetic properties of biomolecules. In this work, we introduce the application of Expectation Maximization (EM) based algorithms for solving localization and parameter estimation problems in SPT using data captured from scientific complementary metal-oxide semiconductor (sCMOS) camera sensors. Two representative methods are considered for generating the filtered and smoothed distributions needed by EM: Sequential Monte Carlo - EM, and Unscented - EM. The SMC method uses particle filtering and particle smoothing to handle general distributions, while the U scheme reduces the computational burden through the use of an unscented Kalman Filter and an unscented Rauch-Tung Striebel Smoother. We also investigate the influence of the number of images in the dataset on the final estimates through intensive simulations as well as the computational efficiency of the two methods.</p>","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"2021 ","pages":"3945-3950"},"PeriodicalIF":0.0,"publicationDate":"2021-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8411991/pdf/nihms-1711781.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39402493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling zebrafish geotaxis as a feedback control process. 作为反馈控制过程的斑马鱼地向性建模。
Pub Date : 2021-05-01 Epub Date: 2021-07-28 DOI: 10.23919/acc50511.2021.9483149
Daniel A Burbano-L, Maurizio Porfiri

Developing mathematical models of the feedback control process underlying animal behavior is of critical importance to understand their interactions with the environment and emotional responses. For instance, fish geotaxis (the tendency to swim at the bottom of the tank) is known to be a highly sensitive measure of anxiety, but how and why animals tend to display such a complex response is yet to be fully clarified. Leveraging the theory of stochastic differential equations, we develop a data-driven model of geotaxis in the form of a feedback control loop where fish use information about the hydrostatic pressure to dive towards the bottom of the tank. The proposed framework extends open-loop models by incorporating a simple, yet effective, control mechanism to explain geotaxis. We focus on the zebrafish animal model, which is a species of choice in the study of anxiety disorders. We calibrate the model using available experimental data on acute ethanol treatment of adult zebrafish, and demonstrate its effectiveness across a wide range of comparisons between theoretical predictions and empirical observations.

建立动物行为背后的反馈控制过程的数学模型对于理解它们与环境和情绪反应的相互作用至关重要。例如,众所周知,鱼类的地向性(在鱼缸底部游动的倾向)是一种高度敏感的焦虑指标,但动物倾向于表现出这种复杂反应的方式和原因尚不完全清楚。利用随机微分方程理论,我们以反馈控制回路的形式开发了一个数据驱动的地向性模型,其中鱼类利用有关静水压力的信息向水箱底部潜水。提出的框架扩展了开环模型,结合了一个简单而有效的控制机制来解释地质趋向性。我们专注于斑马鱼动物模型,这是研究焦虑症的一种选择。我们使用成年斑马鱼急性乙醇治疗的现有实验数据来校准模型,并通过理论预测和经验观察之间的广泛比较来证明其有效性。
{"title":"Modeling zebrafish geotaxis as a feedback control process.","authors":"Daniel A Burbano-L,&nbsp;Maurizio Porfiri","doi":"10.23919/acc50511.2021.9483149","DOIUrl":"https://doi.org/10.23919/acc50511.2021.9483149","url":null,"abstract":"<p><p>Developing mathematical models of the feedback control process underlying animal behavior is of critical importance to understand their interactions with the environment and emotional responses. For instance, fish geotaxis (the tendency to swim at the bottom of the tank) is known to be a highly sensitive measure of anxiety, but how and why animals tend to display such a complex response is yet to be fully clarified. Leveraging the theory of stochastic differential equations, we develop a data-driven model of geotaxis in the form of a feedback control loop where fish use information about the hydrostatic pressure to dive towards the bottom of the tank. The proposed framework extends open-loop models by incorporating a simple, yet effective, control mechanism to explain geotaxis. We focus on the zebrafish animal model, which is a species of choice in the study of anxiety disorders. We calibrate the model using available experimental data on acute ethanol treatment of adult zebrafish, and demonstrate its effectiveness across a wide range of comparisons between theoretical predictions and empirical observations.</p>","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"2021 ","pages":"660-665"},"PeriodicalIF":0.0,"publicationDate":"2021-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8522050/pdf/nihms-1746541.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39560687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Learning from Having Learned: An Environment-adaptive Parking Space Detection Method 从已有的经验中学习:一种适应环境的停车位检测方法
Pub Date : 2020-07-01 DOI: 10.23919/ACC45564.2020.9147934
Yi Yang, Sitan Jiang, Lu Zhang, Jianhang Wang
Although parking space detection is a classic application in the field of image processing, most of commonly used methods can only guarantee their accuracy of detecting standard parking spaces due to the limitation of environmental diversity. Inspired by the close connection between vehicles and parking spaces in the parking environment, we believe that well-trained vehicle detection method can help improve the environmental adaptability of the parking space detection method. In this paper, we propose an environment-adaptive available parking space detection method. Based on the detection results obtained by vehicle detection and orientation estimation, our method enables the vision-only autonomous vehicle to learn environmental information near parked cars, and to detect available parking spaces accordingly. Results from real-world experiments have shown the functionality of the presented approach.
{"title":"Learning from Having Learned: An Environment-adaptive Parking Space Detection Method","authors":"Yi Yang, Sitan Jiang, Lu Zhang, Jianhang Wang","doi":"10.23919/ACC45564.2020.9147934","DOIUrl":"https://doi.org/10.23919/ACC45564.2020.9147934","url":null,"abstract":"Although parking space detection is a classic application in the field of image processing, most of commonly used methods can only guarantee their accuracy of detecting standard parking spaces due to the limitation of environmental diversity. Inspired by the close connection between vehicles and parking spaces in the parking environment, we believe that well-trained vehicle detection method can help improve the environmental adaptability of the parking space detection method. In this paper, we propose an environment-adaptive available parking space detection method. Based on the detection results obtained by vehicle detection and orientation estimation, our method enables the vision-only autonomous vehicle to learn environmental information near parked cars, and to detect available parking spaces accordingly. Results from real-world experiments have shown the functionality of the presented approach.","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"12 1","pages":"4022-4027"},"PeriodicalIF":0.0,"publicationDate":"2020-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87128159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Safety-Guaranteed, Accelerated Learning in MDPs with Local Side Information. 安全保证,加速学习在mdp与本地侧信息。
Pub Date : 2020-07-01 Epub Date: 2020-07-27 DOI: 10.23919/acc45564.2020.9147372
Pranay Thangeda, Melkior Ornik

In environments with uncertain dynamics, synthesis of optimal control policies mandates exploration. The applicability of classical learning algorithms to real-world problems is often limited by the number of time steps required for learning the environment model. Given some local side information about the differences in transition probabilities of the states, potentially obtained from the agent's onboard sensors, we generalize the idea of indirect sampling for accelerated learning to propose an algorithm that balances between exploration and exploitation. We formalize this idea by introducing the notion of the value of information in the context of a Markov decision process with unknown transition probabilities, as a measure of the expected improvement in the agent's current estimate of transition probabilities by taking a particular action. By exploiting available local side information and maximizing the estimated value of learned information at each time step, we accelerate the learning process and subsequent synthesis of the optimal control policy. Further, we define the notion of agent safety, a vital consideration for physical systems, in the context of our problem. Under certain assumptions, we provide guarantees on the safety of an agent exploring with our algorithm that exploits local side information. We illustrate agent safety and the improvement in learning speed using numerical experiments in the setting of a Mars rover, with data from onboard sensors acting as the local side information.

在动态不确定的环境中,最优控制策略的综合需要探索。经典学习算法对现实世界问题的适用性通常受到学习环境模型所需的时间步长的限制。给定一些关于状态转移概率差异的局部信息,这些信息可能来自智能体的机载传感器,我们推广了用于加速学习的间接抽样的思想,提出了一种平衡探索和开发之间的算法。我们通过在具有未知转移概率的马尔可夫决策过程中引入信息价值的概念来形式化这一思想,作为agent通过采取特定行动对当前转移概率估计的预期改进的度量。通过利用可用的局部侧信息和最大化每个时间步学习信息的估计值,我们加速了学习过程和随后的最优控制策略的综合。此外,我们在问题的上下文中定义了代理安全的概念,这是物理系统的重要考虑因素。在一定的假设下,我们利用我们的算法来保证代理探索的安全性。我们使用火星探测器设置的数值实验来说明智能体的安全性和学习速度的提高,其中来自机载传感器的数据作为局部信息。
{"title":"Safety-Guaranteed, Accelerated Learning in MDPs with Local Side Information.","authors":"Pranay Thangeda, Melkior Ornik","doi":"10.23919/acc45564.2020.9147372","DOIUrl":"10.23919/acc45564.2020.9147372","url":null,"abstract":"<p><p>In environments with uncertain dynamics, synthesis of optimal control policies mandates exploration. The applicability of classical learning algorithms to real-world problems is often limited by the number of time steps required for learning the environment model. Given some local side information about the differences in transition probabilities of the states, potentially obtained from the agent's onboard sensors, we generalize the idea of indirect sampling for accelerated learning to propose an algorithm that balances between exploration and exploitation. We formalize this idea by introducing the notion of the value of information in the context of a Markov decision process with unknown transition probabilities, as a measure of the expected improvement in the agent's current estimate of transition probabilities by taking a particular action. By exploiting available local side information and maximizing the estimated value of learned information at each time step, we accelerate the learning process and subsequent synthesis of the optimal control policy. Further, we define the notion of agent safety, a vital consideration for physical systems, in the context of our problem. Under certain assumptions, we provide guarantees on the safety of an agent exploring with our algorithm that exploits local side information. We illustrate agent safety and the improvement in learning speed using numerical experiments in the setting of a Mars rover, with data from onboard sensors acting as the local side information.</p>","PeriodicalId":74510,"journal":{"name":"Proceedings of the ... American Control Conference. American Control Conference","volume":"2020 ","pages":"1099-1104"},"PeriodicalIF":0.0,"publicationDate":"2020-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7676387/pdf/nihms-1643044.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38640130","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Proceedings of the ... American Control Conference. American Control Conference
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1