首页 > 最新文献

Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)最新文献

英文 中文
A Bioinspired Robotic Finger for Multimodal Tactile Sensing Powered by Fiber Optic Sensors 由光纤传感器驱动的多模态触觉传感生物启发机器人手指
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-18 DOI: 10.1002/aisy.202470034
Baijin Mao, Kunyu Zhou, Yuyaocen Xiang, Yuzhu Zhang, Qiangjing Yuan, Hongwei Hao, Yaozhen Chen, Houde Liu, Xueqian Wang, Xiaohao Wang, Juntian Qu

Bioinspired Robotic Fingers

In article number 2400175, Juntian Qu and co-workers report a bio-inspired robotic finger for multi-modal tactile sensing. Inspired by the tactile perception mechanisms of various organisms, this work integrates distributed fiber optic sensing technology to propose a multimodal tactile sensing soft robotic finger with bio-inspired whisker and hair-like structures. It can perceive various parameters such as touch state, contact force, surface roughness, object hardness, and contact position. Additionally, it is capable of dexterously and non-destructively grasping fragile objects and underwater transparent objects.

生物启发机器人手指 在编号为 2400175 的文章中,曲俊田及其合作者报告了一种用于多模态触觉传感的生物启发机器人手指。受各种生物体触觉感知机制的启发,这项工作集成了分布式光纤传感技术,提出了一种具有生物启发胡须和毛发状结构的多模态触觉感知软机器人手指。它能感知触摸状态、接触力、表面粗糙度、物体硬度和接触位置等各种参数。此外,它还能灵巧、无损地抓取易碎物体和水下透明物体。
{"title":"A Bioinspired Robotic Finger for Multimodal Tactile Sensing Powered by Fiber Optic Sensors","authors":"Baijin Mao,&nbsp;Kunyu Zhou,&nbsp;Yuyaocen Xiang,&nbsp;Yuzhu Zhang,&nbsp;Qiangjing Yuan,&nbsp;Hongwei Hao,&nbsp;Yaozhen Chen,&nbsp;Houde Liu,&nbsp;Xueqian Wang,&nbsp;Xiaohao Wang,&nbsp;Juntian Qu","doi":"10.1002/aisy.202470034","DOIUrl":"https://doi.org/10.1002/aisy.202470034","url":null,"abstract":"<p><b>Bioinspired Robotic Fingers</b>\u0000 </p><p>In article number 2400175, Juntian Qu and co-workers report a bio-inspired robotic finger for multi-modal tactile sensing. Inspired by the tactile perception mechanisms of various organisms, this work integrates distributed fiber optic sensing technology to propose a multimodal tactile sensing soft robotic finger with bio-inspired whisker and hair-like structures. It can perceive various parameters such as touch state, contact force, surface roughness, object hardness, and contact position. Additionally, it is capable of dexterously and non-destructively grasping fragile objects and underwater transparent objects.\u0000\u0000 <figure>\u0000 <div><picture>\u0000 <source></source></picture><p></p>\u0000 </div>\u0000 </figure></p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202470034","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142002528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Kirigami Multi-Stable Flexible Gripper with Energy-Free Configurations Switching 具有无能量配置切换功能的叽里呱啦多稳定柔性抓手
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-18 DOI: 10.1002/aisy.202470038
Zhifeng Qi, Xiuting Sun, Jian Xu

Kirigami Flexible Grippers

A kirigami multi-stable flexible gripper with trigger structure is presented by Xiuting Sun and co-workers in article number 2400038. The advanced trigger structure is designed to make the flexible gripper enable an energy-free switching behavior between deployed and curled configurations in symmetrical and asymmetrical planes. The proposed gripper is appropriate for the capture of space debris and demonstrates significant capture capability for moving targets.

叽里纸柔性机械手 孙秀廷及其合作者在文章 2400038 中介绍了一种具有触发结构的叽里纸多稳柔性机械手。先进的触发结构设计使柔性抓手能够在对称和非对称平面上实现展开和卷曲配置之间的无能量切换行为。所提出的机械手适用于捕获空间碎片,并展示了对移动目标的显著捕获能力。
{"title":"A Kirigami Multi-Stable Flexible Gripper with Energy-Free Configurations Switching","authors":"Zhifeng Qi,&nbsp;Xiuting Sun,&nbsp;Jian Xu","doi":"10.1002/aisy.202470038","DOIUrl":"https://doi.org/10.1002/aisy.202470038","url":null,"abstract":"<p><b>Kirigami Flexible Grippers</b>\u0000 </p><p>A kirigami multi-stable flexible gripper with trigger structure is presented by Xiuting Sun and co-workers in article number 2400038. The advanced trigger structure is designed to make the flexible gripper enable an energy-free switching behavior between deployed and curled configurations in symmetrical and asymmetrical planes. The proposed gripper is appropriate for the capture of space debris and demonstrates significant capture capability for moving targets.\u0000\u0000 <figure>\u0000 <div><picture>\u0000 <source></source></picture><p></p>\u0000 </div>\u0000 </figure></p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202470038","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142002530","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Biomimetic Synthesis of Nanosilica by Deep Learning-Designed Peptides and Its Anti-UV Application 深度学习设计肽的纳米二氧化硅仿生合成及其抗紫外线应用
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-18 DOI: 10.1002/aisy.202470037
Yuexuan Shu, Jiwei Chen, Beibei Xu, Zhengchang Liu, Hao Zheng, Fan Zhang, Weiqi Fu

Biomimetic Synthesis

In article 2300467, Weiqi Fu and co-workers use machine learning techniques to design peptides with silicifying functionality. Inspired by the exquisite nanosilica structures from nature, a deep learning model, based on antimicrobial peptide migration learning, is developed with the inputs of a comprehensive collection of silicifying peptides from diatoms to achieve the biomimetic synthesis of nanosilica. The newly designed silicified peptides could facilitate the development of new biosensors and drug delivery systems. [Image by Jiwei Chen and Mengsheng Xia.]

仿生合成 在第 2300467 号文章中,傅蔚琦及其合作者利用机器学习技术设计了具有硅化功能的多肽。受自然界精美的纳米二氧化硅结构的启发,基于抗菌肽迁移学习建立了一个深度学习模型,并输入了从硅藻中收集的大量硅化肽,实现了纳米二氧化硅的生物仿生合成。新设计的硅化肽可促进新型生物传感器和药物输送系统的开发。[图片由陈吉伟和夏梦生提供] 。
{"title":"Biomimetic Synthesis of Nanosilica by Deep Learning-Designed Peptides and Its Anti-UV Application","authors":"Yuexuan Shu,&nbsp;Jiwei Chen,&nbsp;Beibei Xu,&nbsp;Zhengchang Liu,&nbsp;Hao Zheng,&nbsp;Fan Zhang,&nbsp;Weiqi Fu","doi":"10.1002/aisy.202470037","DOIUrl":"https://doi.org/10.1002/aisy.202470037","url":null,"abstract":"<p><b>Biomimetic Synthesis</b>\u0000 </p><p>In article 2300467, Weiqi Fu and co-workers use machine learning techniques to design peptides with silicifying functionality. Inspired by the exquisite nanosilica structures from nature, a deep learning model, based on antimicrobial peptide migration learning, is developed with the inputs of a comprehensive collection of silicifying peptides from diatoms to achieve the biomimetic synthesis of nanosilica. The newly designed silicified peptides could facilitate the development of new biosensors and drug delivery systems. [Image by Jiwei Chen and Mengsheng Xia.]\u0000\u0000 <figure>\u0000 <div><picture>\u0000 <source></source></picture><p></p>\u0000 </div>\u0000 </figure></p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202470037","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142002582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving Targeted Mass Spectrometry Data Analysis with Nested Active Machine Learning 利用嵌套主动机器学习改进目标质谱数据分析
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-18 DOI: 10.1002/aisy.202470035
Duran Bao, Qingbo Shu, Bo Ning, Michael Tang, Yubing Liu, Noel Wong, Zhengming Ding, Zizhan Zheng, Christopher J. Lyon, Tony Hu, Jia Fan

Targeted Mass Spectrometry Data Analysis

The application of liquid chromatography-tandem mass spectrometry (LC-MS/MS) has facilitated the earlier detection and diagnosis of diseases preceding the manifestation of symptoms, but data analysis is complicated for clinical application. Integrating an automated machine learning pipeline can optimize LC-MS/MS data processing and analysis, even with limited training datasets. Machine learning pipelines can also implement an active learning nested model to mitigate bias from imbalanced training datasets, providing more accurate clinical proteomic analysis and disease diagnostic results. For more details, refer to article number 2300773 by Jia Fan, Duran Bao, and co-workers.

有针对性的质谱数据分析 液相色谱-串联质谱(LC-MS/MS)的应用有助于在症状出现之前更早地检测和诊断疾病,但临床应用中的数据分析非常复杂。整合自动化机器学习管道可以优化 LC-MS/MS 数据处理和分析,即使训练数据集有限。机器学习管道还可以实施主动学习嵌套模型,以减轻不平衡训练数据集带来的偏差,从而提供更准确的临床蛋白质组分析和疾病诊断结果。更多详情,请参阅范佳、鲍杜兰及合作者撰写的文章,文章编号:2300773。
{"title":"Improving Targeted Mass Spectrometry Data Analysis with Nested Active Machine Learning","authors":"Duran Bao,&nbsp;Qingbo Shu,&nbsp;Bo Ning,&nbsp;Michael Tang,&nbsp;Yubing Liu,&nbsp;Noel Wong,&nbsp;Zhengming Ding,&nbsp;Zizhan Zheng,&nbsp;Christopher J. Lyon,&nbsp;Tony Hu,&nbsp;Jia Fan","doi":"10.1002/aisy.202470035","DOIUrl":"https://doi.org/10.1002/aisy.202470035","url":null,"abstract":"<p><b>Targeted Mass Spectrometry Data Analysis</b>\u0000 </p><p>The application of liquid chromatography-tandem mass spectrometry (LC-MS/MS) has facilitated the earlier detection and diagnosis of diseases preceding the manifestation of symptoms, but data analysis is complicated for clinical application. Integrating an automated machine learning pipeline can optimize LC-MS/MS data processing and analysis, even with limited training datasets. Machine learning pipelines can also implement an active learning nested model to mitigate bias from imbalanced training datasets, providing more accurate clinical proteomic analysis and disease diagnostic results. For more details, refer to article number 2300773 by Jia Fan, Duran Bao, and co-workers.\u0000\u0000 <figure>\u0000 <div><picture>\u0000 <source></source></picture><p></p>\u0000 </div>\u0000 </figure></p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202470035","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142002529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Navigating Intelligence: A Survey of Google OR-Tools and Machine Learning for Global Path Planning in Autonomous Vehicles 智能导航:用于自动驾驶汽车全局路径规划的谷歌 OR 工具和机器学习调查
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-11 DOI: 10.1002/aisy.202300840
Alexandre Benoit, Pedram Asef

We offer a new in-depth investigation of global path planning (GPP) for unmanned ground vehicles, an autonomous mining sampling robot named ROMIE. GPP is essential for ROMIE's optimal performance, which is translated into solving the traveling salesman problem, a complex graph theory challenge that is crucial for determining the most effective route to cover all sampling locations in a mining field. This problem is central to enhancing ROMIE's operational efficiency and competitiveness against human labor by optimizing cost and time. The primary aim of this research is to advance GPP by developing, evaluating, and improving a cost-efficient software and web application. We delve into an extensive comparison and analysis of Google operations research (OR)-Tools optimization algorithms. Our study is driven by the goal of applying and testing the limits of OR-Tools capabilities by integrating Reinforcement Learning techniques for the first time. This enables us to compare these methods with OR-Tools, assessing their computational effectiveness and real-world application efficiency. Our analysis seeks to provide insights into the effectiveness and practical application of each technique. Our findings indicate that Q-Learning stands out as the optimal strategy, demonstrating superior efficiency by deviating only 1.2% on average from the optimal solutions across our datasets.

我们对无人地面车辆(一种名为 ROMIE 的自主采矿采样机器人)的全局路径规划(GPP)进行了新的深入研究。全局路径规划对 ROMIE 的最佳性能至关重要,它可以转化为解决旅行推销员问题,这是一个复杂的图论难题,对于确定覆盖采矿场所有采样地点的最有效路线至关重要。这个问题对于通过优化成本和时间来提高 ROMIE 的运行效率和与人力相比的竞争力至关重要。本研究的主要目的是通过开发、评估和改进具有成本效益的软件和网络应用程序来推进 GPP。我们对谷歌运筹学(OR)工具的优化算法进行了广泛的比较和分析。我们的研究目标是通过首次集成强化学习技术来应用和测试 OR-Tools 功能的极限。这使我们能够将这些方法与 OR-Tools 进行比较,评估它们的计算效果和实际应用效率。我们的分析旨在深入了解每种技术的有效性和实际应用。我们的研究结果表明,Q-Learning 是最佳策略,在我们的数据集中平均仅偏离最佳解决方案 1.2%,表现出卓越的效率。
{"title":"Navigating Intelligence: A Survey of Google OR-Tools and Machine Learning for Global Path Planning in Autonomous Vehicles","authors":"Alexandre Benoit,&nbsp;Pedram Asef","doi":"10.1002/aisy.202300840","DOIUrl":"https://doi.org/10.1002/aisy.202300840","url":null,"abstract":"<p>We offer a new in-depth investigation of global path planning (GPP) for unmanned ground vehicles, an autonomous mining sampling robot named ROMIE. GPP is essential for ROMIE's optimal performance, which is translated into solving the traveling salesman problem, a complex graph theory challenge that is crucial for determining the most effective route to cover all sampling locations in a mining field. This problem is central to enhancing ROMIE's operational efficiency and competitiveness against human labor by optimizing cost and time. The primary aim of this research is to advance GPP by developing, evaluating, and improving a cost-efficient software and web application. We delve into an extensive comparison and analysis of Google operations research (OR)-Tools optimization algorithms. Our study is driven by the goal of applying and testing the limits of OR-Tools capabilities by integrating Reinforcement Learning techniques for the first time. This enables us to compare these methods with OR-Tools, assessing their computational effectiveness and real-world application efficiency. Our analysis seeks to provide insights into the effectiveness and practical application of each technique. Our findings indicate that Q-Learning stands out as the optimal strategy, demonstrating superior efficiency by deviating only 1.2% on average from the optimal solutions across our datasets.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202300840","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142316774","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
BrainQN: Enhancing the Robustness of Deep Reinforcement Learning with Spiking Neural Networks BrainQN:利用尖峰神经网络增强深度强化学习的鲁棒性
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-04 DOI: 10.1002/aisy.202400075
Shuo Feng, Jian Cao, Zehong Ou, Guang Chen, Yi Zhong, Zilin Wang, Juntong Yan, Jue Chen, Bingsen Wang, Chenglong Zou, Zebang Feng, Yuan Wang

As the third-generation network succeeding artificial neural networks (ANNs), spiking neural networks (SNNs) offer high robustness and low energy consumption. Inspired by biological systems, the limitations of low robustness and high-power consumption in deep reinforcement learning (DRL) are addressed by introducing SNNs. The Brain Q-network (BrainQN) is proposed, which replaces the neurons in the classic Deep Q-learning (DQN) algorithm with SNN neurons. BrainQN is trained using surrogate gradient learning (SGL) and ANN-to-SNN conversion methods. Robustness tests with input noise reveal BrainQN's superior performance, achieving an 82.14% increase in rewards under low noise and 71.74% under high noise compared to DQN. These findings highlight BrainQN's robustness and superior performance in noisy environments, supporting its application in complex scenarios. SGL-trained BrainQN is more robust than ANN-to-SNN conversion under high noise. The differences in network output correlations between noisy and original inputs, along with training algorithm distinctions, explain this phenomenon. BrainQN successfully transitioned from a simulated Pong environment to a ball-catching robot with dynamic vision sensors (DVS). On the neuromorphic chip PAICORE, it shows significant advantages in latency and power consumption compared to Jetson Xavier NX.

作为继人工神经网络(ANN)之后的第三代网络,尖峰神经网络(SNN)具有高鲁棒性和低能耗的特点。受生物系统的启发,通过引入 SNN,解决了深度强化学习(DRL)中低鲁棒性和高能耗的局限性。我们提出了脑 Q 网络(BrainQN),用 SNN 神经元取代经典深度 Q 学习(DQN)算法中的神经元。BrainQN 采用代梯度学习(SGL)和 ANN 到 SNN 转换方法进行训练。与 DQN 相比,BrainQN 在低噪音和高噪音条件下的奖励分别增加了 82.14% 和 71.74%。这些发现凸显了 BrainQN 在噪声环境中的鲁棒性和卓越性能,为其在复杂场景中的应用提供了支持。在高噪音环境下,SGL 训练的 BrainQN 比 ANN 到 SNN 的转换更稳健。噪声输入与原始输入之间网络输出相关性的差异以及训练算法的不同解释了这一现象。BrainQN 成功地从模拟 Pong 环境过渡到了带有动态视觉传感器(DVS)的接球机器人。在神经形态芯片 PAICORE 上,与 Jetson Xavier NX 相比,它在延迟和功耗方面显示出显著优势。
{"title":"BrainQN: Enhancing the Robustness of Deep Reinforcement Learning with Spiking Neural Networks","authors":"Shuo Feng,&nbsp;Jian Cao,&nbsp;Zehong Ou,&nbsp;Guang Chen,&nbsp;Yi Zhong,&nbsp;Zilin Wang,&nbsp;Juntong Yan,&nbsp;Jue Chen,&nbsp;Bingsen Wang,&nbsp;Chenglong Zou,&nbsp;Zebang Feng,&nbsp;Yuan Wang","doi":"10.1002/aisy.202400075","DOIUrl":"https://doi.org/10.1002/aisy.202400075","url":null,"abstract":"<p>As the third-generation network succeeding artificial neural networks (ANNs), spiking neural networks (SNNs) offer high robustness and low energy consumption. Inspired by biological systems, the limitations of low robustness and high-power consumption in deep reinforcement learning (DRL) are addressed by introducing SNNs. The Brain Q-network (BrainQN) is proposed, which replaces the neurons in the classic Deep Q-learning (DQN) algorithm with SNN neurons. BrainQN is trained using surrogate gradient learning (SGL) and ANN-to-SNN conversion methods. Robustness tests with input noise reveal BrainQN's superior performance, achieving an 82.14% increase in rewards under low noise and 71.74% under high noise compared to DQN. These findings highlight BrainQN's robustness and superior performance in noisy environments, supporting its application in complex scenarios. SGL-trained BrainQN is more robust than ANN-to-SNN conversion under high noise. The differences in network output correlations between noisy and original inputs, along with training algorithm distinctions, explain this phenomenon. BrainQN successfully transitioned from a simulated Pong environment to a ball-catching robot with dynamic vision sensors (DVS). On the neuromorphic chip PAICORE, it shows significant advantages in latency and power consumption compared to Jetson Xavier NX.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400075","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142316730","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Looming Detection in Complex Dynamic Visual Scenes by Interneuronal Coordination of Motion and Feature Pathways 通过运动和特征通路的神经元间协调实现复杂动态视觉场景中的隐蔽检测
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-07-28 DOI: 10.1002/aisy.202400198
Bo Gu, Jianfeng Feng, Zhuoyi Song

Detecting looming signals for collision avoidance encounters challenges in real-world scenarios, where moving backgrounds can interfere as an agent navigates through complex natural environments. Remarkably, even insects with limited neural systems adeptly respond to looming stimuli while in motion at high speeds. Existing insect-inspired looming detection models typically rely on either motion-pathway or feature-pathway signals, yet both are susceptible to dynamic visual scene interference. Coordinating interneuron signals from both pathways can enhance the looming detection performance under dynamic conditions. An artificial neural network is employed to construct a combined-pathway model based on Drosophila anatomy. The model outperforms state-of-the-art bio-inspired looming-detection models in tasks involving dynamic backgrounds, simulated by animated 2D-moving natural scenes or recorded in reality when an unmanned aerial vehicle performs obstacle collision avoidance tasks. Notably, by combining neural anatomy architecture and appropriate multiobjective tasks, the model exhibits convergent neural dynamics with biological counterparts post-training, offering network explanations and mechanistic insights. Specifically, a multiplicative interneuron operation enhances looming signal patterns and reduces background interferences, generalizing to more complex scenarios, such as AirSim 3D environments and real-world situations. The work introduces testable biological hypotheses and a promising bioinspired solution for looming detection in dynamic visual environments.

在真实世界的场景中,当机器人在复杂的自然环境中穿梭时,移动背景可能会对其产生干扰,因此检测 "隐现 "信号以避免碰撞就成了难题。值得注意的是,即使是神经系统有限的昆虫,在高速运动时也能熟练地对 "隐现 "刺激做出反应。现有的昆虫隐现检测模型通常依赖于运动通路或特征通路信号,但这两种信号都容易受到动态视觉场景的干扰。协调来自这两条通路的中间神经元信号可以提高动态条件下的隐现检测性能。我们利用人工神经网络构建了一个基于果蝇解剖学的组合通路模型。在涉及动态背景的任务中,该模型的表现优于最先进的生物启发的隐现检测模型,这些动态背景是由动画二维移动自然场景模拟的,或者是无人驾驶飞行器执行避障任务时记录的现实场景。值得注意的是,通过将神经解剖结构与适当的多目标任务相结合,该模型在训练后表现出与生物对应模型趋同的神经动态,提供了网络解释和机理见解。具体来说,乘法神经元操作增强了隐现信号模式,减少了背景干扰,可推广到更复杂的场景,如 AirSim 三维环境和真实世界情况。该研究为动态视觉环境中的 "隐现 "检测引入了可检验的生物假设和有前景的生物启发解决方案。
{"title":"Looming Detection in Complex Dynamic Visual Scenes by Interneuronal Coordination of Motion and Feature Pathways","authors":"Bo Gu,&nbsp;Jianfeng Feng,&nbsp;Zhuoyi Song","doi":"10.1002/aisy.202400198","DOIUrl":"https://doi.org/10.1002/aisy.202400198","url":null,"abstract":"<p>Detecting looming signals for collision avoidance encounters challenges in real-world scenarios, where moving backgrounds can interfere as an agent navigates through complex natural environments. Remarkably, even insects with limited neural systems adeptly respond to looming stimuli while in motion at high speeds. Existing insect-inspired looming detection models typically rely on either motion-pathway or feature-pathway signals, yet both are susceptible to dynamic visual scene interference. Coordinating interneuron signals from both pathways can enhance the looming detection performance under dynamic conditions. An artificial neural network is employed to construct a combined-pathway model based on <i>Drosophila</i> anatomy. The model outperforms state-of-the-art bio-inspired looming-detection models in tasks involving dynamic backgrounds, simulated by animated 2D-moving natural scenes or recorded in reality when an unmanned aerial vehicle performs obstacle collision avoidance tasks. Notably, by combining neural anatomy architecture and appropriate multiobjective tasks, the model exhibits convergent neural dynamics with biological counterparts post-training, offering network explanations and mechanistic insights. Specifically, a multiplicative interneuron operation enhances looming signal patterns and reduces background interferences, generalizing to more complex scenarios, such as AirSim 3D environments and real-world situations. The work introduces testable biological hypotheses and a promising bioinspired solution for looming detection in dynamic visual environments.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400198","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142316979","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Transformer-Based Network for Full Object Pose Estimation with Depth Refinement 基于变换器的网络,可通过深度细化实现全物体姿态估计
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-07-28 DOI: 10.1002/aisy.202400110
Mahmoud Abdulsalam, Kenan Ahiska, Nabil Aouf

In response to increasing demand for robotics manipulation, accurate vision-based full pose estimation is essential. While convolutional neural networks-based approaches have been introduced, the quest for higher performance continues, especially for precise robotics manipulation, including in the Agri-robotics domain. This article proposes an improved transformer-based pipeline for full pose estimation, incorporating a Depth Refinement Module. Operating solely on monocular images, the architecture features an innovative Lighter Depth Estimation Network using a Feature Pyramid with an up-sampling method for depth prediction. A Transformer-based Detection Network with additional prediction heads is employed to directly regress object centers and predict the full poses of the target objects. A novel Depth Refinement Module is then utilized alongside the predicted centers, full poses, and depth patches to refine the accuracy of the estimated poses. The performance of this pipeline is extensively compared with other state-of-the-art methods, and the results are analyzed for fruit picking applications. The results demonstrate that the pipeline improves the accuracy of pose estimation to up to 90.79% compared to other methods available in the literature.

为满足日益增长的机器人操纵需求,基于视觉的精确全姿态估计至关重要。虽然已经推出了基于卷积神经网络的方法,但对更高性能的追求仍在继续,特别是在精确机器人操纵方面,包括农业机器人领域。本文提出了一种基于变压器的全姿态估计改进管道,其中包含深度细化模块。该架构仅在单目图像上运行,采用创新的轻型深度估计网络,使用特征金字塔和上采样方法进行深度预测。基于变压器的检测网络带有额外的预测头,可直接回归物体中心并预测目标物体的完整姿态。然后,一个新颖的深度细化模块与预测中心、全姿态和深度补丁一起使用,以细化估计姿态的准确性。该管道的性能与其他最先进的方法进行了广泛比较,并对水果采摘应用的结果进行了分析。结果表明,与文献中的其他方法相比,该管道将姿势估计的准确性提高了 90.79%。
{"title":"A Transformer-Based Network for Full Object Pose Estimation with Depth Refinement","authors":"Mahmoud Abdulsalam,&nbsp;Kenan Ahiska,&nbsp;Nabil Aouf","doi":"10.1002/aisy.202400110","DOIUrl":"https://doi.org/10.1002/aisy.202400110","url":null,"abstract":"<p>In response to increasing demand for robotics manipulation, accurate vision-based full pose estimation is essential. While convolutional neural networks-based approaches have been introduced, the quest for higher performance continues, especially for precise robotics manipulation, including in the Agri-robotics domain. This article proposes an improved transformer-based pipeline for full pose estimation, incorporating a Depth Refinement Module. Operating solely on monocular images, the architecture features an innovative Lighter Depth Estimation Network using a Feature Pyramid with an up-sampling method for depth prediction. A Transformer-based Detection Network with additional prediction heads is employed to directly regress object centers and predict the full poses of the target objects. A novel Depth Refinement Module is then utilized alongside the predicted centers, full poses, and depth patches to refine the accuracy of the estimated poses. The performance of this pipeline is extensively compared with other state-of-the-art methods, and the results are analyzed for fruit picking applications. The results demonstrate that the pipeline improves the accuracy of pose estimation to up to 90.79% compared to other methods available in the literature.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400110","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142443533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cooperative Path Planning for Multiplayer Reach-Avoid Games under Imperfect Observation Information 不完全观测信息下的多人到达-避免游戏的合作路径规划
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-07-25 DOI: 10.1002/aisy.202300794
Hongwei Fang, Yue Chen, Peng Yi

This article investigates a reach-avoid game and proposes a cooperative path planning algorithm for a target–pursuers (TP) coalition to capture an evader. In the game, the target aims to bait and escape from the evader, and the pursuer aims to capture the evader. Due to imperfect observations, the TP coalition has uncertain information of the evader's state, while the evader is assumed to have perfect observation. The game model is constructed by formulating the optimization problems for each player in a receding horizon fashion. Then, to counter the evader effectively, the TP coalition constructs a virtual evader using the belief information from a Kalman filter. And a chance constraint optimization problem is constructed to predict the virtual evader's trajectory under uncertainties. The TP coalition can capture the actual evader by generating a robust counter-strategy against the virtual evader with a chance constraint feasible set. Next, to compute the Nash equilibrium of the TP coalition's subjective game, an iterative algorithm is designed that combines the iterative best response and the distributed alternating direction method of multiplier algorithms. Finally, the effectiveness of the algorithm is validated through simulations and experiments.

本文研究了一种 "到达-回避 "博弈,并提出了一种目标-追击者(TP)联盟捕捉回避者的合作路径规划算法。在博弈中,目标的目的是诱捕并逃离逃逸者,追捕者的目的是捕获逃逸者。由于观测不完全,TP 联盟对逃逸者的状态信息不确定,而逃逸者被假定为观测完全。博弈模型是通过以后退视界方式为每个博弈方提出优化问题而构建的。然后,为了有效对抗逃避者,TP 联盟利用卡尔曼滤波器的信念信息构建了一个虚拟逃避者。并构建一个机会约束优化问题,以预测虚拟逃避者在不确定情况下的轨迹。TP 联盟可以通过机会约束可行集生成一个针对虚拟逃避者的稳健反策略,从而捕获实际逃避者。接下来,为了计算 TP 联盟主观博弈的纳什均衡,设计了一种迭代算法,该算法结合了乘法算法的迭代最佳响应和分布式交替方向法。最后,通过模拟和实验验证了算法的有效性。
{"title":"Cooperative Path Planning for Multiplayer Reach-Avoid Games under Imperfect Observation Information","authors":"Hongwei Fang,&nbsp;Yue Chen,&nbsp;Peng Yi","doi":"10.1002/aisy.202300794","DOIUrl":"10.1002/aisy.202300794","url":null,"abstract":"<p>This article investigates a reach-avoid game and proposes a cooperative path planning algorithm for a target–pursuers (TP) coalition to capture an evader. In the game, the target aims to bait and escape from the evader, and the pursuer aims to capture the evader. Due to imperfect observations, the TP coalition has uncertain information of the evader's state, while the evader is assumed to have perfect observation. The game model is constructed by formulating the optimization problems for each player in a receding horizon fashion. Then, to counter the evader effectively, the TP coalition constructs a virtual evader using the belief information from a Kalman filter. And a chance constraint optimization problem is constructed to predict the virtual evader's trajectory under uncertainties. The TP coalition can capture the actual evader by generating a robust counter-strategy against the virtual evader with a chance constraint feasible set. Next, to compute the Nash equilibrium of the TP coalition's subjective game, an iterative algorithm is designed that combines the iterative best response and the distributed alternating direction method of multiplier algorithms. Finally, the effectiveness of the algorithm is validated through simulations and experiments.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202300794","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141805103","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Long Short-Term Memory-Based Multi-Robot Trajectory Planning: Learn from MPCC and Make It Better 基于长短期记忆的多机器人轨迹规划:从 MPCC 中学习并使其更好
IF 6.8 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-07-24 DOI: 10.1002/aisy.202300703
Jianbin Xin, Tao Xu, Jihong Zhu, Heshan Wang, Jinzhu Peng

The current trajectory planning methods for multi-robot systems face challenges due to high computational burden and inadequate adaptability in complex constrained environments, obstructing efficiency improvements in production and logistics. This article presents an innovative solution by integrating model predictive contouring control (MPCC) and long short-term memory (LSTM) networks for real-time trajectory planning of multiple mobile robots. Based on the datasets generated by MPCC, a customized LSTM network is constructed to learn the collaborative planning behavior from these datasets offline, subsequently producing smooth and efficient trajectories online with a low computational burden. Moreover, a hybrid control scheme, incorporating a lidar-based safety evaluator, avoids unexpected collision risks by switching to MPCC when necessary, ensuring the overall safety and reliability of the multi-robot system. The proposed hybrid LSTM method is implemented and tested in the robot operating system (ROS) within diverse constrained scenarios. Experimental results demonstrate that the hybrid LSTM method achieves ≈6% enhancements in trajectory productivity and a reduced computational burden of roughly 75% compared to MPCC, thereby providing a promising solution for local multi-robot trajectory planning in logistics transportation tasks.

当前的多机器人系统轨迹规划方法面临着计算负担高、对复杂受限环境适应性不足等挑战,阻碍了生产和物流效率的提高。本文通过整合模型预测轮廓控制(MPCC)和长短期记忆(LSTM)网络,提出了一种创新的解决方案,用于多移动机器人的实时轨迹规划。基于 MPCC 生成的数据集,构建了一个定制的 LSTM 网络,用于离线学习这些数据集中的协作规划行为,随后以较低的计算负担在线生成平滑高效的轨迹。此外,混合控制方案结合了基于激光雷达的安全评估器,可在必要时切换到 MPCC,从而避免意外碰撞风险,确保多机器人系统的整体安全性和可靠性。我们在机器人操作系统(ROS)中实现并测试了所提出的混合 LSTM 方法。实验结果表明,与 MPCC 相比,混合 LSTM 方法的轨迹生产率提高了≈6%,计算负担减少了约 75%,从而为物流运输任务中的局部多机器人轨迹规划提供了一种前景广阔的解决方案。
{"title":"Long Short-Term Memory-Based Multi-Robot Trajectory Planning: Learn from MPCC and Make It Better","authors":"Jianbin Xin,&nbsp;Tao Xu,&nbsp;Jihong Zhu,&nbsp;Heshan Wang,&nbsp;Jinzhu Peng","doi":"10.1002/aisy.202300703","DOIUrl":"10.1002/aisy.202300703","url":null,"abstract":"<p>The current trajectory planning methods for multi-robot systems face challenges due to high computational burden and inadequate adaptability in complex constrained environments, obstructing efficiency improvements in production and logistics. This article presents an innovative solution by integrating model predictive contouring control (MPCC) and long short-term memory (LSTM) networks for real-time trajectory planning of multiple mobile robots. Based on the datasets generated by MPCC, a customized LSTM network is constructed to learn the collaborative planning behavior from these datasets offline, subsequently producing smooth and efficient trajectories online with a low computational burden. Moreover, a hybrid control scheme, incorporating a lidar-based safety evaluator, avoids unexpected collision risks by switching to MPCC when necessary, ensuring the overall safety and reliability of the multi-robot system. The proposed hybrid LSTM method is implemented and tested in the robot operating system (ROS) within diverse constrained scenarios. Experimental results demonstrate that the hybrid LSTM method achieves ≈6% enhancements in trajectory productivity and a reduced computational burden of roughly 75% compared to MPCC, thereby providing a promising solution for local multi-robot trajectory planning in logistics transportation tasks.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":null,"pages":null},"PeriodicalIF":6.8,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202300703","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141807876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1