首页 > 最新文献

Cognitive Robotics最新文献

英文 中文
Reinforcement learning for swarm robotics: An overview of applications, algorithms and simulators 群体机器人的强化学习:应用、算法和模拟器综述
Pub Date : 2023-01-01 DOI: 10.1016/j.cogr.2023.07.004
Marc-Andrė Blais, Moulay A. Akhloufi

Robots such as drones, ground rovers, underwater vehicles and industrial robots have increased in popularity in recent years. Many sectors have benefited from this by increasing productivity while also decreasing costs and certain risks to humans. These robots can be controlled individually but are more efficient in a large group, also known as a swarm. However, an increase in the quantity and complexity of robots creates the need for an adequate control system. Reinforcement learning, an artificial intelligence paradigm, is an increasingly popular approach to control a swarm of unmanned vehicles. The quantity of reviews in the field of reinforcement learning-based swarm robotics is limited. We propose reviewing the various applications, algorithms and simulators on the subject to fill this gap. First, we present the current applications on swarm robotics with a focus on reinforcement learning control systems. Subsequently, we define important reinforcement learning terminologies, followed by a review of the current state-of-the-art in the field of swarm robotics utilizing reinforcement learning. Additionally, we review the various simulators used to train, validate and simulate swarms of unmanned vehicles. We finalize our review by discussing our findings and the possible directions for future research. Overall, our review demonstrates the potential and state-of-the-art reinforcement learning-based control systems for swarm robotics.

近年来,无人机、地面漫游车、水下机器人和工业机器人等机器人越来越受欢迎。许多部门从中受益,提高了生产力,同时降低了成本和对人类的某些风险。这些机器人可以单独控制,但在大型群体(也称为群体)中效率更高。然而,机器人数量和复杂性的增加产生了对足够的控制系统的需求。强化学习是一种人工智能范式,是一种越来越流行的控制无人驾驶汽车群的方法。基于强化学习的群体机器人领域的综述数量有限。我们建议审查该主题的各种应用程序、算法和模拟器,以填补这一空白。首先,我们介绍了群体机器人的当前应用,重点是强化学习控制系统。随后,我们定义了重要的强化学习术语,然后回顾了利用强化学习的群体机器人领域的最新技术。此外,我们还回顾了用于训练、验证和模拟成群无人驾驶汽车的各种模拟器。我们通过讨论我们的发现和未来研究的可能方向来完成我们的审查。总体而言,我们的综述展示了基于强化学习的群体机器人控制系统的潜力和最先进的技术。
{"title":"Reinforcement learning for swarm robotics: An overview of applications, algorithms and simulators","authors":"Marc-Andrė Blais,&nbsp;Moulay A. Akhloufi","doi":"10.1016/j.cogr.2023.07.004","DOIUrl":"https://doi.org/10.1016/j.cogr.2023.07.004","url":null,"abstract":"<div><p>Robots such as drones, ground rovers, underwater vehicles and industrial robots have increased in popularity in recent years. Many sectors have benefited from this by increasing productivity while also decreasing costs and certain risks to humans. These robots can be controlled individually but are more efficient in a large group, also known as a swarm. However, an increase in the quantity and complexity of robots creates the need for an adequate control system. Reinforcement learning, an artificial intelligence paradigm, is an increasingly popular approach to control a swarm of unmanned vehicles. The quantity of reviews in the field of reinforcement learning-based swarm robotics is limited. We propose reviewing the various applications, algorithms and simulators on the subject to fill this gap. First, we present the current applications on swarm robotics with a focus on reinforcement learning control systems. Subsequently, we define important reinforcement learning terminologies, followed by a review of the current state-of-the-art in the field of swarm robotics utilizing reinforcement learning. Additionally, we review the various simulators used to train, validate and simulate swarms of unmanned vehicles. We finalize our review by discussing our findings and the possible directions for future research. Overall, our review demonstrates the potential and state-of-the-art reinforcement learning-based control systems for swarm robotics.</p></div>","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"3 ","pages":"Pages 226-256"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49710706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design and Development of a Pneumatic Conveyor Robot for Color Detection and Sorting 色彩检测分拣气动输送机器人的设计与开发
Pub Date : 2022-03-01 DOI: 10.1016/j.cogr.2022.03.001
Mohammadreza Lalegani Dezaki, Saghi Hatami, A. Zolfagharian, M. Bodaghi
{"title":"Design and Development of a Pneumatic Conveyor Robot for Color Detection and Sorting","authors":"Mohammadreza Lalegani Dezaki, Saghi Hatami, A. Zolfagharian, M. Bodaghi","doi":"10.1016/j.cogr.2022.03.001","DOIUrl":"https://doi.org/10.1016/j.cogr.2022.03.001","url":null,"abstract":"","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"10 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73461653","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Panoptic segmentation network based on fusion coding and attention mechanism 基于融合编码和注意机制的全视分割网络
Pub Date : 2022-01-01 DOI: 10.1016/j.cogr.2022.08.001
Jiarui Zhang, Penghui Tian

Aiming at the problem that the panoptic segmentation network based on coding structure can't accurately extract the detailed information of panoptic images, considering that there are some commonalities between semantic segmentation and instance segmentation tasks, this paper proposes a panoptic segmentation model with multi-feature fusion structure, which generates multi-scale fused feature maps for the panoptic segmentation network, uses the Atrous Spatial Pyramid Pooling to preferentially process the high-level features with rich context information, and then uses the cascade method to splice the low-level features to improve the panoptic segmentation performance of the model. By adding coordinate attention to the ASPP module of the corresponding branch, the perception ability of the model to the contour and instance center is enhanced.

针对基于编码结构的泛光分割网络不能准确提取泛光图像细节信息的问题,考虑到语义分割和实例分割任务之间存在共性,提出了一种多特征融合结构的泛光分割模型,该模型为泛光分割网络生成多尺度融合特征映射。利用空间金字塔池法对上下文信息丰富的高层特征进行优先处理,然后利用级联方法对低层特征进行拼接,提高模型的全视分割性能。通过在相应分支的ASPP模块中增加坐标关注,增强了模型对轮廓和实例中心的感知能力。
{"title":"Panoptic segmentation network based on fusion coding and attention mechanism","authors":"Jiarui Zhang,&nbsp;Penghui Tian","doi":"10.1016/j.cogr.2022.08.001","DOIUrl":"10.1016/j.cogr.2022.08.001","url":null,"abstract":"<div><p>Aiming at the problem that the panoptic segmentation network based on coding structure can't accurately extract the detailed information of panoptic images, considering that there are some commonalities between semantic segmentation and instance segmentation tasks, this paper proposes a panoptic segmentation model with multi-feature fusion structure, which generates multi-scale fused feature maps for the panoptic segmentation network, uses the Atrous Spatial Pyramid Pooling to preferentially process the high-level features with rich context information, and then uses the cascade method to splice the low-level features to improve the panoptic segmentation performance of the model. By adding coordinate attention to the ASPP module of the corresponding branch, the perception ability of the model to the contour and instance center is enhanced.</p></div>","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"2 ","pages":"Pages 186-192"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667241322000179/pdfft?md5=24ed60274e02ce0253046e2bd7a44c68&pid=1-s2.0-S2667241322000179-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73996919","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Spread-based elite opposite swarm optimizer for large scale optimization 面向大规模优化的基于spread的精英逆向群优化算法
Pub Date : 2022-01-01 DOI: 10.1016/j.cogr.2022.03.005
Li Zhang, Yu Tan

To prevent the traditional particle swarm optimizer (PSO) from inefficient search in complex problem spaces, this paper presents a novel spread-based elite opposite swarm optimizer (SEOSO) for large scale optimization. Inspired by the dandelion seeds in nature, the seeds can randomly spread by wind and grow better for the next generation. To achieve this, the spread learning and elite opposite learning are introduced in SEOSO. In spread learning, the particles are divided into some subswarms and these subswarms can exchange the particles to get more useful information that improves the diversity of the swarm. In elite opposite learning, the opposite position of the particle is used to exclude the worse direction. The experiments are conducted on 35 benchmark functions to evaluate the performance of SEOSO in comparison with several state-of-the-art algorithms. The comparative results show the effectiveness of SEOSO in solving large scale optimization problems.

针对传统粒子群优化器(PSO)在复杂问题空间中搜索效率低下的问题,提出了一种基于扩展的精英对群优化器(SEOSO)。灵感来自大自然中的蒲公英种子,种子可以随风随意传播,为下一代生长得更好。为此,在SEOSO中引入了扩散学习和精英逆向学习。在扩展学习中,粒子被分成若干子群,这些子群可以交换粒子以获得更多有用的信息,从而提高群体的多样性。在精英逆向学习中,利用粒子的反向位置来排除较差的方向。在35个基准函数上进行了实验,以评估SEOSO与几种最先进算法的性能。对比结果表明了该算法在解决大规模优化问题中的有效性。
{"title":"Spread-based elite opposite swarm optimizer for large scale optimization","authors":"Li Zhang,&nbsp;Yu Tan","doi":"10.1016/j.cogr.2022.03.005","DOIUrl":"10.1016/j.cogr.2022.03.005","url":null,"abstract":"<div><p>To prevent the traditional particle swarm optimizer (PSO) from inefficient search in complex problem spaces, this paper presents a novel spread-based elite opposite swarm optimizer (SEOSO) for large scale optimization. Inspired by the dandelion seeds in nature, the seeds can randomly spread by wind and grow better for the next generation. To achieve this, the spread learning and elite opposite learning are introduced in SEOSO. In spread learning, the particles are divided into some subswarms and these subswarms can exchange the particles to get more useful information that improves the diversity of the swarm. In elite opposite learning, the opposite position of the particle is used to exclude the worse direction. The experiments are conducted on 35 benchmark functions to evaluate the performance of SEOSO in comparison with several state-of-the-art algorithms. The comparative results show the effectiveness of SEOSO in solving large scale optimization problems.</p></div>","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"2 ","pages":"Pages 112-118"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S266724132200009X/pdfft?md5=72afb6fbbfba394baa5d092c467570af&pid=1-s2.0-S266724132200009X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72570099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Research on improved full-factor deep information mining algorithm 改进的全因子深度信息挖掘算法研究
Pub Date : 2022-01-01 DOI: 10.1016/j.cogr.2022.01.001
Yun Man , Xu Fei , Liu Jun , Zhang Qian

In the use of fire-fighting physics platform for fire alarm data correlation analysis, there are often problems such as too much data volume and insufficient accuracy of the analysis results. For such questions, this paper establishes a full-factor secondary mining mechanism for fire accidents based on the fire big data based on the correlation analysis algorithm and the clustering algorithm. The association algorithm is used to conduct full-factor primary mining on the fire-related factors in the data warehouse, and the common-sense accident attributes in the association rules are extracted. Then use the K-means clustering algorithm, where the cluster center is the relevant attribute in the fire accident record, and perform the second combined clustering of the accident elements to achieve in-depth information mining of all factors of the fire accident. Experimental results show that the improved full-factor deep information mining algorithm proposed in this paper can effectively filter 31.6% of meaningless mining results compared to the traditional single mining algorithm. It shows that the algorithm in this paper can more accurately dig out the relationship between data, and can provide more effective decision support for fire management and other work.

在利用消防物理平台进行火灾报警数据相关性分析时,往往存在数据量过大、分析结果准确性不足等问题。针对这些问题,本文基于相关分析算法和聚类算法,建立了基于火灾大数据的火灾事故全因素二次挖掘机制。利用关联算法对数据仓库中的火灾相关因素进行全因素初级挖掘,提取关联规则中的常识性事故属性。然后使用K-means聚类算法,其中聚类中心为火灾事故记录中的相关属性,对事故要素进行第二次联合聚类,实现对火灾事故各因素的深度信息挖掘。实验结果表明,与传统的单一挖掘算法相比,本文提出的改进的全因子深度信息挖掘算法能有效过滤掉31.6%的无意义挖掘结果。结果表明,本文算法能够更准确地挖掘出数据之间的关系,能够为消防管理等工作提供更有效的决策支持。
{"title":"Research on improved full-factor deep information mining algorithm","authors":"Yun Man ,&nbsp;Xu Fei ,&nbsp;Liu Jun ,&nbsp;Zhang Qian","doi":"10.1016/j.cogr.2022.01.001","DOIUrl":"https://doi.org/10.1016/j.cogr.2022.01.001","url":null,"abstract":"<div><p>In the use of fire-fighting physics platform for fire alarm data correlation analysis, there are often problems such as too much data volume and insufficient accuracy of the analysis results. For such questions, this paper establishes a full-factor secondary mining mechanism for fire accidents based on the fire big data based on the correlation analysis algorithm and the clustering algorithm. The association algorithm is used to conduct full-factor primary mining on the fire-related factors in the data warehouse, and the common-sense accident attributes in the association rules are extracted. Then use the K-means clustering algorithm, where the cluster center is the relevant attribute in the fire accident record, and perform the second combined clustering of the accident elements to achieve in-depth information mining of all factors of the fire accident. Experimental results show that the improved full-factor deep information mining algorithm proposed in this paper can effectively filter 31.6% of meaningless mining results compared to the traditional single mining algorithm. It shows that the algorithm in this paper can more accurately dig out the relationship between data, and can provide more effective decision support for fire management and other work.</p></div>","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"2 ","pages":"Pages 30-38"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667241322000015/pdfft?md5=0dd4e3a0dc308e9e12201330a7437e1f&pid=1-s2.0-S2667241322000015-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136555883","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fine-grained regression for image aesthetic scoring 图像美学评分的细粒度回归
Pub Date : 2022-01-01 DOI: 10.1016/j.cogr.2022.07.003
Xin Jin, Qiang Deng, Hao Lou, Xiqiao Li, Chaoen Xiao

There are many tasks on image aesthetic assessment, such as aesthetic classification, scoring, score distribution prediction, and captions. Due to the distribution of the aesthetic score is unbalanced, the assessment models always output scores near the mean score. In this paper, we propose a fine-grained regression method for aesthetics score regression and combine position and channel attention mechanisms to enhance the aesthetic feature fusion. And by training the regression network separately from the classification network, we make the classification task a complement to the regression task. Besides, the researchers are used to using Mean Square Error (MSE) as the main evaluation metric which is inadequate in measuring the error of each interval. In order to fully consider the images of the various aesthetic score segments, instead of focusing on the intermediate aesthetic score segments because of the imbalance of the aesthetic datasets, we propose a new evaluation metric called Segmented Mean Square Errors (SMSE) to prove the advantages of the model. We divide the entire AADB dataset into 10 equal parts based on the aesthetic scores and the experiments were carried out on each of the segmented AADB datasets. In this way, images for each aesthetic score segment are fairly considered. The experimental results reveal that our method outperforms all the state-of-the-art methods on both MSE and SMSE. The dual attention modules of position and channel also make the activation maps more reasonable. Our methods make the aesthetic scoring go beyond laboratories to real life applications. Because computational visual aesthetics is a very interesting and challenging task in the field of computer vision, and computer vision is also one of the key areas of focus of this journal, the method proposed in this paper is closely related to the field covered by the journal.

图像美学评价有许多任务,如美学分类、评分、分数分布预测和标题。由于审美分数的分布是不平衡的,评价模型输出的分数总是接近平均分。本文提出了一种细粒度的美学评分回归方法,并结合位置注意机制和通道注意机制来增强美学特征融合。通过将回归网络与分类网络分开训练,使分类任务成为回归任务的补充。此外,研究人员习惯于使用均方误差(Mean Square Error, MSE)作为主要评价指标,这不足以衡量每个区间的误差。为了充分考虑各个审美评分段的图像,而不是因为审美数据集的不平衡而关注中间的审美评分段,我们提出了一种新的评价指标,称为分割均方误差(SMSE)来证明模型的优势。我们根据美学分数将整个AADB数据集划分为10等份,并在每个分割的AADB数据集上进行实验。这样,每个美学评分段的图像都得到了公平的考虑。实验结果表明,我们的方法在MSE和SMSE上都优于所有最先进的方法。位置和通道的双重注意模块也使激活图更加合理。我们的方法使美学评分从实验室走向现实生活。由于计算视觉美学在计算机视觉领域是一个非常有趣和具有挑战性的任务,而计算机视觉也是本期刊重点关注的领域之一,因此本文提出的方法与该期刊所涵盖的领域密切相关。
{"title":"Fine-grained regression for image aesthetic scoring","authors":"Xin Jin,&nbsp;Qiang Deng,&nbsp;Hao Lou,&nbsp;Xiqiao Li,&nbsp;Chaoen Xiao","doi":"10.1016/j.cogr.2022.07.003","DOIUrl":"10.1016/j.cogr.2022.07.003","url":null,"abstract":"<div><p>There are many tasks on image aesthetic assessment, such as aesthetic classification, scoring, score distribution prediction, and captions. Due to the distribution of the aesthetic score is unbalanced, the assessment models always output scores near the mean score. In this paper, we propose a fine-grained regression method for aesthetics score regression and combine position and channel attention mechanisms to enhance the aesthetic feature fusion. And by training the regression network separately from the classification network, we make the classification task a complement to the regression task. Besides, the researchers are used to using Mean Square Error (MSE) as the main evaluation metric which is inadequate in measuring the error of each interval. In order to fully consider the images of the various aesthetic score segments, instead of focusing on the intermediate aesthetic score segments because of the imbalance of the aesthetic datasets, we propose a new evaluation metric called Segmented Mean Square Errors (SMSE) to prove the advantages of the model. We divide the entire AADB dataset into 10 equal parts based on the aesthetic scores and the experiments were carried out on each of the segmented AADB datasets. In this way, images for each aesthetic score segment are fairly considered. The experimental results reveal that our method outperforms all the state-of-the-art methods on both MSE and SMSE. The dual attention modules of position and channel also make the activation maps more reasonable. Our methods make the aesthetic scoring go beyond laboratories to real life applications. Because computational visual aesthetics is a very interesting and challenging task in the field of computer vision, and computer vision is also one of the key areas of focus of this journal, the method proposed in this paper is closely related to the field covered by the journal.</p></div>","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"2 ","pages":"Pages 202-210"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667241322000167/pdfft?md5=dc3af1caaad28fd9bab9b75e96e3a5e1&pid=1-s2.0-S2667241322000167-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78743861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DCTNets: Deep crowd transfer networks for an approximate crowd counting DCTNets:用于近似人群计数的深度人群转移网络
Pub Date : 2022-01-01 DOI: 10.1016/j.cogr.2022.03.004
Arslan Ali , Weihua Ou , Saima Kanwal

Due to the numerous real-world applications of the crowd counting job, it has become a popular research topic. Modern crowd counting systems have a sophisticated structure and employ a filter on a big image size, making them difficult to use. Because these technologies are computationally intensive and difficult to implement in small surveillance systems, they are not appropriate for use in small surveillance systems. They also function poorly in a variety of sizes and densities, as well. Transfer learning and deep convolutional neural network architecture are used to create a modest but efficient network, which we describe herein. We named the proposed crowd counting architecture deep crowd transfer network (DCTNets) since it incorporates both deep learning and transfer learning principles into a single system. Among DCTNets’ key components are a detection module that is based on mask R-CNNs and an estimate module that is based on deep convolutional neural networks. In the first step, we apply transfer learning to the Mask R-CNN model using the datasets ShanghaiTech, JHU-CROWD++, and UCF-QNRF. After that, we train and evaluate the complete architecture on these datasets using the transfer learning results. Input images are sent through a Mask R-CNN, which counts individuals and segments the counted region, then through an estimation network, which estimates the population size, and finally through a merge of the outputs from the two models. According to the findings of comparative tests, the proposed model outperforms existing state-of-the-art approaches on the ShanghaiTech, JHU-CROWD++, and UCF-QNRF datasets.

由于人群计数工作在现实世界中的大量应用,它已成为一个热门的研究课题。现代人群计数系统具有复杂的结构,并且在大图像尺寸上使用过滤器,这使得它们难以使用。由于这些技术计算量大,难以在小型监控系统中实现,因此不适合在小型监控系统中使用。它们在各种大小和密度下的功能也很差。使用迁移学习和深度卷积神经网络架构来创建一个适度但高效的网络,我们在这里描述。我们将提出的人群计数架构命名为深度人群迁移网络(DCTNets),因为它将深度学习和迁移学习原理结合到一个系统中。DCTNets的关键组件包括基于掩码r - cnn的检测模块和基于深度卷积神经网络的估计模块。在第一步,我们将迁移学习应用于Mask R-CNN模型,使用数据集ShanghaiTech, JHU-CROWD++和UCF-QNRF。之后,我们使用迁移学习结果在这些数据集上训练和评估完整的架构。输入图像通过Mask R-CNN发送,该Mask R-CNN对个体进行计数,并对被计数的区域进行分割,然后通过估计网络发送,该网络估计种群大小,最后通过合并两个模型的输出。根据对比测试的结果,所提出的模型在上海科技、JHU-CROWD++和UCF-QNRF数据集上优于现有的最先进方法。
{"title":"DCTNets: Deep crowd transfer networks for an approximate crowd counting","authors":"Arslan Ali ,&nbsp;Weihua Ou ,&nbsp;Saima Kanwal","doi":"10.1016/j.cogr.2022.03.004","DOIUrl":"10.1016/j.cogr.2022.03.004","url":null,"abstract":"<div><p>Due to the numerous real-world applications of the crowd counting job, it has become a popular research topic. Modern crowd counting systems have a sophisticated structure and employ a filter on a big image size, making them difficult to use. Because these technologies are computationally intensive and difficult to implement in small surveillance systems, they are not appropriate for use in small surveillance systems. They also function poorly in a variety of sizes and densities, as well. Transfer learning and deep convolutional neural network architecture are used to create a modest but efficient network, which we describe herein. We named the proposed crowd counting architecture deep crowd transfer network (DCTNets) since it incorporates both deep learning and transfer learning principles into a single system. Among DCTNets’ key components are a detection module that is based on mask R-CNNs and an estimate module that is based on deep convolutional neural networks. In the first step, we apply transfer learning to the Mask R-CNN model using the datasets ShanghaiTech, JHU-CROWD++, and UCF-QNRF. After that, we train and evaluate the complete architecture on these datasets using the transfer learning results. Input images are sent through a Mask R-CNN, which counts individuals and segments the counted region, then through an estimation network, which estimates the population size, and finally through a merge of the outputs from the two models. According to the findings of comparative tests, the proposed model outperforms existing state-of-the-art approaches on the ShanghaiTech, JHU-CROWD++, and UCF-QNRF datasets.</p></div>","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"2 ","pages":"Pages 96-111"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667241322000076/pdfft?md5=9be2d6987eecd7631f37947f00a23f45&pid=1-s2.0-S2667241322000076-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77228331","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A pneumatic conveyor robot for color detection and sorting 用于颜色检测和分拣的气动输送机器人
Pub Date : 2022-01-01 DOI: 10.1016/j.cogr.2022.03.001
Mohammadreza Lalegani Dezaki , Saghi Hatami , Ali Zolfagharian , Mahdi Bodaghi

Despite numerous research works on conveyor robots, few works can be found on electropneumatic conveyor belt robots with two separated lines. The unique feature of this study is a combination of various systems to develop an electropneumatic robot. In this work, an automated and intelligent mechatronic conveyor system is designed and developed for transporting and positioning circular objects that can be used in the manufacturing and packaging industries. In addition to moving and positioning, timing can also be controlled on this conveyor belt robot. All control operations are handled by an electrical and programmable relay called a mini programmable logic controller (PLC), color sensor, gripper arm, and electronic switches. An electropneumatic system is used to control the robot for placing objects. The main goal of this study is to develop a novel 3D structural design which make the procedure unique for better efficiency and accuracy. The novelty of this work lies within the 3D design of two belts and assembly of all electropneumatic components which are helpful for manufacturing assembly lines. Also, TCS230 sensor and AVR microcontroller are used to identify the colors within the operation. The results show the accuracy of the developed system is reliable in terms of color and positioning detection. The system is able to work non-stop for more than 1 hour without any issues.

尽管对输送机器人的研究很多,但对两条分离线的电-气输送带机器人的研究却很少。本研究的独特之处在于将各种系统相结合来开发一种电气动机器人。在这项工作中,设计和开发了一种自动化和智能机电输送系统,用于运输和定位可用于制造和包装行业的圆形物体。除了移动和定位,还可以在这个输送带机器人上控制定时。所有的控制操作都由称为微型可编程逻辑控制器(PLC)的电气和可编程继电器、颜色传感器、抓取臂和电子开关处理。电动气动系统用于控制机器人放置物体。本研究的主要目标是开发一种新颖的三维结构设计,使该程序具有更高的效率和精度。这项工作的新颖之处在于两条皮带的三维设计和所有电气动元件的组装,这有助于制造装配线。此外,TCS230传感器和AVR微控制器用于识别操作内的颜色。结果表明,所开发的系统在颜色和定位检测方面具有可靠的精度。系统可连续工作1小时以上,无任何问题。
{"title":"A pneumatic conveyor robot for color detection and sorting","authors":"Mohammadreza Lalegani Dezaki ,&nbsp;Saghi Hatami ,&nbsp;Ali Zolfagharian ,&nbsp;Mahdi Bodaghi","doi":"10.1016/j.cogr.2022.03.001","DOIUrl":"https://doi.org/10.1016/j.cogr.2022.03.001","url":null,"abstract":"<div><p>Despite numerous research works on conveyor robots, few works can be found on electropneumatic conveyor belt robots with two separated lines. The unique feature of this study is a combination of various systems to develop an electropneumatic robot. In this work, an automated and intelligent mechatronic conveyor system is designed and developed for transporting and positioning circular objects that can be used in the manufacturing and packaging industries. In addition to moving and positioning, timing can also be controlled on this conveyor belt robot. All control operations are handled by an electrical and programmable relay called a mini programmable logic controller (PLC), color sensor, gripper arm, and electronic switches. An electropneumatic system is used to control the robot for placing objects. The main goal of this study is to develop a novel 3D structural design which make the procedure unique for better efficiency and accuracy. The novelty of this work lies within the 3D design of two belts and assembly of all electropneumatic components which are helpful for manufacturing assembly lines. Also, TCS230 sensor and AVR microcontroller are used to identify the colors within the operation. The results show the accuracy of the developed system is reliable in terms of color and positioning detection. The system is able to work non-stop for more than 1 hour without any issues.</p></div>","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"2 ","pages":"Pages 60-72"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667241322000040/pdfft?md5=82b20b2598c2b1b3c8e25f70c6cbff73&pid=1-s2.0-S2667241322000040-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"92004296","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
A sliding mode and non-linear disturbance observer based bilateral control for telerehabilitation systems with flexible manipulators 基于滑模非线性扰动观测器的柔性遥康复系统双边控制
Pub Date : 2022-01-01 DOI: 10.1016/j.cogr.2022.01.002
Yichen Zhong , Yanfeng Pu , Ting Wang

Aiming at achieving high flexibility and safety, telerehabilitation systems and telesurgery systems often use flexible manipulators in the telerehabilitation systems. However, due to the structure of the flexible manipulator, it has strong model uncertainties and nonlinearity in its dynamic model which causes the difficulty of the accurate control. In order to accomplish accurate trajectory tracking of telerehabilitations systems with flexible manipulators, a bilateral controller is introduced on the basis of the sliding mode control strategy and a non-linear disturbance observer. The non-linear disturbance observer is applied to estimate the model uncertainties and external disturbance of both the master and the slave flexible manipulators in the telerehabilitation system. The asymptotic stability is analyzed by the Lyapunov function. Numerical simulations are performed and results show efficiency and effectiveness of our method.

为了实现高灵活性和安全性,远程康复系统和远程外科系统经常在远程康复系统中使用柔性机械手。然而,由于柔性机械臂的结构特点,其动力学模型具有较强的模型不确定性和非线性,给精确控制带来了困难。为了实现柔性机械手远程康复系统的精确轨迹跟踪,在滑模控制策略和非线性扰动观测器的基础上引入了双边控制器。采用非线性扰动观测器对远程康复系统中主从柔性机械臂的模型不确定性和外部扰动进行估计。利用Lyapunov函数分析了系统的渐近稳定性。数值仿真结果表明了该方法的有效性。
{"title":"A sliding mode and non-linear disturbance observer based bilateral control for telerehabilitation systems with flexible manipulators","authors":"Yichen Zhong ,&nbsp;Yanfeng Pu ,&nbsp;Ting Wang","doi":"10.1016/j.cogr.2022.01.002","DOIUrl":"10.1016/j.cogr.2022.01.002","url":null,"abstract":"<div><p>Aiming at achieving high flexibility and safety, telerehabilitation systems and telesurgery systems often use flexible manipulators in the telerehabilitation systems. However, due to the structure of the flexible manipulator, it has strong model uncertainties and nonlinearity in its dynamic model which causes the difficulty of the accurate control. In order to accomplish accurate trajectory tracking of telerehabilitations systems with flexible manipulators, a bilateral controller is introduced on the basis of the sliding mode control strategy and a non-linear disturbance observer. The non-linear disturbance observer is applied to estimate the model uncertainties and external disturbance of both the master and the slave flexible manipulators in the telerehabilitation system. The asymptotic stability is analyzed by the Lyapunov function. Numerical simulations are performed and results show efficiency and effectiveness of our method.</p></div>","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"2 ","pages":"Pages 39-49"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667241322000027/pdfft?md5=b7d9d250b28663087ed65c328e03f908&pid=1-s2.0-S2667241322000027-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90269622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Research and application of UAV-based hyperspectral remote sensing for smart city construction 基于无人机的高光谱遥感在智慧城市建设中的研究与应用
Pub Date : 2022-01-01 DOI: 10.1016/j.cogr.2022.12.002
Boxiong Yang , Shunmin Wang , Shelei Li , Bo Zhou , Fujun Zhao , Faizan Ali , Hui He

Hyperspectral remote sensing has been an important technical means to obtain more refined information and provide rich, accurate, and reasonable data for the quantitative analysis and delicacy management of a "smart city". To better understand and use the hyperspectral data to help the construction of a digital city, the study of the feature and characteristics of hyperspectral remote sensing images is introduced in this paper. Then how to collect the hyperspectral information of urban ground objects through the unmanned aerial vehicle (UAV) and hyperspectral imager was described, which greatly improves the efficiency of urban data acquisition. Finally, various application cases of UAV-based hyperspectral remote sensing and deep information mining of urban ground objects were analyzed and discussed in detail, such as terrain classification, urban greening analysis, etc. The research result shows that airborne hyperspectral imagery (HIS) has unique advantages over color photography and multispectral remote sensing, with a richer and higher level of spectral details and physical & chemical properties.

高光谱遥感已成为获取更精细信息的重要技术手段,为“智慧城市”的定量分析和精细化管理提供丰富、准确、合理的数据。为了更好地理解和利用高光谱数据,帮助数字城市的建设,本文介绍了高光谱遥感图像的特征和特点的研究。然后介绍了如何利用无人机和高光谱成像仪采集城市地物的高光谱信息,极大地提高了城市数据采集的效率。最后,对基于无人机的高光谱遥感和城市地物深度信息挖掘在地形分类、城市绿化分析等方面的各种应用案例进行了详细的分析和讨论。研究结果表明,相对于彩色摄影和多光谱遥感,机载高光谱成像具有更丰富、更高层次的光谱细节和物理特征等独特优势。化学性质。
{"title":"Research and application of UAV-based hyperspectral remote sensing for smart city construction","authors":"Boxiong Yang ,&nbsp;Shunmin Wang ,&nbsp;Shelei Li ,&nbsp;Bo Zhou ,&nbsp;Fujun Zhao ,&nbsp;Faizan Ali ,&nbsp;Hui He","doi":"10.1016/j.cogr.2022.12.002","DOIUrl":"10.1016/j.cogr.2022.12.002","url":null,"abstract":"<div><p>Hyperspectral remote sensing has been an important technical means to obtain more refined information and provide rich, accurate, and reasonable data for the quantitative analysis and delicacy management of a \"smart city\". To better understand and use the hyperspectral data to help the construction of a digital city, the study of the feature and characteristics of hyperspectral remote sensing images is introduced in this paper. Then how to collect the hyperspectral information of urban ground objects through the unmanned aerial vehicle (UAV) and hyperspectral imager was described, which greatly improves the efficiency of urban data acquisition. Finally, various application cases of UAV-based hyperspectral remote sensing and deep information mining of urban ground objects were analyzed and discussed in detail, such as terrain classification, urban greening analysis, etc. The research result shows that airborne hyperspectral imagery (HIS) has unique advantages over color photography and multispectral remote sensing, with a richer and higher level of spectral details and physical &amp; chemical properties.</p></div>","PeriodicalId":100288,"journal":{"name":"Cognitive Robotics","volume":"2 ","pages":"Pages 255-266"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667241322000234/pdfft?md5=c9c10c3ec3160d3471e685148c043c95&pid=1-s2.0-S2667241322000234-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74497174","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Cognitive Robotics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1