首页 > 最新文献

Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)最新文献

英文 中文
EASEEbot: A Robotic Envelope Assessment for Energy Efficiency EASEEbot:能源效率的机器人外壳评估
Guanbo Chen, Beyza Kiper, Xuchu Xu, B. Sher, S. Ergan, Chen Feng
—Building envelope inspections are necessary to maintain buildings’ energy efficiency, but current solutions are expensive, time-consuming, and destructive. Furthermore, inspectors often face safety and accessibility issues. To mitigate these issues, we propose a holistic system, EASEEbot, consisting of robots to capture data and help retrofit and employ artificial intelligence to assist in data analysis. The robots including an unmanned aerial system (UAS) and ground-penetrating radar (GPR) accommodate data collection while the Robo- dog offers guidance to inspectors in retrofitting phase. The machine learning algorithm helps to analyze the captured data, identifies envelope issues, and generates a building’s digital twin to map identified defects spatially to buildings’ fac¸ades. The retrofit Robo-Dog uses the generated digital twin to project previously recorded defect imagery onto corresponding areas of the building’s envelope. It further guides workers to ensure the identified defective areas are addressed. EASEEbot offers non- destructive sensing, risk mitigation, and high-quality building envelope inspections.
-建筑围护结构检查对于保持建筑的能源效率是必要的,但目前的解决方案既昂贵又耗时,而且具有破坏性。此外,检查员经常面临安全和无障碍问题。为了缓解这些问题,我们提出了一个整体系统,EASEEbot,由机器人组成,用于捕获数据,帮助改造和使用人工智能来协助数据分析。这些机器人包括一个无人机系统(UAS)和探地雷达(GPR),用于数据收集,而机器狗在改装阶段为检查员提供指导。机器学习算法有助于分析捕获的数据,识别围护结构问题,并生成建筑物的数字孪生体,以将已识别的缺陷在空间上映射到建筑物的表面。改造后的机器狗使用生成的数字孪生体将先前记录的缺陷图像投影到建筑物围护结构的相应区域。它进一步指导工人确保已确定的缺陷区域得到解决。EASEEbot提供非破坏性传感,风险缓解,和高质量的建筑围护结构检查。
{"title":"EASEEbot: A Robotic Envelope Assessment for Energy Efficiency","authors":"Guanbo Chen, Beyza Kiper, Xuchu Xu, B. Sher, S. Ergan, Chen Feng","doi":"10.22260/icra2022/0012","DOIUrl":"https://doi.org/10.22260/icra2022/0012","url":null,"abstract":"—Building envelope inspections are necessary to maintain buildings’ energy efficiency, but current solutions are expensive, time-consuming, and destructive. Furthermore, inspectors often face safety and accessibility issues. To mitigate these issues, we propose a holistic system, EASEEbot, consisting of robots to capture data and help retrofit and employ artificial intelligence to assist in data analysis. The robots including an unmanned aerial system (UAS) and ground-penetrating radar (GPR) accommodate data collection while the Robo- dog offers guidance to inspectors in retrofitting phase. The machine learning algorithm helps to analyze the captured data, identifies envelope issues, and generates a building’s digital twin to map identified defects spatially to buildings’ fac¸ades. The retrofit Robo-Dog uses the generated digital twin to project previously recorded defect imagery onto corresponding areas of the building’s envelope. It further guides workers to ensure the identified defective areas are addressed. EASEEbot offers non- destructive sensing, risk mitigation, and high-quality building envelope inspections.","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127435357","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
TeleLayering: Teleoperated Construction 3D Printing Using Multimodal Feedback for Extraterrestrial and Terrestrial Construction TeleLayering:远程操作的建筑3D打印使用多模式反馈地外和地面建设
A. Kazemian, H. Gilbert, Yimin Zhu, M. Fiske, N. Alexandrov
 Abstract - In this paper, we propose a teleoperated construction 3D printing technology, called TeleLayering, for planetary and terrestrial applications. The TeleLayering technology is enabled by effective multimodal control and monitoring systems and enhanced construction 3D printing robots to build or repair a variety of structures in extreme environments without the need for human presence on the jobsite. This paper presents a general description, main technical requirements, implementation challenges, and applications of this technology.
摘要:在本文中,我们提出了一种用于行星和地球应用的远程操作建筑3D打印技术,称为TeleLayering。TeleLayering技术通过有效的多模式控制和监控系统以及增强型建筑3D打印机器人实现,无需人工在场即可在极端环境中建造或修复各种结构。本文介绍了该技术的总体描述、主要技术要求、实现挑战和应用。
{"title":"TeleLayering: Teleoperated Construction 3D Printing Using Multimodal Feedback for Extraterrestrial and Terrestrial Construction","authors":"A. Kazemian, H. Gilbert, Yimin Zhu, M. Fiske, N. Alexandrov","doi":"10.22260/icra2022/0006","DOIUrl":"https://doi.org/10.22260/icra2022/0006","url":null,"abstract":" Abstract - In this paper, we propose a teleoperated construction 3D printing technology, called TeleLayering, for planetary and terrestrial applications. The TeleLayering technology is enabled by effective multimodal control and monitoring systems and enhanced construction 3D printing robots to build or repair a variety of structures in extreme environments without the need for human presence on the jobsite. This paper presents a general description, main technical requirements, implementation challenges, and applications of this technology.","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133078746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Upper extremity exoskeletons in construction, a field-based study 上肢外骨骼在构建中,实地研究
Sean T. Bennett, P. Adamczyk, Fei Dai, D. Veeramani, Michael F. Wehner, Zhenhua Zhu
1 Abstract — The construction trade requires repetitive, physically demanding manual tasks which can over time pose severe risks for work-related musculoskeletal disorders (WMSDs) [1]. Exoskeletons and exosuits (collectively called “EXOs” in this work) have substantial potential to protect workers and to increase worker productivity by reducing exertion and fatigue. Despite these potential benefits, EXOs are uncommon in the construction industry. We present preliminary results from a pilot study investigating the knowledge gaps and barriers to EXO adoption. The overall objective of this work is to establish a foundational understanding of how EXOs can transform the future of construction trade work. The described work focuses on industry collaboration and field-based kinematic evaluation of three subjects performing a real-world construction task, removing wooden blocks from a steel-frame wall. We demonstrate the range of motion of the upper extremities of the subjects performing the task unassisted, followed by performing the task wearing two upper-extremity EXOs. This work is a presented in parallel with our separate study (evaluating the effects of a lower back EXO while dumping a gondola of refuse) also presented at this workshop. Our preliminary findings build a foundation of understanding of EXO-enabled construction tasks. This will foster EXO adoption and yield benefits including but not limited to improving the productivity of construction trades, reducing the risks of WMSDs and injuries of trade workers, broadening the workforce participation in construction trades, and extending the career life expectancy of existing trade workers.
摘要-建筑行业需要重复性的体力劳动,随着时间的推移,可能会对与工作相关的肌肉骨骼疾病(WMSDs)造成严重的风险[1]。外骨骼和外骨骼服(在本工作中统称为“exo”)具有保护工人和通过减少劳累和疲劳来提高工人生产率的巨大潜力。尽管有这些潜在的好处,exo在建筑行业并不常见。我们介绍了一项试点研究的初步结果,该研究调查了采用EXO的知识差距和障碍。这项工作的总体目标是建立对exo如何改变未来建筑行业工作的基本理解。所描述的工作侧重于行业协作和基于现场的运动学评估,三个主体执行现实世界的建筑任务,从钢框架墙上拆除木块。我们展示了受试者上肢的运动范围,他们在没有辅助的情况下执行任务,然后穿着两个上肢exo执行任务。这项工作与我们在本次研讨会上提出的另一项研究(在倾倒一贡多拉垃圾时评估下背部EXO的影响)同时提出。我们的初步发现为理解exo启用的施工任务奠定了基础。这将促进EXO的采用,并带来好处,包括但不限于提高建筑行业的生产力,减少WMSDs和贸易工人受伤的风险,扩大建筑行业的劳动力参与,以及延长现有贸易工人的职业预期寿命。
{"title":"Upper extremity exoskeletons in construction, a field-based study","authors":"Sean T. Bennett, P. Adamczyk, Fei Dai, D. Veeramani, Michael F. Wehner, Zhenhua Zhu","doi":"10.22260/icra2022/0007","DOIUrl":"https://doi.org/10.22260/icra2022/0007","url":null,"abstract":"1 Abstract — The construction trade requires repetitive, physically demanding manual tasks which can over time pose severe risks for work-related musculoskeletal disorders (WMSDs) [1]. Exoskeletons and exosuits (collectively called “EXOs” in this work) have substantial potential to protect workers and to increase worker productivity by reducing exertion and fatigue. Despite these potential benefits, EXOs are uncommon in the construction industry. We present preliminary results from a pilot study investigating the knowledge gaps and barriers to EXO adoption. The overall objective of this work is to establish a foundational understanding of how EXOs can transform the future of construction trade work. The described work focuses on industry collaboration and field-based kinematic evaluation of three subjects performing a real-world construction task, removing wooden blocks from a steel-frame wall. We demonstrate the range of motion of the upper extremities of the subjects performing the task unassisted, followed by performing the task wearing two upper-extremity EXOs. This work is a presented in parallel with our separate study (evaluating the effects of a lower back EXO while dumping a gondola of refuse) also presented at this workshop. Our preliminary findings build a foundation of understanding of EXO-enabled construction tasks. This will foster EXO adoption and yield benefits including but not limited to improving the productivity of construction trades, reducing the risks of WMSDs and injuries of trade workers, broadening the workforce participation in construction trades, and extending the career life expectancy of existing trade workers.","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117000689","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The effect of challenging work environment on human-robot interaction and cognitive load during teleoperation: a case study of teleoperated excavator in a virtual experiment 挑战性工作环境对遥操作人机交互和认知负荷的影响——以遥操作挖掘机为例
Jin Sol Lee, Youngjib Ham
— Construction sites typically involve a risky, dynamic, and challenging work environment. Despite numerous safety training programs and regulations, accidents still occur in construction sites, especially when working with construction robotics. To alleviate this problem in the most fundamental way, teleoperation that allows operators to work remotely has been studied. Teleoperated construction robots have the great potential to be used in various contexts for extreme and hazardous construction sites. Here, work conditions for human-robot interaction in construction differ from those in other structured and controlled environments like manufacturing factories, and thus there is a need for the associated studies. In this paper, we aim to measure and analyze the performance of human-robot interaction and the cognitive load of human operators in dynamic and challenging construction work environments (hazardous risks such as underground utility strikes and working under time constraints).
-建筑工地通常涉及一个危险、动态和具有挑战性的工作环境。尽管有许多安全培训计划和法规,但事故仍然发生在建筑工地,特别是在使用建筑机器人时。为了从根本上缓解这一问题,人们研究了允许操作员远程工作的远程操作。遥控建筑机器人在极端和危险的建筑工地的各种情况下具有巨大的潜力。在这里,建筑中人机交互的工作条件不同于制造工厂等其他结构化和受控环境,因此需要进行相关研究。在本文中,我们旨在测量和分析动态和具有挑战性的建筑工作环境(危险风险,如地下公用事业罢工和在时间限制下工作)中人机交互的性能和人类操作员的认知负荷。
{"title":"The effect of challenging work environment on human-robot interaction and cognitive load during teleoperation: a case study of teleoperated excavator in a virtual experiment","authors":"Jin Sol Lee, Youngjib Ham","doi":"10.22260/icra2022/0017","DOIUrl":"https://doi.org/10.22260/icra2022/0017","url":null,"abstract":"— Construction sites typically involve a risky, dynamic, and challenging work environment. Despite numerous safety training programs and regulations, accidents still occur in construction sites, especially when working with construction robotics. To alleviate this problem in the most fundamental way, teleoperation that allows operators to work remotely has been studied. Teleoperated construction robots have the great potential to be used in various contexts for extreme and hazardous construction sites. Here, work conditions for human-robot interaction in construction differ from those in other structured and controlled environments like manufacturing factories, and thus there is a need for the associated studies. In this paper, we aim to measure and analyze the performance of human-robot interaction and the cognitive load of human operators in dynamic and challenging construction work environments (hazardous risks such as underground utility strikes and working under time constraints).","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132072407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards the autonomous underwater construction of cement block structures with free-floating robots 基于自由漂浮机器人的水泥砌块结构水下自主施工研究
Samuel Lensgraf, A. Sniffen, Alberto Quattrini Li, Devin J. Balkcom
—This paper presents StoneClaw, our custom- made free-floating autonomous underwater vehicle that plans for an efficient use of two complementary energy sources (battery and compressed air) and exploits self-correcting features on our designed manipulator, for con- structing structures with interlocking cement blocks.
本文介绍了我们定制的自由漂浮自主水下航行器StoneClaw,它计划有效地利用两种互补的能源(电池和压缩空气),并利用我们设计的操纵器的自我校正功能,用于构建具有互锁水泥块的结构。
{"title":"Towards the autonomous underwater construction of cement block structures with free-floating robots","authors":"Samuel Lensgraf, A. Sniffen, Alberto Quattrini Li, Devin J. Balkcom","doi":"10.22260/icra2022/0005","DOIUrl":"https://doi.org/10.22260/icra2022/0005","url":null,"abstract":"—This paper presents StoneClaw, our custom- made free-floating autonomous underwater vehicle that plans for an efficient use of two complementary energy sources (battery and compressed air) and exploits self-correcting features on our designed manipulator, for con- structing structures with interlocking cement blocks.","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121298559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Vision-based Automated Flagging System in Construction 建筑中基于视觉的自动标记系统
Wei Han, Zhenhua Zhu
— Flaggers are a high-risk profession. They are always required to work closely with the open traffic lanes. Any distracted, speeding or intoxicated drivers might hit them, leading to their injuries and fatalities. From 1980 to 1992, a total of 54 fatalities involving flaggers in the construction industry have been reported. To protect flaggers and reduce their exposure to potential vehicular traffic, previous studies proposed and implemented the Automated Flagger Assistance Devices (AFADs). However, the AFADs have not been widely used in practice due to their costs. In addition to hiring a flagger to remotely operate an AFAD, the cost of an AFAD system alone ranges from $25,000 to $30,000 without the consideration of device maintenance. Instead of creating an assistance device, this paper proposed an automated flagging system (AFS) that can guide the traffic without the need for a flagger available on the site. The proposed system is composed of two modules: information capturing and decision-making. The information module is to monitor traffic conditions and retrieves useful information for the decision-making module to decide which sign (STOP or SLOW) to display in the LED panel. So far, a prototype was developed and tested in a laboratory environment. A vehicle detector was trained and integrated into the prototype. The laboratory test results indicated that the prototype could correctly show the STOP or SLOW sign based on the detection of simulated traffics.
-旗手是一个高风险的职业。他们总是被要求与开放的车道密切配合。任何分心、超速或醉酒的司机都可能撞到他们,导致他们受伤甚至死亡。从1980年至1992年,据报建筑业共有54起涉及旗帜的死亡事件。为了保护旗子并减少其暴露于潜在车辆的风险,以前的研究建议并实施了自动旗子辅助装置(AFADs)。然而,由于其成本问题,afad尚未在实践中得到广泛应用。除了聘请一名操作员远程操作AFAD外,不考虑设备维护,单是AFAD系统的成本就在25,000美元到30,000美元之间。本文提出了一种自动标记系统(AFS),而不是创建辅助设备,该系统可以在不需要现场可用的标记的情况下引导交通。该系统由信息获取和决策两个模块组成。信息模块用于监控交通状况,并为决策模块检索有用的信息,以决定在LED面板上显示哪个标志(STOP或SLOW)。到目前为止,一个原型已经在实验室环境中开发和测试。一个车辆探测器被训练并集成到原型中。实验室测试结果表明,该原型可以根据模拟交通的检测正确显示STOP或SLOW标志。
{"title":"Vision-based Automated Flagging System in Construction","authors":"Wei Han, Zhenhua Zhu","doi":"10.22260/icra2022/0004","DOIUrl":"https://doi.org/10.22260/icra2022/0004","url":null,"abstract":"— Flaggers are a high-risk profession. They are always required to work closely with the open traffic lanes. Any distracted, speeding or intoxicated drivers might hit them, leading to their injuries and fatalities. From 1980 to 1992, a total of 54 fatalities involving flaggers in the construction industry have been reported. To protect flaggers and reduce their exposure to potential vehicular traffic, previous studies proposed and implemented the Automated Flagger Assistance Devices (AFADs). However, the AFADs have not been widely used in practice due to their costs. In addition to hiring a flagger to remotely operate an AFAD, the cost of an AFAD system alone ranges from $25,000 to $30,000 without the consideration of device maintenance. Instead of creating an assistance device, this paper proposed an automated flagging system (AFS) that can guide the traffic without the need for a flagger available on the site. The proposed system is composed of two modules: information capturing and decision-making. The information module is to monitor traffic conditions and retrieves useful information for the decision-making module to decide which sign (STOP or SLOW) to display in the LED panel. So far, a prototype was developed and tested in a laboratory environment. A vehicle detector was trained and integrated into the prototype. The laboratory test results indicated that the prototype could correctly show the STOP or SLOW sign based on the detection of simulated traffics.","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134077133","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Reinforcement Learning-based Construction Robots Collaboration for Sequential Tasks 基于深度强化学习的施工机器人协同顺序任务
Lei Huang, Zhengbo Zou
—The integration of robots into the construction in- dustry shows promise in addressing challenges such as stagnant productivity and low efficiency. Recently, an increasing amount of research develops construction robots based on reinforcement learning (RL). However, most existing RL-based construction robots are trained to conduct specific tasks individually without cooperation. This paper proposes an approach that utilizes two RL-based construction robots (an unmanned ground vehicle and a robot arm) to collaboratively finish the task of window panel transport and installation in sequence without human intervention. Our experiment results show that the two con- struction robots can successfully collaborate to finish all tasks in an end-to-end manner after they are trained separately with a success rate of 79.6%.
-将机器人集成到建筑工业中,有望解决生产力停滞和效率低下等挑战。近年来,基于强化学习(RL)的建筑机器人的研究越来越多。然而,大多数现有的基于强化学习的建筑机器人都被训练成在没有合作的情况下单独执行特定任务。本文提出了一种利用两个基于rl的施工机器人(无人地面车辆和机械臂)协同完成窗板运输和安装任务的方法,无需人工干预。我们的实验结果表明,两个建筑机器人分别训练后,可以成功地以端到端方式协作完成所有任务,成功率为79.6%。
{"title":"Deep Reinforcement Learning-based Construction Robots Collaboration for Sequential Tasks","authors":"Lei Huang, Zhengbo Zou","doi":"10.22260/icra2022/0015","DOIUrl":"https://doi.org/10.22260/icra2022/0015","url":null,"abstract":"—The integration of robots into the construction in- dustry shows promise in addressing challenges such as stagnant productivity and low efficiency. Recently, an increasing amount of research develops construction robots based on reinforcement learning (RL). However, most existing RL-based construction robots are trained to conduct specific tasks individually without cooperation. This paper proposes an approach that utilizes two RL-based construction robots (an unmanned ground vehicle and a robot arm) to collaboratively finish the task of window panel transport and installation in sequence without human intervention. Our experiment results show that the two con- struction robots can successfully collaborate to finish all tasks in an end-to-end manner after they are trained separately with a success rate of 79.6%.","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126075338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Accurate matching between BIM-rendered and real-world images bim渲染和真实世界图像之间的精确匹配
Houhao Liang, Justin K.W.Yeoh
—As the digital representation of the built environ- ment, BIM has been used to assist robot localization. Real-world images captured by the robot camera can be compared with BIM-rendered images to estimate the pose. However, there is a perception gap between the BIM environment and reality; image styles are typically too different to be matched. Hence, this study investigates an advanced image feature detection technique, D2-Net, to identify key points and descriptors on BIM-rendered and real-world images. These key features are further matched via K Nearest Neighbor Search and RANSAC. The ability to bridge the perception gap can be evaluated by the image matching performance, which is the Euclidean distance between the projected key points and the number of inliers. SIFT, as the traditional feature detection technique, was compared in this study. Results show that the average projection error of D2-Net is only 16.55 pixels, while the error of SIFT is 187.46 pixels. It demonstrates that the advanced D2-Net can be utilized to detect representative features on BIM-rendered and real-world images. The matched image pairs can be further utilized to estimate the robot pose in BIM. Overall, it aims to enhance the BIM-assisted localization and improve the robot’s reliability as a decision-making tool on-site.
-作为建筑环境的数字表示,BIM已被用于协助机器人定位。机器人相机拍摄的真实世界图像可以与bim渲染的图像进行比较,以估计姿态。然而,BIM环境与现实之间存在认知差距;图像样式通常差异太大,无法匹配。因此,本研究研究了一种先进的图像特征检测技术,D2-Net,以识别bim渲染和真实图像的关键点和描述符。通过K近邻搜索和RANSAC进一步匹配这些关键特征。弥合感知差距的能力可以通过图像匹配性能来评估,图像匹配性能是投影关键点与内层数之间的欧几里得距离。本文对传统的SIFT特征检测技术进行了比较。结果表明,D2-Net的平均投影误差仅为16.55像素,而SIFT的平均投影误差为187.46像素。这表明,先进的D2-Net可以用来检测bim渲染和真实世界的图像上的代表性特征。匹配的图像对可以进一步用于BIM中机器人姿态的估计。总体而言,它旨在增强bim辅助定位,提高机器人作为现场决策工具的可靠性。
{"title":"Accurate matching between BIM-rendered and real-world images","authors":"Houhao Liang, Justin K.W.Yeoh","doi":"10.22260/icra2022/0009","DOIUrl":"https://doi.org/10.22260/icra2022/0009","url":null,"abstract":"—As the digital representation of the built environ- ment, BIM has been used to assist robot localization. Real-world images captured by the robot camera can be compared with BIM-rendered images to estimate the pose. However, there is a perception gap between the BIM environment and reality; image styles are typically too different to be matched. Hence, this study investigates an advanced image feature detection technique, D2-Net, to identify key points and descriptors on BIM-rendered and real-world images. These key features are further matched via K Nearest Neighbor Search and RANSAC. The ability to bridge the perception gap can be evaluated by the image matching performance, which is the Euclidean distance between the projected key points and the number of inliers. SIFT, as the traditional feature detection technique, was compared in this study. Results show that the average projection error of D2-Net is only 16.55 pixels, while the error of SIFT is 187.46 pixels. It demonstrates that the advanced D2-Net can be utilized to detect representative features on BIM-rendered and real-world images. The matched image pairs can be further utilized to estimate the robot pose in BIM. Overall, it aims to enhance the BIM-assisted localization and improve the robot’s reliability as a decision-making tool on-site.","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116736826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Computational Framework For Robotic Quality Assessment and Management In Construction 施工机器人质量评估与管理的计算框架
Jingyang Liu, Yumeng Zhuang, Joshua Bard
—As an integrated process in construction projects, quality assessment and management (QA&M) can be important to prevent failures during construction. The existing QA&M practice such as the evaluation of the geometric tolerance and surface qualities is mostly performed manually which can be labor-intensive and tedious. This study proposes a computational framework for a robot to perform automatic QA&M in unknown environments. The framework is composed of three parts: (1) motion planning; (2) defect detection; and (3) defect registration. The motion planning component generates efficient robotic path for autonomous exploration and surface inspection. The defect detection component quantifies surface anomalies within a user-defined area of interests through multiple sensor measurements. The defect registration component localizes the detected defects and registers the defects to a site model. To demonstrate the feasibility of the proposed framework, we present a user case for assessing geometric tolerance and surface quality of a 1500 mm (L) x 745 mm (W) x 1980 mm interior wall mockup. The result of the case study shows that the proposed framework has the potential to provide reliable geometric measurement and defect detection for gypsum wall panels in a lab environment.
-作为建设项目的一个综合过程,质量评估和管理(QA&M)对于防止施工过程中的故障是非常重要的。现有的质量保证与管理实践,如几何公差和表面质量的评定,大多是手工进行的,这是一种劳动密集型和繁琐的工作。本研究提出了一个机器人在未知环境中执行自动QA&M的计算框架。该框架由三部分组成:(1)运动规划;(2)缺陷检测;(3)缺陷登记。运动规划组件生成有效的机器人路径,用于自主探测和表面检测。缺陷检测组件通过多个传感器测量来量化用户定义的感兴趣区域内的表面异常。缺陷注册组件将检测到的缺陷定位,并将缺陷注册到站点模型。为了证明所提出框架的可行性,我们提出了一个用户案例,用于评估1500毫米(长)x 745毫米(宽)x 1980毫米内墙模型的几何公差和表面质量。案例研究结果表明,所提出的框架具有在实验室环境中为石膏墙板提供可靠的几何测量和缺陷检测的潜力。
{"title":"A Computational Framework For Robotic Quality Assessment and Management In Construction","authors":"Jingyang Liu, Yumeng Zhuang, Joshua Bard","doi":"10.22260/icra2022/0011","DOIUrl":"https://doi.org/10.22260/icra2022/0011","url":null,"abstract":"—As an integrated process in construction projects, quality assessment and management (QA&M) can be important to prevent failures during construction. The existing QA&M practice such as the evaluation of the geometric tolerance and surface qualities is mostly performed manually which can be labor-intensive and tedious. This study proposes a computational framework for a robot to perform automatic QA&M in unknown environments. The framework is composed of three parts: (1) motion planning; (2) defect detection; and (3) defect registration. The motion planning component generates efficient robotic path for autonomous exploration and surface inspection. The defect detection component quantifies surface anomalies within a user-defined area of interests through multiple sensor measurements. The defect registration component localizes the detected defects and registers the defects to a site model. To demonstrate the feasibility of the proposed framework, we present a user case for assessing geometric tolerance and surface quality of a 1500 mm (L) x 745 mm (W) x 1980 mm interior wall mockup. The result of the case study shows that the proposed framework has the potential to provide reliable geometric measurement and defect detection for gypsum wall panels in a lab environment.","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"601 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123042352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards a Collaborative Future in Construction Robotics: A Human-centered Study in a Multi-user Immersive Operation and Communication System for Excavation 面向建筑机器人的协同未来:以人为中心的多用户沉浸式挖掘操作与通信系统研究
Di Liu, Youngjib Ham, Jeonghee Kim, Hangue Park
— When operating a construction robot, i.e., an excavator, the excavator operator’s unsafe behavior directly affects the underground utility damage occurrence during excavation process. Operator’s behavior is greatly affected by the environment and further the communication with other coworkers, i.e., spotter. In this paper, we propose a multi-user immersive operation and communication system for excavation. Further, we investigate how the different types of environments and operator-spotter communication channels affect operator’s attention demand and performance during excavation.
-在操作施工机器人即挖掘机时,挖掘机操作人员的不安全行为直接影响到挖掘过程中地下公用设施的损坏情况。操作员的行为很大程度上受环境和与其他同事(即观察员)的沟通的影响。本文提出了一种多用户沉浸式挖掘操作与通信系统。此外,我们研究了不同类型的环境和操作员-观察者通信渠道如何影响操作员在挖掘过程中的注意力需求和表现。
{"title":"Towards a Collaborative Future in Construction Robotics: A Human-centered Study in a Multi-user Immersive Operation and Communication System for Excavation","authors":"Di Liu, Youngjib Ham, Jeonghee Kim, Hangue Park","doi":"10.22260/icra2022/0016","DOIUrl":"https://doi.org/10.22260/icra2022/0016","url":null,"abstract":"— When operating a construction robot, i.e., an excavator, the excavator operator’s unsafe behavior directly affects the underground utility damage occurrence during excavation process. Operator’s behavior is greatly affected by the environment and further the communication with other coworkers, i.e., spotter. In this paper, we propose a multi-user immersive operation and communication system for excavation. Further, we investigate how the different types of environments and operator-spotter communication channels affect operator’s attention demand and performance during excavation.","PeriodicalId":179995,"journal":{"name":"Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)","volume":"74 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133952016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1