基于大语言模型的代码生成,用于控制建筑装配机器人:分层生成方法

IF 6.2 2区 工程技术 Q1 CONSTRUCTION & BUILDING TECHNOLOGY Developments in the Built Environment Pub Date : 2024-06-20 DOI:10.1016/j.dibe.2024.100488
Hanbin Luo , Jianxin Wu , Jiajing Liu , Maxwell Fordjour Antwi-Afari
{"title":"基于大语言模型的代码生成,用于控制建筑装配机器人:分层生成方法","authors":"Hanbin Luo ,&nbsp;Jianxin Wu ,&nbsp;Jiajing Liu ,&nbsp;Maxwell Fordjour Antwi-Afari","doi":"10.1016/j.dibe.2024.100488","DOIUrl":null,"url":null,"abstract":"<div><p>Offline programming (OLP) is a mainstream approach for controlling assembly robots at construction sites. However, existing methods are tailored to specific assembly tasks and workflows, and thus lack flexibility. Additionally, the emerging large language model (LLM)-based OLP cannot effectively handle the code logic of robot programming. Thus, this paper addresses the question: <em>How can robot control programs be generated effectively and accurately for diverse construction assembly tasks using LLM techniques?</em> This paper describes a closed user-on-the-loop control framework for construction assembly robots based on LLM techniques. A hierarchical strategy to generate robot control programs is proposed to logically integrate code generation at high and low levels. Additionally, customized application programming interfaces and a chain of action are combined to enhance the LLM's understanding of assembly action logic. An assembly task set was designed to evaluate the feasibility and reliability of the proposed approach. The results show that the proposed approach (1) is widely applicable to diverse assembly tasks, and (2) can improve the quality of the generated code by decreasing the number of errors. Our approach facilitates the automation of construction assembly tasks by simplifying the robot control process.</p></div>","PeriodicalId":34137,"journal":{"name":"Developments in the Built Environment","volume":"19 ","pages":"Article 100488"},"PeriodicalIF":6.2000,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666165924001698/pdfft?md5=4c5bb6230dbce18398eb68e7ab22159c&pid=1-s2.0-S2666165924001698-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Large language model-based code generation for the control of construction assembly robots: A hierarchical generation approach\",\"authors\":\"Hanbin Luo ,&nbsp;Jianxin Wu ,&nbsp;Jiajing Liu ,&nbsp;Maxwell Fordjour Antwi-Afari\",\"doi\":\"10.1016/j.dibe.2024.100488\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Offline programming (OLP) is a mainstream approach for controlling assembly robots at construction sites. However, existing methods are tailored to specific assembly tasks and workflows, and thus lack flexibility. Additionally, the emerging large language model (LLM)-based OLP cannot effectively handle the code logic of robot programming. Thus, this paper addresses the question: <em>How can robot control programs be generated effectively and accurately for diverse construction assembly tasks using LLM techniques?</em> This paper describes a closed user-on-the-loop control framework for construction assembly robots based on LLM techniques. A hierarchical strategy to generate robot control programs is proposed to logically integrate code generation at high and low levels. Additionally, customized application programming interfaces and a chain of action are combined to enhance the LLM's understanding of assembly action logic. An assembly task set was designed to evaluate the feasibility and reliability of the proposed approach. The results show that the proposed approach (1) is widely applicable to diverse assembly tasks, and (2) can improve the quality of the generated code by decreasing the number of errors. Our approach facilitates the automation of construction assembly tasks by simplifying the robot control process.</p></div>\",\"PeriodicalId\":34137,\"journal\":{\"name\":\"Developments in the Built Environment\",\"volume\":\"19 \",\"pages\":\"Article 100488\"},\"PeriodicalIF\":6.2000,\"publicationDate\":\"2024-06-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2666165924001698/pdfft?md5=4c5bb6230dbce18398eb68e7ab22159c&pid=1-s2.0-S2666165924001698-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Developments in the Built Environment\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666165924001698\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Developments in the Built Environment","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666165924001698","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

离线编程(OLP)是建筑工地控制装配机器人的主流方法。然而,现有的方法都是针对特定的装配任务和工作流程量身定制的,因此缺乏灵活性。此外,新兴的基于大型语言模型(LLM)的离线编程无法有效处理机器人编程的代码逻辑。因此,本文探讨了这一问题:如何利用 LLM 技术有效、准确地生成机器人控制程序,以完成各种建筑装配任务?本文介绍了基于 LLM 技术的建筑装配机器人闭环用户控制框架。本文提出了一种生成机器人控制程序的分层策略,在逻辑上整合了高层和低层的代码生成。此外,定制的应用编程接口和动作链相结合,增强了 LLM 对装配动作逻辑的理解。为评估所建议方法的可行性和可靠性,设计了一个装配任务集。结果表明,建议的方法(1)广泛适用于各种装配任务,(2)可以通过减少错误数量来提高生成代码的质量。我们的方法简化了机器人控制过程,从而促进了建筑装配任务的自动化。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Large language model-based code generation for the control of construction assembly robots: A hierarchical generation approach

Offline programming (OLP) is a mainstream approach for controlling assembly robots at construction sites. However, existing methods are tailored to specific assembly tasks and workflows, and thus lack flexibility. Additionally, the emerging large language model (LLM)-based OLP cannot effectively handle the code logic of robot programming. Thus, this paper addresses the question: How can robot control programs be generated effectively and accurately for diverse construction assembly tasks using LLM techniques? This paper describes a closed user-on-the-loop control framework for construction assembly robots based on LLM techniques. A hierarchical strategy to generate robot control programs is proposed to logically integrate code generation at high and low levels. Additionally, customized application programming interfaces and a chain of action are combined to enhance the LLM's understanding of assembly action logic. An assembly task set was designed to evaluate the feasibility and reliability of the proposed approach. The results show that the proposed approach (1) is widely applicable to diverse assembly tasks, and (2) can improve the quality of the generated code by decreasing the number of errors. Our approach facilitates the automation of construction assembly tasks by simplifying the robot control process.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.40
自引率
1.20%
发文量
31
审稿时长
22 days
期刊介绍: Developments in the Built Environment (DIBE) is a recently established peer-reviewed gold open access journal, ensuring that all accepted articles are permanently and freely accessible. Focused on civil engineering and the built environment, DIBE publishes original papers and short communications. Encompassing topics such as construction materials and building sustainability, the journal adopts a holistic approach with the aim of benefiting the community.
期刊最新文献
Study on the pore structure of eco-regenerated mortar using corn cob based on nuclear magnetic resonance Innovative design and sensing performance of a novel large-strain sensor for prestressed FRP plates Effects of superabsorbent polymer and natural zeolite on shrinkage, mechanical properties, and porosity in ultra-high performance concretes Explainable machine learning model for load-deformation correlation in long-span suspension bridges using XGBoost-SHAP Extending Information Delivery Specifications for digital building permit requirements
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1