This study proposes a multimodal deep learning model for high-precision automated detection of resistance spot welding defects. A dual-input weight-sharing network is employed to process the surface images of the weld nugget, while infrared images and welding parameter data are processed by two additional base models. The outputs of these base models are fused using Dempster–Shafer theory, yielding the ensemble multimodal deep learning model (EMMDL). Validation on a welding dataset reveals that: (1) EMMDL achieves an accuracy of 91.6 %, significantly outperforming base models with single modality; (2) Dual-input and weight sharing increases classification accuracy by 7.87 % and enhances robustness in small sample scenarios; (3) The model uses more information from infrared images when identifying bad samples. By integrating complementary multimodal information, EMMDL overcomes blind spots of single-source methods and provides interpretable decision support for industrial quality control.
{"title":"Multimodal data fusion for welding defect detection using ensemble deep learning","authors":"Shiqiang Tang , Feilong Fei , Limao Zhang , Jinfeng Yu","doi":"10.1016/j.autcon.2025.106694","DOIUrl":"10.1016/j.autcon.2025.106694","url":null,"abstract":"<div><div>This study proposes a multimodal deep learning model for high-precision automated detection of resistance spot welding defects. A dual-input weight-sharing network is employed to process the surface images of the weld nugget, while infrared images and welding parameter data are processed by two additional base models. The outputs of these base models are fused using Dempster–Shafer theory, yielding the ensemble multimodal deep learning model (EMMDL). Validation on a welding dataset reveals that: (1) EMMDL achieves an accuracy of 91.6 %, significantly outperforming base models with single modality; (2) Dual-input and weight sharing increases classification accuracy by 7.87 % and enhances robustness in small sample scenarios; (3) The model uses more information from infrared images when identifying bad samples. By integrating complementary multimodal information, EMMDL overcomes blind spots of single-source methods and provides interpretable decision support for industrial quality control.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"182 ","pages":"Article 106694"},"PeriodicalIF":11.5,"publicationDate":"2025-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145730986","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-05DOI: 10.1016/j.autcon.2025.106707
Odin Iversen, Lizhen Huang
Current methods of checking regulatory compliance in the architecture, engineering, construction, and operations (AECO) industry are mostly manual, time consuming and error prone. This paper, using design science research (DSR), proposes an artifact that leverages a large language model (LLM) for automated compliance checking (ACC) to directly interpret regulations, extract BIM data, execute checks, and generate detailed reports. For rule interpretation, the artifact achieves high F1-scores (97% for classification, 100% for dependency identification). For building model preparation, it correctly selected data extraction tools in 97% of cases. In rule execution, it demonstrated 97,7% accuracy and significantly outperformed a naive baseline, which highlights the need for a structured framework. Finally, the artifact generated detailed reports that included the LLM’s reasoning. The key finding is that an LLM-based reasoning engine enables a holistic approach that overcomes the manual rule digitization bottleneck in traditional ACC systems.
{"title":"Leveraging large language models for BIM-based automated compliance checking","authors":"Odin Iversen, Lizhen Huang","doi":"10.1016/j.autcon.2025.106707","DOIUrl":"10.1016/j.autcon.2025.106707","url":null,"abstract":"<div><div>Current methods of checking regulatory compliance in the architecture, engineering, construction, and operations (AECO) industry are mostly manual, time consuming and error prone. This paper, using design science research (DSR), proposes an artifact that leverages a large language model (LLM) for automated compliance checking (ACC) to directly interpret regulations, extract BIM data, execute checks, and generate detailed reports. For rule interpretation, the artifact achieves high F1-scores (97% for classification, 100% for dependency identification). For building model preparation, it correctly selected data extraction tools in 97% of cases. In rule execution, it demonstrated 97,7% accuracy and significantly outperformed a naive baseline, which highlights the need for a structured framework. Finally, the artifact generated detailed reports that included the LLM’s reasoning. The key finding is that an LLM-based reasoning engine enables a holistic approach that overcomes the manual rule digitization bottleneck in traditional ACC systems.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"182 ","pages":"Article 106707"},"PeriodicalIF":11.5,"publicationDate":"2025-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145684076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-05DOI: 10.1016/j.autcon.2025.106695
Xuling Ye , Xingyu Tao , Jack C.P. Cheng , Markus König
Collaboration in Construction Business Process Management (CBPM) often suffers from inefficiency, fragmentation, and security concerns. Blockchain and Smart Contract (SC) offer potential solutions by enabling automation, transparency, and tamper-resistant records. However, adoption remains limited due to two critical gaps: (1) insufficient automation, as current SCs lack cascaded (interdependent) execution, and (2) insufficient adaptability, as existing SCs are non-upgradable, limiting responsiveness to workflow changes. This paper proposes a SC-CBPM framework addressing these gaps through three objectives: (1) Automate CBPM tasks and processes; (2) Develop Cascaded SCs to link interdependent tasks and enforce access control; (3) Develop Upgradable SCs to allow updates without data loss. The framework is validated through two scenarios: BIM-based design collaboration and payment automation, demonstrating feasibility and acceptable computational workability. Performance is evaluated through gas consumption and latency, ensuring deployment readiness. The main contribution is advancing blockchain from a static record-keeping tool to an adaptive workflow automation mechanism.
{"title":"Cascaded and upgradable smart contracts for blockchain-aided construction business process management","authors":"Xuling Ye , Xingyu Tao , Jack C.P. Cheng , Markus König","doi":"10.1016/j.autcon.2025.106695","DOIUrl":"10.1016/j.autcon.2025.106695","url":null,"abstract":"<div><div>Collaboration in Construction Business Process Management (CBPM) often suffers from inefficiency, fragmentation, and security concerns. Blockchain and Smart Contract (SC) offer potential solutions by enabling automation, transparency, and tamper-resistant records. However, adoption remains limited due to two critical gaps: (1) insufficient automation, as current SCs lack cascaded (interdependent) execution, and (2) insufficient adaptability, as existing SCs are non-upgradable, limiting responsiveness to workflow changes. This paper proposes a SC-CBPM framework addressing these gaps through three objectives: (1) Automate CBPM tasks and processes; (2) Develop Cascaded SCs to link interdependent tasks and enforce access control; (3) Develop Upgradable SCs to allow updates without data loss. The framework is validated through two scenarios: BIM-based design collaboration and payment automation, demonstrating feasibility and acceptable computational workability. Performance is evaluated through gas consumption and latency, ensuring deployment readiness. The main contribution is advancing blockchain from a static record-keeping tool to an adaptive workflow automation mechanism.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"182 ","pages":"Article 106695"},"PeriodicalIF":11.5,"publicationDate":"2025-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145684077","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-03DOI: 10.1016/j.autcon.2025.106697
Long Li , Jing Yang , Yulong Li , Guobin Wu , Shengxi Zhang
Spoil dumpsite selection (SDS), a representative complex decision problem in mega transportation infrastructure (MTI) projects, is crucial for ensuring the project sustainability. However, conventional single-domain or purely data-driven methods cannot fully address the multi-objective conflicts and cross-domain knowledge heterogeneity in SDS. To bridge this gap, this paper proposes a cross-domain decision support system (CDDS) with three progressive modules: (1) criteria system and alternatives identification, (2) domain division and ontology representation, and (3) two-stage knowledge fusion, together forming a systematic decision process. Case study of a mega railway project in western China demonstrates that CDDS can produce viable and robust results, verifying its effectiveness and applicability. Applying this tool, project stakeholders can enhance the interpretability of their decisions in complex environments. Furthermore, this system expands the theoretical and methodological boundaries of knowledge fusion decision and can guide practical complex system engineering decisions in similar contexts.
{"title":"Cross-domain decision support system for spoil dumpsite selection in mega transportation infrastructure projects","authors":"Long Li , Jing Yang , Yulong Li , Guobin Wu , Shengxi Zhang","doi":"10.1016/j.autcon.2025.106697","DOIUrl":"10.1016/j.autcon.2025.106697","url":null,"abstract":"<div><div>Spoil dumpsite selection (SDS), a representative complex decision problem in mega transportation infrastructure (MTI) projects, is crucial for ensuring the project sustainability. However, conventional single-domain or purely data-driven methods cannot fully address the multi-objective conflicts and cross-domain knowledge heterogeneity in SDS. To bridge this gap, this paper proposes a cross-domain decision support system (CDDS) with three progressive modules: (1) criteria system and alternatives identification, (2) domain division and ontology representation, and (3) two-stage knowledge fusion, together forming a systematic decision process. Case study of a mega railway project in western China demonstrates that CDDS can produce viable and robust results, verifying its effectiveness and applicability. Applying this tool, project stakeholders can enhance the interpretability of their decisions in complex environments. Furthermore, this system expands the theoretical and methodological boundaries of knowledge fusion decision and can guide practical complex system engineering decisions in similar contexts.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"182 ","pages":"Article 106697"},"PeriodicalIF":11.5,"publicationDate":"2025-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145658681","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-29DOI: 10.1016/j.autcon.2025.106685
David Boix-Cots , Tai Ikumi , Nikola Tošić , Albert de la Fuente
This paper introduces a sensor data-driven decision support system for calculating both economic and environmental impacts of implementing the maturity method. The system integrates data from wireless temperature sensors embedded in concrete with a four-phase workflow and a dedicated Impact Assessment Methodology (IAM). This combination enables construction teams to assess both economic and environmental impacts of early-age concrete behaviour, supporting decisions such as formwork removal timing or concrete mix adjustment. The proposed methodology was applied to a real-world viaduct construction project involving 691 m3 of concrete and 50 wireless sensors. The results demonstrated significant optimization potential compared with the standard method, including cost savings of 48.15 €/m3, 1.59 kg CO₂-eq/m3 of avoided emissions, and a reduction of 0.031 m3 of water per cubic meter of concrete. The system provides a transparent and replicable framework with potential applicability to a wide range of construction contexts, from building projects to large-scale infrastructure works.
{"title":"Sensor data-driven decision support system for real-time optimization and impact assessment in concrete construction","authors":"David Boix-Cots , Tai Ikumi , Nikola Tošić , Albert de la Fuente","doi":"10.1016/j.autcon.2025.106685","DOIUrl":"10.1016/j.autcon.2025.106685","url":null,"abstract":"<div><div>This paper introduces a sensor data-driven decision support system for calculating both economic and environmental impacts of implementing the maturity method. The system integrates data from wireless temperature sensors embedded in concrete with a four-phase workflow and a dedicated Impact Assessment Methodology (IAM). This combination enables construction teams to assess both economic and environmental impacts of early-age concrete behaviour, supporting decisions such as formwork removal timing or concrete mix adjustment. The proposed methodology was applied to a real-world viaduct construction project involving 691 m<sup>3</sup> of concrete and 50 wireless sensors. The results demonstrated significant optimization potential compared with the standard method, including cost savings of 48.15 €/m<sup>3</sup>, 1.59 kg CO₂-eq/m<sup>3</sup> of avoided emissions, and a reduction of 0.031 m<sup>3</sup> of water per cubic meter of concrete. The system provides a transparent and replicable framework with potential applicability to a wide range of construction contexts, from building projects to large-scale infrastructure works.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"181 ","pages":"Article 106685"},"PeriodicalIF":11.5,"publicationDate":"2025-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145613939","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-29DOI: 10.1016/j.autcon.2025.106682
Nicholas Charron , Jake McLaughlin , Sriram Narasimhan
Existing robot-aided inspection methods suffer from inconsistent map accuracy, unreliable defect measurements, and platform-specific designs. This paper investigates whether a SLAM-centric framework can enable precise, repeatable, and platform-agnostic visual inspections. The framework integrates lidar–camera–inertial SLAM, offline trajectory refinement, inspection-map generation, defect extraction from imagery, and 3D ray-tracing to project defects into a unified map. The approach confirms that accurate defect localization, dimensional quantification, and dense inspection maps can be produced in real-world scenarios. This finding benefits infrastructure owners and inspectors by providing an end-to-end solution for robot-aided inspections that enable faster, safer, and more objective assessments compared to current qualitative workflows. The released datasets and software establish a foundation for future research on long-term defect monitoring and inspection automation.
{"title":"SLAM-centric visual inspection of civil infrastructure","authors":"Nicholas Charron , Jake McLaughlin , Sriram Narasimhan","doi":"10.1016/j.autcon.2025.106682","DOIUrl":"10.1016/j.autcon.2025.106682","url":null,"abstract":"<div><div>Existing robot-aided inspection methods suffer from inconsistent map accuracy, unreliable defect measurements, and platform-specific designs. This paper investigates whether a SLAM-centric framework can enable precise, repeatable, and platform-agnostic visual inspections. The framework integrates lidar–camera–inertial SLAM, offline trajectory refinement, inspection-map generation, defect extraction from imagery, and 3D ray-tracing to project defects into a unified map. The approach confirms that accurate defect localization, dimensional quantification, and dense inspection maps can be produced in real-world scenarios. This finding benefits infrastructure owners and inspectors by providing an end-to-end solution for robot-aided inspections that enable faster, safer, and more objective assessments compared to current qualitative workflows. The released datasets and software establish a foundation for future research on long-term defect monitoring and inspection automation.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"181 ","pages":"Article 106682"},"PeriodicalIF":11.5,"publicationDate":"2025-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145613944","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-27DOI: 10.1016/j.autcon.2025.106686
Mudasir Hussain , Zhongnan Ye , Hung-Lin Chi , Shu-Chien Hsu
Construction machinery enhances productivity and ensures project timelines. However, equipment failure poses significant risks, including injuries, fatalities, and financial losses. Traditional safety assessments rely on manual reporting and are prone to errors, delays, and inconsistencies. This paper introduced a cascade learning technique for automated safety risk assessment in crane operations, ensuring reliable, accurate, and adaptable evaluations. The cascade model detects cranes, classifies safety statuses and activities, and computes risk values using confidence scores and impact factors. A risk threshold of 0.52 triggers real-time alerts for intervention. Video-feed analysis supports continuous monitoring and documentation. Expert validation confirmed the practicality of the risk-quantification models. The model achieved 92.10 % precision in crane detection, 99.25 % accuracy in safety classification, and 99.47 % accuracy in activity classification, with an inference time of 0.70 s. This approach enhances Smart Site Safety System (4S) technologies, automates safety assessments, and contributes to improved construction safety standards.
{"title":"Automated safety risk assessment for crane operations using cascade learning","authors":"Mudasir Hussain , Zhongnan Ye , Hung-Lin Chi , Shu-Chien Hsu","doi":"10.1016/j.autcon.2025.106686","DOIUrl":"10.1016/j.autcon.2025.106686","url":null,"abstract":"<div><div>Construction machinery enhances productivity and ensures project timelines. However, equipment failure poses significant risks, including injuries, fatalities, and financial losses. Traditional safety assessments rely on manual reporting and are prone to errors, delays, and inconsistencies. This paper introduced a cascade learning technique for automated safety risk assessment in crane operations, ensuring reliable, accurate, and adaptable evaluations. The cascade model detects cranes, classifies safety statuses and activities, and computes risk values using confidence scores and impact factors. A risk threshold of 0.52 triggers real-time alerts for intervention. Video-feed analysis supports continuous monitoring and documentation. Expert validation confirmed the practicality of the risk-quantification models. The model achieved 92.10 % precision in crane detection, 99.25 % accuracy in safety classification, and 99.47 % accuracy in activity classification, with an inference time of 0.70 s. This approach enhances Smart Site Safety System (4S) technologies, automates safety assessments, and contributes to improved construction safety standards.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"181 ","pages":"Article 106686"},"PeriodicalIF":11.5,"publicationDate":"2025-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145611907","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-25DOI: 10.1016/j.autcon.2025.106680
Sharjeel Anjum , Muhammad Khan , Chukwuma Nnaji , Ashrant Aryal , Amanda S. Koh
Physical fatigue among construction workers is a major safety concern, impacting both health and productivity. Machine learning (ML) models for fatigue monitoring often struggle with generalizing across varying work conditions and populations. This paper advances fatigue monitoring automation by (1) developing ML models trained under diverse temperature and load conditions (Dataset 1), (2) evaluating generalizability on unseen construction-related data (Dataset 2), and (3) proposing transfer learning-based fine-tuning to enhance models' adaptability while reducing the need for large datasets. Initial accuracies on Dataset 1 were 87.5 % (RFC), 89.7 % (XGBoost), and 92 % (FatigueNet); however, these dropped sharply to 40 % (RFC, XGBoost) and 29 % (FatigueNet) under the generalizability test. When trained from scratch on combined datasets, RFC and FatigueNet achieved 47 % and 60 % accuracy, highlighting challenges with generalization. Transfer learning improved FatigueNet's accuracy to 82 % and RFC's to 87 %. These results demonstrate transfer learning's potential for real-time fatigue monitoring and construction site safety.
{"title":"Generalizing fatigue prediction models for construction workers: Cross-experiment evaluation with transfer learning across thermal and load conditions","authors":"Sharjeel Anjum , Muhammad Khan , Chukwuma Nnaji , Ashrant Aryal , Amanda S. Koh","doi":"10.1016/j.autcon.2025.106680","DOIUrl":"10.1016/j.autcon.2025.106680","url":null,"abstract":"<div><div>Physical fatigue among construction workers is a major safety concern, impacting both health and productivity. Machine learning (ML) models for fatigue monitoring often struggle with generalizing across varying work conditions and populations. This paper advances fatigue monitoring automation by (1) developing ML models trained under diverse temperature and load conditions (Dataset 1), (2) evaluating generalizability on unseen construction-related data (Dataset 2), and (3) proposing transfer learning-based fine-tuning to enhance models' adaptability while reducing the need for large datasets. Initial accuracies on Dataset 1 were 87.5 % (RFC), 89.7 % (XGBoost), and 92 % (FatigueNet); however, these dropped sharply to 40 % (RFC, XGBoost) and 29 % (FatigueNet) under the generalizability test. When trained from scratch on combined datasets, RFC and FatigueNet achieved 47 % and 60 % accuracy, highlighting challenges with generalization. Transfer learning improved FatigueNet's accuracy to 82 % and RFC's to 87 %. These results demonstrate transfer learning's potential for real-time fatigue monitoring and construction site safety.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"181 ","pages":"Article 106680"},"PeriodicalIF":11.5,"publicationDate":"2025-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145593092","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-24DOI: 10.1016/j.autcon.2025.106679
Sina Poorghasem, Yiming Liu, Zhan Jiang, Jinxin Chen, Yi Bao
Monitoring and predicting damages of civil infrastructure are essential for safe and efficient operation and maintenance. This paper presents a digital twin-based approach for automatic detection and prediction of cracks and corrosion utilizing spatiotemporal measurements of strains from distributed fiber optic sensors. Generative machine learning techniques are used to improve the quantity and quality of datasets used to develop damage detection and prediction models. The performance of the approach was evaluated using laboratory experiments through case studies on reinforced concrete beams and steel pipes. Results demonstrated that cracks and corrosion were detected accurately (accuracy>0.98) and efficiently (latency = 0.17 ms). Predictions of strain distributions were performed 7 min ahead for cracks and 21 h ahead for corrosion. The effects of sensing parameters on performance were investigated, enabling sensor configuration optimization. The presented approach advances the ability to monitor and predict damages based on advanced machine learning and distributed fiber optic sensing techniques.
{"title":"Machine learning-based automatic detection and prediction of cracks and corrosion using spatiotemporal measurements from distributed fiber optic sensors","authors":"Sina Poorghasem, Yiming Liu, Zhan Jiang, Jinxin Chen, Yi Bao","doi":"10.1016/j.autcon.2025.106679","DOIUrl":"10.1016/j.autcon.2025.106679","url":null,"abstract":"<div><div>Monitoring and predicting damages of civil infrastructure are essential for safe and efficient operation and maintenance. This paper presents a digital twin-based approach for automatic detection and prediction of cracks and corrosion utilizing spatiotemporal measurements of strains from distributed fiber optic sensors. Generative machine learning techniques are used to improve the quantity and quality of datasets used to develop damage detection and prediction models. The performance of the approach was evaluated using laboratory experiments through case studies on reinforced concrete beams and steel pipes. Results demonstrated that cracks and corrosion were detected accurately (accuracy>0.98) and efficiently (latency = 0.17 ms). Predictions of strain distributions were performed 7 min ahead for cracks and 21 h ahead for corrosion. The effects of sensing parameters on performance were investigated, enabling sensor configuration optimization. The presented approach advances the ability to monitor and predict damages based on advanced machine learning and distributed fiber optic sensing techniques.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"181 ","pages":"Article 106679"},"PeriodicalIF":11.5,"publicationDate":"2025-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145593113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-24DOI: 10.1016/j.autcon.2025.106671
Tao Sun , Beining Han , Jimmy Wu , Szymon Rusinkiewicz , Yi Shao
Manipulation remains a key bottleneck in achieving fully autonomous rebar cage assembly. Existing solutions based on rail-guided systems are expensive, poorly scalable, and limited in capability. This paper introduces a framework that leverages a mobile manipulator and uses visual servoing together with imitation learning (IL) to address complex rebar manipulation tasks. The framework enables autonomous execution of two challenging manipulation tasks: (a) tight-fit rebar slot insertion and (b) rebar tying at complex intersection nodes within cages. Using only low-cost RGB cameras, the proposed approach achieves over 90% success rate for over 20 rollouts on both tasks. A highlight is the integration of a segmentation module and a reinsertion strategy that improves tight-fit insertion performance by 41.7% over the baseline and significantly improves robustness to background changes. Notably, the system requires neither depth sensors nor explicit geometric modeling, and supports rapid deployment in novel environments. This paper establishes a foundation for extending autonomy to broader rebar manipulation scenarios. Qualitative results are available on the project website1.
{"title":"Mobile robotic rebar cage assembly via imitation learning","authors":"Tao Sun , Beining Han , Jimmy Wu , Szymon Rusinkiewicz , Yi Shao","doi":"10.1016/j.autcon.2025.106671","DOIUrl":"10.1016/j.autcon.2025.106671","url":null,"abstract":"<div><div>Manipulation remains a key bottleneck in achieving fully autonomous rebar cage assembly. Existing solutions based on rail-guided systems are expensive, poorly scalable, and limited in capability. This paper introduces a framework that leverages a mobile manipulator and uses visual servoing together with imitation learning (IL) to address complex rebar manipulation tasks. The framework enables autonomous execution of two challenging manipulation tasks: (a) tight-fit rebar slot insertion and (b) rebar tying at complex intersection nodes within cages. Using only low-cost RGB cameras, the proposed approach achieves over 90% success rate for over 20 rollouts on both tasks. A highlight is the integration of a segmentation module and a reinsertion strategy that improves tight-fit insertion performance by 41.7% over the baseline and significantly improves robustness to background changes. Notably, the system requires neither depth sensors nor explicit geometric modeling, and supports rapid deployment in novel environments. This paper establishes a foundation for extending autonomy to broader rebar manipulation scenarios. Qualitative results are available on the project website<span><span><sup>1</sup></span></span>.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"181 ","pages":"Article 106671"},"PeriodicalIF":11.5,"publicationDate":"2025-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145593116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}