Jiawei Guo, Sen Zhang, Nikta Amiri, Lingyu Yu, Yi Wang
{"title":"一种用于异常兰姆波形检测的对抗性变压器。","authors":"Jiawei Guo, Sen Zhang, Nikta Amiri, Lingyu Yu, Yi Wang","doi":"10.1016/j.neunet.2025.107153","DOIUrl":null,"url":null,"abstract":"<p><p>Lamb waves are widely used for defect detection in structural health monitoring, and various methods are developed for Lamb wave data analysis. This paper presents an unsupervised Adversarial Transformer model for anomalous Lamb wave pattern detection by analyzing the spatiotemporal images generated by a hybrid PZT-scanning laser Doppler vibrometer (SLDV). The model includes the global attention and the local attention mechanisms, and both are trained adversarially. Given the different natures between the normal and anomalous wave patterns, global attention allows accurate reconstruction of normal wave data but is less capable of reproducing anomalous data and, hence, can be used for anomalous wave pattern detection. Local attention, however, serves as a sparring partner in the proposed adversarial training process to boost the quality of global attention. In addition, a new segment replacement strategy is also proposed to make global attention consistently extract textural contents found in normal data, which, however, are noticeably different from anomalies, leading to superior model performance. Our Adversarial Transformer model is also compared with several benchmark models and demonstrates an overall accuracy of 97.1 % for anomalous wave pattern detection. It is also confirmed that global attention and local attention in adversarial training are responsible for the superior performance of our model over the benchmark models (including the native Transformer model).</p>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"185 ","pages":"107153"},"PeriodicalIF":6.0000,"publicationDate":"2025-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An adversarial transformer for anomalous lamb wave pattern detection.\",\"authors\":\"Jiawei Guo, Sen Zhang, Nikta Amiri, Lingyu Yu, Yi Wang\",\"doi\":\"10.1016/j.neunet.2025.107153\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Lamb waves are widely used for defect detection in structural health monitoring, and various methods are developed for Lamb wave data analysis. This paper presents an unsupervised Adversarial Transformer model for anomalous Lamb wave pattern detection by analyzing the spatiotemporal images generated by a hybrid PZT-scanning laser Doppler vibrometer (SLDV). The model includes the global attention and the local attention mechanisms, and both are trained adversarially. Given the different natures between the normal and anomalous wave patterns, global attention allows accurate reconstruction of normal wave data but is less capable of reproducing anomalous data and, hence, can be used for anomalous wave pattern detection. Local attention, however, serves as a sparring partner in the proposed adversarial training process to boost the quality of global attention. In addition, a new segment replacement strategy is also proposed to make global attention consistently extract textural contents found in normal data, which, however, are noticeably different from anomalies, leading to superior model performance. Our Adversarial Transformer model is also compared with several benchmark models and demonstrates an overall accuracy of 97.1 % for anomalous wave pattern detection. It is also confirmed that global attention and local attention in adversarial training are responsible for the superior performance of our model over the benchmark models (including the native Transformer model).</p>\",\"PeriodicalId\":49763,\"journal\":{\"name\":\"Neural Networks\",\"volume\":\"185 \",\"pages\":\"107153\"},\"PeriodicalIF\":6.0000,\"publicationDate\":\"2025-01-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neural Networks\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1016/j.neunet.2025.107153\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1016/j.neunet.2025.107153","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
An adversarial transformer for anomalous lamb wave pattern detection.
Lamb waves are widely used for defect detection in structural health monitoring, and various methods are developed for Lamb wave data analysis. This paper presents an unsupervised Adversarial Transformer model for anomalous Lamb wave pattern detection by analyzing the spatiotemporal images generated by a hybrid PZT-scanning laser Doppler vibrometer (SLDV). The model includes the global attention and the local attention mechanisms, and both are trained adversarially. Given the different natures between the normal and anomalous wave patterns, global attention allows accurate reconstruction of normal wave data but is less capable of reproducing anomalous data and, hence, can be used for anomalous wave pattern detection. Local attention, however, serves as a sparring partner in the proposed adversarial training process to boost the quality of global attention. In addition, a new segment replacement strategy is also proposed to make global attention consistently extract textural contents found in normal data, which, however, are noticeably different from anomalies, leading to superior model performance. Our Adversarial Transformer model is also compared with several benchmark models and demonstrates an overall accuracy of 97.1 % for anomalous wave pattern detection. It is also confirmed that global attention and local attention in adversarial training are responsible for the superior performance of our model over the benchmark models (including the native Transformer model).
期刊介绍:
Neural Networks is a platform that aims to foster an international community of scholars and practitioners interested in neural networks, deep learning, and other approaches to artificial intelligence and machine learning. Our journal invites submissions covering various aspects of neural networks research, from computational neuroscience and cognitive modeling to mathematical analyses and engineering applications. By providing a forum for interdisciplinary discussions between biology and technology, we aim to encourage the development of biologically-inspired artificial intelligence.