首页 > 最新文献

IEEE Sensors Journal最新文献

英文 中文
Corrections to “CSFO: A Category-Specific Flattening Optimization Method for Sensor-Based Long-Tailed Activity Recognition” 对“CSFO:基于传感器的长尾活动识别的特定类别平坦化优化方法”的更正
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-13 DOI: 10.1109/JSEN.2025.3610164
Xueer Wang;Qi Teng
Presents corrections to the paper, (Corrections to “CSFO: A Category-Specific Flattening Optimization Method for Sensor-Based Long-Tailed Activity Recognition”).
提出了对论文的更正,(对“CSFO:基于传感器的长尾活动识别的特定类别平坦化优化方法”的更正)。
{"title":"Corrections to “CSFO: A Category-Specific Flattening Optimization Method for Sensor-Based Long-Tailed Activity Recognition”","authors":"Xueer Wang;Qi Teng","doi":"10.1109/JSEN.2025.3610164","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3610164","url":null,"abstract":"Presents corrections to the paper, (Corrections to “CSFO: A Category-Specific Flattening Optimization Method for Sensor-Based Long-Tailed Activity Recognition”).","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 22","pages":"42413-42415"},"PeriodicalIF":4.3,"publicationDate":"2025-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11245647","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145500470","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Lightweight Perception Enhancement Network for Real-Time and Accurate Internal Surface Defect Detection of Cold-Drawn Steel Pipes 基于轻量感知增强网络的冷拔钢管内表面缺陷实时准确检测
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-13 DOI: 10.1109/JSEN.2025.3629733
You Tan;Kechen Song;Hongshu Chen;Yu Zhang;Yunhui Yan
The detection of internal surface defects in cold-drawn pipes is challenging. In recent years, as the production demands for cold-drawn steel pipes have steadily grown, there has been an urgent need for an efficient detection approach that balances accuracy and real-time performance in industrial environments. Although several existing deep learning-based methods have achieved high accuracy in surface defect detection, they often need substantial computational costs to extract rich feature representations, which inevitably slows down the inference process and leads to low detection efficiency. Moreover, internal defects of cold-drawn pipes typically exhibit challenges, which may further degrade the performance of existing models. To address these challenges, we propose a lightweight perception enhancement network (LPENet) to effectively balance efficiency and accuracy. Specifically, we introduce a progressive feature extraction (PFE) backbone that enhances contextual perception from local to global scales. Furthermore, we design amultiscale context enhancement (MCE) module to enrich the feature representation and a boundary-enhanced aggregation (BEA) module to strengthen fine-grained feature awareness. In addition, we propose a perception-guided fusion (PGF) strategy to facilitate interaction between shallow and deep features. We deploy LPENet in combination with a pipe internal surface detection (PISD) robot, achieving wireless and efficient defect detection in real-world steel pipe factories. In extensive experiments on the SSP2000 dataset, LPENet achieves the best balance between detection accuracy and efficiency. The source code is publicly available at https://github.com/VDT-2048/LPENet.
冷拔管内表面缺陷的检测是一项具有挑战性的工作。近年来,随着冷拔钢管的生产需求稳步增长,迫切需要一种有效的检测方法,在工业环境中平衡精度和实时性。虽然现有的几种基于深度学习的方法在表面缺陷检测方面取得了很高的精度,但它们往往需要大量的计算成本来提取丰富的特征表示,这不可避免地减慢了推理过程,导致检测效率低下。此外,冷拔管的内部缺陷通常表现出挑战,这可能进一步降低现有模型的性能。为了解决这些挑战,我们提出了一种轻量级感知增强网络(LPENet)来有效地平衡效率和准确性。具体来说,我们引入了一种渐进特征提取(PFE)主干,增强了从局部到全局尺度的上下文感知。此外,我们设计了多尺度上下文增强(MCE)模块来丰富特征表示,设计了边界增强聚合(BEA)模块来增强细粒度特征感知。此外,我们提出了一种感知引导融合(PGF)策略,以促进浅层和深层特征之间的交互。我们将LPENet与管道内表面检测(PISD)机器人相结合,在现实世界的钢管工厂中实现无线和高效的缺陷检测。在SSP2000数据集上的大量实验中,LPENet在检测精度和效率之间达到了最好的平衡。源代码可在https://github.com/VDT-2048/LPENet上公开获得。
{"title":"A Lightweight Perception Enhancement Network for Real-Time and Accurate Internal Surface Defect Detection of Cold-Drawn Steel Pipes","authors":"You Tan;Kechen Song;Hongshu Chen;Yu Zhang;Yunhui Yan","doi":"10.1109/JSEN.2025.3629733","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3629733","url":null,"abstract":"The detection of internal surface defects in cold-drawn pipes is challenging. In recent years, as the production demands for cold-drawn steel pipes have steadily grown, there has been an urgent need for an efficient detection approach that balances accuracy and real-time performance in industrial environments. Although several existing deep learning-based methods have achieved high accuracy in surface defect detection, they often need substantial computational costs to extract rich feature representations, which inevitably slows down the inference process and leads to low detection efficiency. Moreover, internal defects of cold-drawn pipes typically exhibit challenges, which may further degrade the performance of existing models. To address these challenges, we propose a lightweight perception enhancement network (LPENet) to effectively balance efficiency and accuracy. Specifically, we introduce a progressive feature extraction (PFE) backbone that enhances contextual perception from local to global scales. Furthermore, we design amultiscale context enhancement (MCE) module to enrich the feature representation and a boundary-enhanced aggregation (BEA) module to strengthen fine-grained feature awareness. In addition, we propose a perception-guided fusion (PGF) strategy to facilitate interaction between shallow and deep features. We deploy LPENet in combination with a pipe internal surface detection (PISD) robot, achieving wireless and efficient defect detection in real-world steel pipe factories. In extensive experiments on the SSP2000 dataset, LPENet achieves the best balance between detection accuracy and efficiency. The source code is publicly available at <uri>https://github.com/VDT-2048/LPENet</uri>.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"26 1","pages":"1383-1394"},"PeriodicalIF":4.3,"publicationDate":"2025-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145852514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Soybean Adulteration Detection Method Based on Adaptive Feature Compensation Classification Network and Electronic Nose 基于自适应特征补偿分类网络和电子鼻的大豆掺假检测方法
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-12 DOI: 10.1109/JSEN.2025.3629234
Baosheng Wang;Xiaoxue Ping;Yang Liu
Soybean is an important food and economic crop, yet it is often subject to adulteration through the mixing of old and new beans, which threatens food safety and market fairness. This study proposes a soybean adulteration detection method based on an adaptive feature complementary classification network (AFCC-Net) and an electronic nose (e-nose) system. First, the e-nose system collects volatile compound data from soybeans with varying adulteration ratios, and t-distributed stochastic neighbor embedding (t-SNE) is employed to visualize differences. Then, an adaptive feature complementary computing module (AFCCM) is introduced, which integrates local convolutional operations with a global self-attention mechanism to complementarily fuse gas features. Residual connections are incorporated to enhance feature representation, enabling deep feature extraction from gas data. Finally, a lightweight AFCC-Net is designed to identify soybeans with different adulteration ratios. Ablation experiments validate the rationality of the AFCCM design. Compared with lightweight deep learning methods and state-of-the-art gas information classification approaches, AFCC-Net demonstrates the best classification performance under cross-validation. On the soybean adulteration dataset from Yushu City, Jilin Province, China, it achieves an accuracy of 98.67%, a precision of 98.80%, and a recall of 98.33%. On the soybean adulteration dataset from Panjin City, Liaoning Province, China, it achieves an accuracy of 98.33%, a precision of 98.49%, and a recall of 98.05%. Moreover, the model demonstrates strong generalization capability on the test set. The AFCC-Net combined with the e-nose detection method provides a nondestructive solution for soybean adulteration detection, indicating considerable practical application value.
大豆是一种重要的粮食和经济作物,但在大豆生产过程中经常出现新旧混用的掺假现象,威胁着食品安全和市场公平。本研究提出一种基于自适应特征互补分类网络(AFCC-Net)和电子鼻(e-nose)系统的大豆掺假检测方法。首先,电子鼻系统收集不同掺假率的大豆挥发性化合物数据,并采用t分布随机邻居嵌入(t-SNE)可视化差异。然后,介绍了一种自适应特征互补计算模块(AFCCM),该模块将局部卷积运算与全局自关注机制相结合,实现了气体特征的互补融合。残差连接可以增强特征表示,实现天然气数据的深度特征提取。最后,设计了一个轻量级的AFCC-Net来识别不同掺假比例的大豆。烧蚀实验验证了AFCCM设计的合理性。与轻量级深度学习方法和最先进的气体信息分类方法相比,AFCC-Net在交叉验证下表现出最好的分类性能。在中国吉林省玉树市的大豆掺假数据集上,准确率为98.67%,精密度为98.80%,召回率为98.33%。在中国辽宁省盘锦市的大豆掺假数据集上,该方法的准确率为98.33%,精密度为98.49%,召回率为98.05%。此外,该模型在测试集上显示出较强的泛化能力。AFCC-Net结合电子鼻检测法为大豆掺假检测提供了一种无损解决方案,具有相当的实际应用价值。
{"title":"A Soybean Adulteration Detection Method Based on Adaptive Feature Compensation Classification Network and Electronic Nose","authors":"Baosheng Wang;Xiaoxue Ping;Yang Liu","doi":"10.1109/JSEN.2025.3629234","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3629234","url":null,"abstract":"Soybean is an important food and economic crop, yet it is often subject to adulteration through the mixing of old and new beans, which threatens food safety and market fairness. This study proposes a soybean adulteration detection method based on an adaptive feature complementary classification network (AFCC-Net) and an electronic nose (e-nose) system. First, the e-nose system collects volatile compound data from soybeans with varying adulteration ratios, and t-distributed stochastic neighbor embedding (t-SNE) is employed to visualize differences. Then, an adaptive feature complementary computing module (AFCCM) is introduced, which integrates local convolutional operations with a global self-attention mechanism to complementarily fuse gas features. Residual connections are incorporated to enhance feature representation, enabling deep feature extraction from gas data. Finally, a lightweight AFCC-Net is designed to identify soybeans with different adulteration ratios. Ablation experiments validate the rationality of the AFCCM design. Compared with lightweight deep learning methods and state-of-the-art gas information classification approaches, AFCC-Net demonstrates the best classification performance under cross-validation. On the soybean adulteration dataset from Yushu City, Jilin Province, China, it achieves an accuracy of 98.67%, a precision of 98.80%, and a recall of 98.33%. On the soybean adulteration dataset from Panjin City, Liaoning Province, China, it achieves an accuracy of 98.33%, a precision of 98.49%, and a recall of 98.05%. Moreover, the model demonstrates strong generalization capability on the test set. The AFCC-Net combined with the e-nose detection method provides a nondestructive solution for soybean adulteration detection, indicating considerable practical application value.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 24","pages":"45084-45092"},"PeriodicalIF":4.3,"publicationDate":"2025-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145729393","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Novel Endoscopic Infrared Thermal Imaging System for Burden Surface Temperature Field Measurement in Blast Furnace 一种用于高炉炉料表面温度场测量的新型内窥镜红外热成像系统
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-11 DOI: 10.1109/JSEN.2025.3629138
Yitian Li;Dong Pan;Zhaohui Jiang;Haoyang Yu;Gui Gui;Weihua Gui
The temperature distribution of the blast furnace (BF) burden surface is crucial to regulate the gas flow distribution and monitor the abnormal furnace conditions. However, it has always been a challenging issue to obtain the burden surface thermal distribution. Therefore, this study proposes a novel endoscopic infrared thermal imaging system for measuring the temperature field of the burden surface. First, aiming at the imaging problem brought by asymmetric viewing angle and large spatial structure in BF, the optical system design indicators suitable for the BF structure are calculated based on geometric optics principle. Second, according to the design indicator, an endoscopic infrared optical system combining an asymmetric reversed telephoto objective lens and a rod lens relay system is designed, which ensures the acquisition of raw infrared radiation in the BF. Subsequently, a distortion calibration method based on corner relocalization and improved covariance matrix estimation is proposed, which accurately acquires imaging parameters by utilizing checkerboard images captured in a defocused state. Finally, temperature measurement verification was conducted on the blackbody furnace and simulated burden surface. Within the range of 600–1000 K, the relative error was within 1%, and the average temperature difference compared with a commercial infrared camera was 0.6991 K.
高炉炉料表面温度分布对调节高炉煤气流量分布和监测高炉异常状态至关重要。然而,炉料表面热分布的获取一直是一个具有挑战性的问题。因此,本研究提出了一种新型的内窥镜红外热成像系统,用于测量炉料表面的温度场。首先,针对BF不对称视角和大空间结构带来的成像问题,基于几何光学原理计算出适合BF结构的光学系统设计指标;其次,根据设计指标,设计了一种由非对称反长焦物镜和杆式镜头中继系统组成的内窥镜红外光学系统,保证了BF内原始红外辐射的采集。随后,提出了一种基于角点再定位和改进协方差矩阵估计的畸变校正方法,利用散焦状态下捕获的棋盘图像准确获取成像参数。最后对黑体炉和模拟炉料表面进行了测温验证。在600-1000 K范围内,相对误差在1%以内,与商用红外相机的平均温差为0.6991 K。
{"title":"A Novel Endoscopic Infrared Thermal Imaging System for Burden Surface Temperature Field Measurement in Blast Furnace","authors":"Yitian Li;Dong Pan;Zhaohui Jiang;Haoyang Yu;Gui Gui;Weihua Gui","doi":"10.1109/JSEN.2025.3629138","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3629138","url":null,"abstract":"The temperature distribution of the blast furnace (BF) burden surface is crucial to regulate the gas flow distribution and monitor the abnormal furnace conditions. However, it has always been a challenging issue to obtain the burden surface thermal distribution. Therefore, this study proposes a novel endoscopic infrared thermal imaging system for measuring the temperature field of the burden surface. First, aiming at the imaging problem brought by asymmetric viewing angle and large spatial structure in BF, the optical system design indicators suitable for the BF structure are calculated based on geometric optics principle. Second, according to the design indicator, an endoscopic infrared optical system combining an asymmetric reversed telephoto objective lens and a rod lens relay system is designed, which ensures the acquisition of raw infrared radiation in the BF. Subsequently, a distortion calibration method based on corner relocalization and improved covariance matrix estimation is proposed, which accurately acquires imaging parameters by utilizing checkerboard images captured in a defocused state. Finally, temperature measurement verification was conducted on the blackbody furnace and simulated burden surface. Within the range of 600–1000 K, the relative error was within 1%, and the average temperature difference compared with a commercial infrared camera was 0.6991 K.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 24","pages":"44973-44983"},"PeriodicalIF":4.3,"publicationDate":"2025-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145729465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Noninvasive and Quantitative Brain Temperature Monitoring Using Wearable Microwave Technique 基于可穿戴微波技术的无创定量脑温监测
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-11 DOI: 10.1109/JSEN.2025.3627930
Daljeet Singh;Mariella Särestöniemi;Teemu Myllylä
A noninvasive and quantitative microwave method and setup for brain temperature monitoring are proposed in this study. The proposed microwave setup is suitable for wearable devices and prolonged usage without compromising the subject’s comfort. The proposed method is carefully devised for accurate measurements based on two-level feature extraction and is independent of the microwave sensor. A unique dataset creation module and the ordered selection scheme (OSS) based on correlation analysis are proposed to ensure real-time operation with a lightweight algorithm. Finally, the quantitative method is devised using weighted regression analysis on signal attributes selected using OSS. Six thin, small, lightweight microwave sensors are evaluated with different placement strategies for brain temperature monitoring. A realistic phantom model is developed exclusively to test the proposed microwave method and sensors. The dynamic phantom model mimics the dielectric properties of a human head. The correlation and regression analysis performed on data collected from numerous trials showcase that the proposed microwave system can detect minute changes in brain temperature, and its response is analogous to temperature values measured by invasive sensors.
本研究提出了一种无创、定量的微波脑温度监测方法和装置。所提出的微波装置适用于可穿戴设备和长时间使用而不影响受试者的舒适性。该方法是基于两级特征提取的精确测量方法,不依赖于微波传感器。提出了一种独特的数据集创建模块和基于相关性分析的有序选择方案(OSS),通过轻量级算法保证了数据集的实时性。最后,对OSS选择的信号属性进行加权回归分析,设计定量方法。六种薄、小、轻的微波传感器采用不同的放置策略进行脑温度监测。为了测试所提出的微波方法和传感器,专门开发了一个逼真的模型。动态幻影模型模拟了人类头部的介电特性。从大量试验中收集的数据进行的相关和回归分析表明,所提出的微波系统可以检测到大脑温度的微小变化,其反应类似于侵入式传感器测量的温度值。
{"title":"Noninvasive and Quantitative Brain Temperature Monitoring Using Wearable Microwave Technique","authors":"Daljeet Singh;Mariella Särestöniemi;Teemu Myllylä","doi":"10.1109/JSEN.2025.3627930","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3627930","url":null,"abstract":"A noninvasive and quantitative microwave method and setup for brain temperature monitoring are proposed in this study. The proposed microwave setup is suitable for wearable devices and prolonged usage without compromising the subject’s comfort. The proposed method is carefully devised for accurate measurements based on two-level feature extraction and is independent of the microwave sensor. A unique dataset creation module and the ordered selection scheme (OSS) based on correlation analysis are proposed to ensure real-time operation with a lightweight algorithm. Finally, the quantitative method is devised using weighted regression analysis on signal attributes selected using OSS. Six thin, small, lightweight microwave sensors are evaluated with different placement strategies for brain temperature monitoring. A realistic phantom model is developed exclusively to test the proposed microwave method and sensors. The dynamic phantom model mimics the dielectric properties of a human head. The correlation and regression analysis performed on data collected from numerous trials showcase that the proposed microwave system can detect minute changes in brain temperature, and its response is analogous to temperature values measured by invasive sensors.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 24","pages":"44898-44909"},"PeriodicalIF":4.3,"publicationDate":"2025-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11241138","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145729428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robotic Grasping Detection Based on Continual Learning Using Perceptual Loss and Multibranch Deep Fusion 基于感知损失和多分支深度融合持续学习的机器人抓取检测
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-10 DOI: 10.1109/JSEN.2025.3628829
Qiaokang Liang;Yaoxin Lai;Songyun Deng;Xinhao Chen;Xiaoyu Yuan;Li Zhou
Vision-based grasping detection is extensively utilized in the field of production and manufacturing, leveraging multisource visual data to generate feature maps and achieve robust autonomous grasps. However, significant challenges remain in effectively integrating multisource visual inputs and overcoming catastrophic forgetting in scenarios that vary with time. To address these issues, this article proposes: 1) a three-branch RGB-D fusion module for cross-modal feature synthesis, integrated into the GR-ConvNet framework to optimize antipodal grasping detection; 2) a composite distillation strategy combining perceptual loss with smooth L1 loss to stabilize knowledge retention across sequential tasks; and 3) a robotic grasping detection system driven by RGB-D sensor integration to facilitate autonomous grasping of objects with diverse shapes. Comprehensive evaluations demonstrate state-of-the-art performance of our methods: 98.9% grasping detection accuracy on the Cornell dataset, 89.12% mean grasp accuracy on the final continual learning task, and 82% grasp success rate in real-world robotic trials. Moreover, ablation experiments conducted on our proposed model and the corresponding continual learning approach demonstrate the effectiveness of the three-branch deep fusion (3-BDF) module and the combined distillation loss. To our knowledge, this is the first application of a perceptual loss approach in RGB-D sensor-driven grasping detection tasks designed for continuously changing scenarios. Code and Video are available at: https://github.com/lyxhnu/Cornell-CL
基于视觉的抓取检测广泛应用于生产制造领域,利用多源视觉数据生成特征图,实现鲁棒自主抓取。然而,在有效整合多源视觉输入和克服随时间变化的情景中的灾难性遗忘方面仍然存在重大挑战。针对这些问题,本文提出:1)将三分支RGB-D融合模块集成到GR-ConvNet框架中,用于跨模态特征综合,优化对足抓取检测;2)结合感知损失和平滑L1损失的复合蒸馏策略,以稳定跨顺序任务的知识保留;3)基于RGB-D传感器集成驱动的机器人抓取检测系统,实现对不同形状物体的自主抓取。综合评估表明,我们的方法具有最先进的性能:在康奈尔数据集上的抓取检测准确率为98.9%,在最终的持续学习任务中平均抓取准确率为89.12%,在现实世界机器人试验中抓取成功率为82%。此外,在我们提出的模型和相应的持续学习方法上进行的烧蚀实验证明了三分支深度融合(3-BDF)模块和联合蒸馏损失的有效性。据我们所知,这是在为不断变化的场景设计的RGB-D传感器驱动的抓取检测任务中首次应用感知损失方法。代码和视频可在:https://github.com/lyxhnu/Cornell-CL
{"title":"Robotic Grasping Detection Based on Continual Learning Using Perceptual Loss and Multibranch Deep Fusion","authors":"Qiaokang Liang;Yaoxin Lai;Songyun Deng;Xinhao Chen;Xiaoyu Yuan;Li Zhou","doi":"10.1109/JSEN.2025.3628829","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3628829","url":null,"abstract":"Vision-based grasping detection is extensively utilized in the field of production and manufacturing, leveraging multisource visual data to generate feature maps and achieve robust autonomous grasps. However, significant challenges remain in effectively integrating multisource visual inputs and overcoming catastrophic forgetting in scenarios that vary with time. To address these issues, this article proposes: 1) a three-branch RGB-D fusion module for cross-modal feature synthesis, integrated into the GR-ConvNet framework to optimize antipodal grasping detection; 2) a composite distillation strategy combining perceptual loss with smooth L1 loss to stabilize knowledge retention across sequential tasks; and 3) a robotic grasping detection system driven by RGB-D sensor integration to facilitate autonomous grasping of objects with diverse shapes. Comprehensive evaluations demonstrate state-of-the-art performance of our methods: 98.9% grasping detection accuracy on the Cornell dataset, 89.12% mean grasp accuracy on the final continual learning task, and 82% grasp success rate in real-world robotic trials. Moreover, ablation experiments conducted on our proposed model and the corresponding continual learning approach demonstrate the effectiveness of the three-branch deep fusion (3-BDF) module and the combined distillation loss. To our knowledge, this is the first application of a perceptual loss approach in RGB-D sensor-driven grasping detection tasks designed for continuously changing scenarios. Code and Video are available at: <uri>https://github.com/lyxhnu/Cornell-CL</uri>","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 24","pages":"44962-44972"},"PeriodicalIF":4.3,"publicationDate":"2025-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145729474","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MTC: Multimodal Transformer With Cross-Modality Guided Attention for Pedestrian Crossing Intention Prediction 基于跨模态引导注意力的多模态变压器行人过马路意向预测
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-10 DOI: 10.1109/JSEN.2025.3628663
Yuanzhe Li;Steffen Müller
Pedestrian crossing intention prediction is crucial for autonomous vehicles (AVs), enabling timely reactions to prevent potential accidents, especially in urban areas. The prediction task is challenging because the pedestrian’s behavior is highly diverse and influenced by various environmental and social factors. Although various networks have shown the potential to exploit complementary cues through multimodal fusion in this task, certain issues remain unresolved. First, critical contextual information, such as geometric depth and its associated modalities, has not been adequately explored. Second, the effective multimodal fusion strategies—particularly in terms of fusion scales and fusion order—remain underexplored. To address these limitations, a multimodal Transformer with cross-modality guided attention (MTC) is proposed. MTC fuses seven visual and motion modality features extracted from multiple Transformer-based encoding modules, incorporating depth maps (DMs) as a new modality to supplement the model’s understanding of scene geometry and pedestrian-centric distance information. MTC follows a multimodal fusion strategy in the spatial–modality–temporal order. Specifically, a novel cross-modality guided attention (CMGA) mechanism is designed to capture complementary feature maps through comprehensive interactions between coregistered visual modalities. Additionally, intermodal attention (IMA) and Transformer-based temporal feature fusion (TFF) are designed to effectively facilitate cross-modal interaction and capture temporal dependencies. Extensive evaluations on the JAAD dataset validate the proposed network’s effectiveness, outperforming the state-of-the-art (SOTA) methods.
行人过马路意图预测对于自动驾驶汽车(AVs)来说至关重要,它能够及时做出反应,防止潜在的事故,尤其是在城市地区。由于行人的行为是高度多样化的,并受到各种环境和社会因素的影响,因此预测任务具有挑战性。尽管在这项任务中,各种网络已经显示出通过多模态融合利用互补线索的潜力,但某些问题仍未解决。首先,关键的背景信息,如几何深度及其相关模式,没有得到充分的探索。其次,有效的多模态聚变策略,特别是在聚变规模和聚变顺序方面,仍然没有得到充分的探索。为了解决这些限制,提出了一种具有跨模态引导注意力(MTC)的多模态变压器。MTC融合了从多个基于transformer的编码模块中提取的七种视觉和运动模态特征,将深度图(dm)作为一种新的模态,以补充模型对场景几何形状和以行人为中心的距离信息的理解。MTC在空间-模态-时间顺序上遵循多模态融合策略。具体而言,设计了一种新的跨模态引导注意(CMGA)机制,通过共同注册的视觉模态之间的综合交互来捕获互补特征映射。此外,多式联运注意(IMA)和基于变压器的时间特征融合(TFF)旨在有效促进跨模式交互和捕获时间依赖性。对JAAD数据集的广泛评估验证了所提出的网络的有效性,优于最先进的(SOTA)方法。
{"title":"MTC: Multimodal Transformer With Cross-Modality Guided Attention for Pedestrian Crossing Intention Prediction","authors":"Yuanzhe Li;Steffen Müller","doi":"10.1109/JSEN.2025.3628663","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3628663","url":null,"abstract":"Pedestrian crossing intention prediction is crucial for autonomous vehicles (AVs), enabling timely reactions to prevent potential accidents, especially in urban areas. The prediction task is challenging because the pedestrian’s behavior is highly diverse and influenced by various environmental and social factors. Although various networks have shown the potential to exploit complementary cues through multimodal fusion in this task, certain issues remain unresolved. First, critical contextual information, such as geometric depth and its associated modalities, has not been adequately explored. Second, the effective multimodal fusion strategies—particularly in terms of fusion scales and fusion order—remain underexplored. To address these limitations, a multimodal Transformer with cross-modality guided attention (MTC) is proposed. MTC fuses seven visual and motion modality features extracted from multiple Transformer-based encoding modules, incorporating depth maps (DMs) as a new modality to supplement the model’s understanding of scene geometry and pedestrian-centric distance information. MTC follows a multimodal fusion strategy in the spatial–modality–temporal order. Specifically, a novel cross-modality guided attention (CMGA) mechanism is designed to capture complementary feature maps through comprehensive interactions between coregistered visual modalities. Additionally, intermodal attention (IMA) and Transformer-based temporal feature fusion (TFF) are designed to effectively facilitate cross-modal interaction and capture temporal dependencies. Extensive evaluations on the JAAD dataset validate the proposed network’s effectiveness, outperforming the state-of-the-art (SOTA) methods.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 24","pages":"44929-44939"},"PeriodicalIF":4.3,"publicationDate":"2025-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145729451","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Runway Snow State Identification Method Based on Impedance Characteristic Differences 基于阻抗特性差的跑道雪态识别方法
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-10 DOI: 10.1109/JSEN.2025.3628713
Bin Chen;Jinlong Zhang;Junhai Yang;Bohao Pan
The volumetric proportions of ice crystals, water, and air within snowpack are highly susceptible to environmental disturbances, leading to multistate phase transitions, such as dry snow, wet snow, and slush. This study introduces a new method for runway snow identification using planar electrode impedance detection. Based on dielectric polarization theory, the effects of water content (0%–30% by volume) and density (100–600 kg/m3) on the complex permittivity of snow are analyzed. A multidimensional identification space is established using the sensitive excitation bands identified at 20 and 100 kHz to accurately classify snow types. A multidimensional identification space is defined to accurately classify snow types. Electrode design is optimized for runway conditions, and a calibration method is applied to mitigate impedance drift caused by interference. Field tests show the developed contact sensor achieves 85% identification accuracy. This work provides a new technique for real-time, automated runway snow condition monitoring, aligning with global reporting format (GRF) standards.
积雪中冰晶、水和空气的体积比例极易受到环境干扰,导致多状态相变,如干雪、湿雪和雪泥。提出了一种基于平面电极阻抗检测的跑道积雪识别新方法。基于介电极化理论,分析了积雪含水量(体积比为0% ~ 30%)和密度(100 ~ 600 kg/m3)对积雪复介电常数的影响。利用20 kHz和100 kHz识别的敏感激励波段建立多维识别空间,对积雪类型进行准确分类。定义了多维识别空间,对积雪类型进行准确分类。针对跑道条件对电极设计进行了优化,并采用了一种校准方法来减轻干扰引起的阻抗漂移。现场试验表明,所研制的接触式传感器识别准确率达到85%。这项工作为实时、自动跑道雪况监测提供了一种新技术,与全球报告格式(GRF)标准保持一致。
{"title":"Runway Snow State Identification Method Based on Impedance Characteristic Differences","authors":"Bin Chen;Jinlong Zhang;Junhai Yang;Bohao Pan","doi":"10.1109/JSEN.2025.3628713","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3628713","url":null,"abstract":"The volumetric proportions of ice crystals, water, and air within snowpack are highly susceptible to environmental disturbances, leading to multistate phase transitions, such as dry snow, wet snow, and slush. This study introduces a new method for runway snow identification using planar electrode impedance detection. Based on dielectric polarization theory, the effects of water content (0%–30% by volume) and density (100–600 kg/m3) on the complex permittivity of snow are analyzed. A multidimensional identification space is established using the sensitive excitation bands identified at 20 and 100 kHz to accurately classify snow types. A multidimensional identification space is defined to accurately classify snow types. Electrode design is optimized for runway conditions, and a calibration method is applied to mitigate impedance drift caused by interference. Field tests show the developed contact sensor achieves 85% identification accuracy. This work provides a new technique for real-time, automated runway snow condition monitoring, aligning with global reporting format (GRF) standards.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 24","pages":"44940-44950"},"PeriodicalIF":4.3,"publicationDate":"2025-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145729396","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Real-Time Error-Compensated Multisensor Acquisition System for Marine Geotechnical Investigation 海洋岩土工程勘察实时误差补偿多传感器采集系统
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-10 DOI: 10.1109/JSEN.2025.3628740
Seung-Beom Ku;Hyungjin Jung;Hyungjin Cho;Jiseok Oh;Jang-Un Kim;JunA Lee;Sungjun Cho;Jongmuk Won;Junghee Park;Hyunwook Choo;Hyung-Min Lee
This article proposes a real-time errorcompensated multisensor acquisition system for a self-weight multiphysics cone penetration apparatus that performs marine geotechnical investigation. Conventional methods such as standard penetration test (SPT) and cone penetration test (CPT) provide reliable, high-resolution data but require dedicated offshore vessels, which are expensive to operate. To address these limitations, the apparatus with the proposed acquisition system has been developed for a lightweight and cost-effective solution. The proposed acquisition system drives hydro-compensated dual pressure transducers, strain gauges with Wheatstone bridges, and an inertial measurement unit (IMU) to obtain accurate geotechnical parameters as well as determine soil strength and stiffness properties during dynamic penetration. Additionally, the acquisition system uses an RS-485 communication protocol to transmit data over long distances up to 1.2 km at a data rate up to 100 kb/s. A 10.7 V lithium-ion (Li-ion) battery powers the proposed system, generating supply voltages of 9, 5, and 2 V through onboard voltage regulators to drive analog and digital subsystems. The proposed apparatus was verified to acquire reliable geotechnical parameters through field tests, providing a viable solution for offshore wind power development and submarine cable installations.
本文提出了一种用于海洋岩土工程勘察的自重式多物理场圆锥探深仪的实时误差补偿多传感器采集系统。常规方法,如标准贯入测试(SPT)和锥形贯入测试(CPT),可以提供可靠的高分辨率数据,但需要专用的海上船舶,操作成本高昂。为了解决这些限制,已经开发了带有拟议采集系统的设备,以实现轻量级和经济高效的解决方案。所提出的采集系统驱动液压补偿双压力传感器、带有惠斯通桥的应变片和惯性测量单元(IMU),以获得准确的岩土参数,并确定动态侵彻过程中的土壤强度和刚度特性。此外,采集系统使用RS-485通信协议,以高达100 kb/s的数据速率在1.2公里的长距离上传输数据。10.7 V锂离子(Li-ion)电池为系统供电,通过板载电压调节器产生9,5和2 V的电源电压,以驱动模拟和数字子系统。通过现场测试,验证了该装置可获得可靠的岩土参数,为海上风力发电开发和海底电缆安装提供了可行的解决方案。
{"title":"A Real-Time Error-Compensated Multisensor Acquisition System for Marine Geotechnical Investigation","authors":"Seung-Beom Ku;Hyungjin Jung;Hyungjin Cho;Jiseok Oh;Jang-Un Kim;JunA Lee;Sungjun Cho;Jongmuk Won;Junghee Park;Hyunwook Choo;Hyung-Min Lee","doi":"10.1109/JSEN.2025.3628740","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3628740","url":null,"abstract":"This article proposes a real-time errorcompensated multisensor acquisition system for a self-weight multiphysics cone penetration apparatus that performs marine geotechnical investigation. Conventional methods such as standard penetration test (SPT) and cone penetration test (CPT) provide reliable, high-resolution data but require dedicated offshore vessels, which are expensive to operate. To address these limitations, the apparatus with the proposed acquisition system has been developed for a lightweight and cost-effective solution. The proposed acquisition system drives hydro-compensated dual pressure transducers, strain gauges with Wheatstone bridges, and an inertial measurement unit (IMU) to obtain accurate geotechnical parameters as well as determine soil strength and stiffness properties during dynamic penetration. Additionally, the acquisition system uses an RS-485 communication protocol to transmit data over long distances up to 1.2 km at a data rate up to 100 kb/s. A 10.7 V lithium-ion (Li-ion) battery powers the proposed system, generating supply voltages of 9, 5, and 2 V through onboard voltage regulators to drive analog and digital subsystems. The proposed apparatus was verified to acquire reliable geotechnical parameters through field tests, providing a viable solution for offshore wind power development and submarine cable installations.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 24","pages":"44951-44961"},"PeriodicalIF":4.3,"publicationDate":"2025-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145729432","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
mmTracking: A DL-Based mmWave RADAR Data Processing Algorithm for Indoor People Tracking mmTracking:一种基于dl的毫米波雷达数据处理算法
IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2025-11-07 DOI: 10.1109/JSEN.2025.3628185
Michela Raimondi;Gianluca Ciattaglia;Antonio Nocera;Maria Gardano;Linda Senigagliesi;Susanna Spinsante;Ennio Gambi
Locating and tracking targets in indoor environments is a challenging field of research. The complexity and variability of the environment limit the suitability of many technologies for this application. In this context, mmWave frequency modulated continuous wave (FMCW) radars can prove to be valuable sensors when combined with deep learning (DL) techniques, in order to extend performance in target locating and tracking. This article presents an original approach to locate and track moving targets in indoor environments, based on a YOLOv3 DL network that can be applied to radar data. To quantify the performance of the proposed method, here named mmTracking, tests were designed in accordance with the ISO/IEC 18305:2016 reference standard. The results show a mean error in localization of 0.39 m with a variance of 0.01 m2, and a root mean square error (RMSE) in the tracking of 0.40 m.
在室内环境中定位和跟踪目标是一个具有挑战性的研究领域。环境的复杂性和可变性限制了许多技术对该应用程序的适用性。在这种情况下,当与深度学习(DL)技术相结合时,毫米波调频连续波(FMCW)雷达可以证明是有价值的传感器,以提高目标定位和跟踪的性能。本文提出了一种在室内环境中定位和跟踪移动目标的原始方法,该方法基于可应用于雷达数据的YOLOv3 DL网络。为了量化所提出的方法(这里称为mmTracking)的性能,按照ISO/IEC 18305:2016参考标准设计了测试。结果表明,定位的平均误差为0.39 m,方差为0.01 m2;跟踪的均方根误差(RMSE)为0.40 m。
{"title":"mmTracking: A DL-Based mmWave RADAR Data Processing Algorithm for Indoor People Tracking","authors":"Michela Raimondi;Gianluca Ciattaglia;Antonio Nocera;Maria Gardano;Linda Senigagliesi;Susanna Spinsante;Ennio Gambi","doi":"10.1109/JSEN.2025.3628185","DOIUrl":"https://doi.org/10.1109/JSEN.2025.3628185","url":null,"abstract":"Locating and tracking targets in indoor environments is a challenging field of research. The complexity and variability of the environment limit the suitability of many technologies for this application. In this context, mmWave frequency modulated continuous wave (FMCW) radars can prove to be valuable sensors when combined with deep learning (DL) techniques, in order to extend performance in target locating and tracking. This article presents an original approach to locate and track moving targets in indoor environments, based on a YOLOv3 DL network that can be applied to radar data. To quantify the performance of the proposed method, here named mmTracking, tests were designed in accordance with the ISO/IEC 18305:2016 reference standard. The results show a mean error in localization of 0.39 m with a variance of 0.01 m2, and a root mean square error (RMSE) in the tracking of 0.40 m.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 24","pages":"45071-45083"},"PeriodicalIF":4.3,"publicationDate":"2025-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145729287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Sensors Journal
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1