{"title":"A Data-Driven Method for Indoor Radar Ghost Recognition With Environmental Mapping","authors":"Ruizhi Liu;Xinghui Song;Jiawei Qian;Shuai Hao;Yue Lin;Hongtao Xu","doi":"10.1109/TRS.2024.3456891","DOIUrl":null,"url":null,"abstract":"Millimeter-wave (mmWave) radar has been widely applied in target detection. However, due to multipath and occlusion, radar often detects ghosts, especially in indoor environments. Existing solutions are mostly tailored to specific, simplified scenarios. To identify radar ghosts in diverse and complex indoor environments, we propose a data-driven approach. A thoughtful indoor radar ghost dataset is created with a multimodal data acquisition and automatic annotation system. And PairwiseNet, an end-to-end deep neural network adept at handling point-pair relationships within sparse point clouds, is proposed for radar ghost recognition. Multiframe accumulation is also implemented in PairwiseNet. To further enhance PairwiseNet, an additional network incorporating grid maps and U-Net is developed for constructing environmental maps from sequential point clouds. This network is trained through cross-modal distillation, with a depth camera as the teacher. Finally, a series of experiments validates the effectiveness of the proposed method in identifying indoor radar ghosts and autonomously constructing environmental maps. The classification accuracy on the test set reaches 96.0%, accurately identifying ghosts in the vast majority of cases.","PeriodicalId":100645,"journal":{"name":"IEEE Transactions on Radar Systems","volume":"2 ","pages":"910-923"},"PeriodicalIF":0.0000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Radar Systems","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10672544/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Millimeter-wave (mmWave) radar has been widely applied in target detection. However, due to multipath and occlusion, radar often detects ghosts, especially in indoor environments. Existing solutions are mostly tailored to specific, simplified scenarios. To identify radar ghosts in diverse and complex indoor environments, we propose a data-driven approach. A thoughtful indoor radar ghost dataset is created with a multimodal data acquisition and automatic annotation system. And PairwiseNet, an end-to-end deep neural network adept at handling point-pair relationships within sparse point clouds, is proposed for radar ghost recognition. Multiframe accumulation is also implemented in PairwiseNet. To further enhance PairwiseNet, an additional network incorporating grid maps and U-Net is developed for constructing environmental maps from sequential point clouds. This network is trained through cross-modal distillation, with a depth camera as the teacher. Finally, a series of experiments validates the effectiveness of the proposed method in identifying indoor radar ghosts and autonomously constructing environmental maps. The classification accuracy on the test set reaches 96.0%, accurately identifying ghosts in the vast majority of cases.