Shengjun Tang , Junjie Huang , Benhe Cai , Han Du , Baoding Zhou , Zhigang Zhao , You Li , Weixi Wang , Renzhong Guo
{"title":"回到几何:通过二维三维几何约束从点云中高效分割室内空间","authors":"Shengjun Tang , Junjie Huang , Benhe Cai , Han Du , Baoding Zhou , Zhigang Zhao , You Li , Weixi Wang , Renzhong Guo","doi":"10.1016/j.jag.2024.104265","DOIUrl":null,"url":null,"abstract":"<div><div>This paper addresses the challenge of indoor space segmentation from 3D point clouds, which is essential for understanding interior layouts, reconstructing 3D structures, and developing indoor navigation maps. While current deep learning-based methods rely on projecting 3D point clouds into 2D for instance extraction, they often fail to capture the local and global 3D features necessary for effectively segmenting complex indoor spaces, such as multi-ring nested structures. These methods also struggle with generalization across different scenes. In response, this paper proposes an efficient indoor space segmentation method that integrates both 2D and 3D geometric constraints. By leveraging the distribution characteristics of point clouds in 2D and the local and global features in 3D, the method achieves reliable extraction of vertical structural information in complex indoor environments. To address under-segmentation in small spaces due to varying scales, the paper introduces an adaptive extraction method for space partition anchors, guided by local features. During instance-level space segmentation, a hierarchical contour tree structure is employed to precisely partition complex indoor spaces, effectively handling circular and composite structures. The proposed approach was tested on 96 RGB-D scans from the Beike dataset and 6 large-scale indoor scenes from the S3DIS dataset, covering a range of complexities, sizes, and structures. The experimental section includes ablation studies and thorough comparisons with existing state-of-the-art spatial partitioning algorithms based on morphology and deep learning. Results demonstrate that the proposed method significantly outperforms existing approaches in terms of accuracy, robustness, and generalization ability, providing a solid foundation for indoor space modeling and robotic navigation. The source code and datasets will be made publicly available via the “<span><span>EISPGeo</span><svg><path></path></svg></span>” link.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"135 ","pages":"Article 104265"},"PeriodicalIF":7.6000,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Back to geometry: Efficient indoor space segmentation from point clouds by 2D–3D geometry constrains\",\"authors\":\"Shengjun Tang , Junjie Huang , Benhe Cai , Han Du , Baoding Zhou , Zhigang Zhao , You Li , Weixi Wang , Renzhong Guo\",\"doi\":\"10.1016/j.jag.2024.104265\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This paper addresses the challenge of indoor space segmentation from 3D point clouds, which is essential for understanding interior layouts, reconstructing 3D structures, and developing indoor navigation maps. While current deep learning-based methods rely on projecting 3D point clouds into 2D for instance extraction, they often fail to capture the local and global 3D features necessary for effectively segmenting complex indoor spaces, such as multi-ring nested structures. These methods also struggle with generalization across different scenes. In response, this paper proposes an efficient indoor space segmentation method that integrates both 2D and 3D geometric constraints. By leveraging the distribution characteristics of point clouds in 2D and the local and global features in 3D, the method achieves reliable extraction of vertical structural information in complex indoor environments. To address under-segmentation in small spaces due to varying scales, the paper introduces an adaptive extraction method for space partition anchors, guided by local features. During instance-level space segmentation, a hierarchical contour tree structure is employed to precisely partition complex indoor spaces, effectively handling circular and composite structures. The proposed approach was tested on 96 RGB-D scans from the Beike dataset and 6 large-scale indoor scenes from the S3DIS dataset, covering a range of complexities, sizes, and structures. The experimental section includes ablation studies and thorough comparisons with existing state-of-the-art spatial partitioning algorithms based on morphology and deep learning. Results demonstrate that the proposed method significantly outperforms existing approaches in terms of accuracy, robustness, and generalization ability, providing a solid foundation for indoor space modeling and robotic navigation. The source code and datasets will be made publicly available via the “<span><span>EISPGeo</span><svg><path></path></svg></span>” link.</div></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":\"135 \",\"pages\":\"Article 104265\"},\"PeriodicalIF\":7.6000,\"publicationDate\":\"2024-11-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843224006216\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843224006216","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
Back to geometry: Efficient indoor space segmentation from point clouds by 2D–3D geometry constrains
This paper addresses the challenge of indoor space segmentation from 3D point clouds, which is essential for understanding interior layouts, reconstructing 3D structures, and developing indoor navigation maps. While current deep learning-based methods rely on projecting 3D point clouds into 2D for instance extraction, they often fail to capture the local and global 3D features necessary for effectively segmenting complex indoor spaces, such as multi-ring nested structures. These methods also struggle with generalization across different scenes. In response, this paper proposes an efficient indoor space segmentation method that integrates both 2D and 3D geometric constraints. By leveraging the distribution characteristics of point clouds in 2D and the local and global features in 3D, the method achieves reliable extraction of vertical structural information in complex indoor environments. To address under-segmentation in small spaces due to varying scales, the paper introduces an adaptive extraction method for space partition anchors, guided by local features. During instance-level space segmentation, a hierarchical contour tree structure is employed to precisely partition complex indoor spaces, effectively handling circular and composite structures. The proposed approach was tested on 96 RGB-D scans from the Beike dataset and 6 large-scale indoor scenes from the S3DIS dataset, covering a range of complexities, sizes, and structures. The experimental section includes ablation studies and thorough comparisons with existing state-of-the-art spatial partitioning algorithms based on morphology and deep learning. Results demonstrate that the proposed method significantly outperforms existing approaches in terms of accuracy, robustness, and generalization ability, providing a solid foundation for indoor space modeling and robotic navigation. The source code and datasets will be made publicly available via the “EISPGeo” link.
期刊介绍:
The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.