DetailPoint:利用注意力机制对点云进行详细特征学习

IF 2.4 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Machine Vision and Applications Pub Date : 2023-12-18 DOI:10.1007/s00138-023-01491-2
Ying Li, Jincheng Bai, Huankun Sheng
{"title":"DetailPoint:利用注意力机制对点云进行详细特征学习","authors":"Ying Li, Jincheng Bai, Huankun Sheng","doi":"10.1007/s00138-023-01491-2","DOIUrl":null,"url":null,"abstract":"<p>Point cloud analysis is an important part of 3D geometric processing. It has been widely used in many fields, such as automatic driving and robots. Although great progress has been made in recent years, there are still some unresolved problems. For example, current methods devote employing MLP to extract local features after search k neighbor points, they cannot effectively model the dependency relationship between the anchor point and k neighboring points. In addition, the prevailing models may not exploit the inherent structural similarities present in the global scope. To solve these issues, we propose a feature extraction model named DetailPoint to get detailed local information and long-range global dependency of point clouds. DetailPoint possess three units: the shallow local learning unit, the deep local learning unit and the deep global learning unit. We first use the SLL to extract shallow local features, and then use the DLL to learn deep local features. In these two units, we design a dual-path extraction method to acquire detail local features with dependencies. Finally, the DGL unit is employed to improve the generalization ability of local features and establish global interaction. These three units are connected in series to form our DetailPoint. We evaluated the performance of our model on four datasets, ScanObjectNN and ModelNet40 for shape classification, the ShapeNet dataset for part segmentation, and the S3DIS dataset for sementatic segmentations. The experimental results demonstrate that DetailPoint is capable of expressing point clouds more effectively, resulting in superior performance compared to existing methods.</p>","PeriodicalId":51116,"journal":{"name":"Machine Vision and Applications","volume":"72 1","pages":""},"PeriodicalIF":2.4000,"publicationDate":"2023-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DetailPoint: detailed feature learning on point clouds with attention mechanism\",\"authors\":\"Ying Li, Jincheng Bai, Huankun Sheng\",\"doi\":\"10.1007/s00138-023-01491-2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Point cloud analysis is an important part of 3D geometric processing. It has been widely used in many fields, such as automatic driving and robots. Although great progress has been made in recent years, there are still some unresolved problems. For example, current methods devote employing MLP to extract local features after search k neighbor points, they cannot effectively model the dependency relationship between the anchor point and k neighboring points. In addition, the prevailing models may not exploit the inherent structural similarities present in the global scope. To solve these issues, we propose a feature extraction model named DetailPoint to get detailed local information and long-range global dependency of point clouds. DetailPoint possess three units: the shallow local learning unit, the deep local learning unit and the deep global learning unit. We first use the SLL to extract shallow local features, and then use the DLL to learn deep local features. In these two units, we design a dual-path extraction method to acquire detail local features with dependencies. Finally, the DGL unit is employed to improve the generalization ability of local features and establish global interaction. These three units are connected in series to form our DetailPoint. We evaluated the performance of our model on four datasets, ScanObjectNN and ModelNet40 for shape classification, the ShapeNet dataset for part segmentation, and the S3DIS dataset for sementatic segmentations. The experimental results demonstrate that DetailPoint is capable of expressing point clouds more effectively, resulting in superior performance compared to existing methods.</p>\",\"PeriodicalId\":51116,\"journal\":{\"name\":\"Machine Vision and Applications\",\"volume\":\"72 1\",\"pages\":\"\"},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2023-12-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Machine Vision and Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s00138-023-01491-2\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Machine Vision and Applications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s00138-023-01491-2","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

点云分析是三维几何处理的重要组成部分。它已被广泛应用于自动驾驶和机器人等多个领域。尽管近年来点云分析取得了长足进步,但仍存在一些尚未解决的问题。例如,目前的方法致力于在搜索 k 个邻近点后采用 MLP 提取局部特征,但无法有效地模拟锚点与 k 个邻近点之间的依赖关系。此外,现有模型可能无法利用全局范围内存在的固有结构相似性。为了解决这些问题,我们提出了一种名为 DetailPoint 的特征提取模型,用于获取点云的详细局部信息和长距离全局依赖关系。DetailPoint 拥有三个单元:浅层局部学习单元、深层局部学习单元和深层全局学习单元。我们首先使用 SLL 提取浅层局部特征,然后使用 DLL 学习深层局部特征。在这两个单元中,我们设计了一种双路径提取方法,以获取具有依赖性的局部细节特征。最后,利用 DGL 单元提高局部特征的泛化能力,并建立全局交互。这三个单元串联起来就形成了我们的 DetailPoint。我们在四个数据集上评估了模型的性能:ScanObjectNN 和 ModelNet40 用于形状分类,ShapeNet 数据集用于部件分割,S3DIS 数据集用于静态分割。实验结果表明,DetailPoint 能够更有效地表达点云,与现有方法相比性能更优。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
DetailPoint: detailed feature learning on point clouds with attention mechanism

Point cloud analysis is an important part of 3D geometric processing. It has been widely used in many fields, such as automatic driving and robots. Although great progress has been made in recent years, there are still some unresolved problems. For example, current methods devote employing MLP to extract local features after search k neighbor points, they cannot effectively model the dependency relationship between the anchor point and k neighboring points. In addition, the prevailing models may not exploit the inherent structural similarities present in the global scope. To solve these issues, we propose a feature extraction model named DetailPoint to get detailed local information and long-range global dependency of point clouds. DetailPoint possess three units: the shallow local learning unit, the deep local learning unit and the deep global learning unit. We first use the SLL to extract shallow local features, and then use the DLL to learn deep local features. In these two units, we design a dual-path extraction method to acquire detail local features with dependencies. Finally, the DGL unit is employed to improve the generalization ability of local features and establish global interaction. These three units are connected in series to form our DetailPoint. We evaluated the performance of our model on four datasets, ScanObjectNN and ModelNet40 for shape classification, the ShapeNet dataset for part segmentation, and the S3DIS dataset for sementatic segmentations. The experimental results demonstrate that DetailPoint is capable of expressing point clouds more effectively, resulting in superior performance compared to existing methods.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Machine Vision and Applications
Machine Vision and Applications 工程技术-工程:电子与电气
CiteScore
6.30
自引率
3.00%
发文量
84
审稿时长
8.7 months
期刊介绍: Machine Vision and Applications publishes high-quality technical contributions in machine vision research and development. Specifically, the editors encourage submittals in all applications and engineering aspects of image-related computing. In particular, original contributions dealing with scientific, commercial, industrial, military, and biomedical applications of machine vision, are all within the scope of the journal. Particular emphasis is placed on engineering and technology aspects of image processing and computer vision. The following aspects of machine vision applications are of interest: algorithms, architectures, VLSI implementations, AI techniques and expert systems for machine vision, front-end sensing, multidimensional and multisensor machine vision, real-time techniques, image databases, virtual reality and visualization. Papers must include a significant experimental validation component.
期刊最新文献
A novel key point based ROI segmentation and image captioning using guidance information Specular Surface Detection with Deep Static Specular Flow and Highlight Removing cloud shadows from ground-based solar imagery Underwater image object detection based on multi-scale feature fusion Object Recognition Consistency in Regression for Active Detection
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1