首页 > 最新文献

2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)最新文献

英文 中文
Deep Learning-Based Enhancement of Hyperspectral Images Using Simulated Ground Truth 基于深度学习的基于模拟地面真值的高光谱图像增强
Pub Date : 2018-08-01 DOI: 10.1109/PRRS.2018.8486408
A. Nikonorov, M. Petrov, Sergei Bibikov, V. Kutikova, P. Yakimov, A. Morozov, R. Skidanov, N. Kazanskiy
The paper addresses the problem of imaging quality enhancement for the Offner hyperspectrometer using a convolutional neural network. We use a deep convolutional neural network with residual training and PReLU activation, inspired by the super-resolution task for RGB images. In the case of hyperspectral imaging, it is often a problem to find a large enough ground truth dataset for training a neural network from scratch. Transfer learning using the network pretrained for RGB images with some pre- and postprocessing is one of the possible workarounds. In this paper, we propose to simulate the necessary ground truth data using non-imaging spectrometer. The obtained dataset with partially simulated ground truth is then used to train the convolutional neural network directly for hyperspectral image quality enhancement. The proposed training approach also allows to incorporate distortions specific for hyperspectral images into the enhancement procedure. It allows to successfully remove the striping distortions inherent to the Offner scheme of image acquisition. The experimental results of the proposed approach show a significant quality gain.
本文利用卷积神经网络解决了奥夫纳超光谱仪成像质量的提高问题。受RGB图像超分辨率任务的启发,我们使用了带有残差训练和PReLU激活的深度卷积神经网络。在高光谱成像的情况下,找到足够大的地面真值数据集来从头开始训练神经网络通常是一个问题。使用RGB图像预训练的网络进行迁移学习并进行一些预处理和后处理是一种可能的解决方案。本文提出用非成像光谱仪模拟必要的地面真值数据。得到的数据集具有部分模拟的地面真值,然后用于直接训练卷积神经网络,用于高光谱图像质量增强。所提出的训练方法还允许将特定于高光谱图像的畸变纳入增强过程中。它允许成功地消除条纹畸变固有的Offner方案的图像采集。实验结果表明,该方法具有显著的质量增益。
{"title":"Deep Learning-Based Enhancement of Hyperspectral Images Using Simulated Ground Truth","authors":"A. Nikonorov, M. Petrov, Sergei Bibikov, V. Kutikova, P. Yakimov, A. Morozov, R. Skidanov, N. Kazanskiy","doi":"10.1109/PRRS.2018.8486408","DOIUrl":"https://doi.org/10.1109/PRRS.2018.8486408","url":null,"abstract":"The paper addresses the problem of imaging quality enhancement for the Offner hyperspectrometer using a convolutional neural network. We use a deep convolutional neural network with residual training and PReLU activation, inspired by the super-resolution task for RGB images. In the case of hyperspectral imaging, it is often a problem to find a large enough ground truth dataset for training a neural network from scratch. Transfer learning using the network pretrained for RGB images with some pre- and postprocessing is one of the possible workarounds. In this paper, we propose to simulate the necessary ground truth data using non-imaging spectrometer. The obtained dataset with partially simulated ground truth is then used to train the convolutional neural network directly for hyperspectral image quality enhancement. The proposed training approach also allows to incorporate distortions specific for hyperspectral images into the enhancement procedure. It allows to successfully remove the striping distortions inherent to the Offner scheme of image acquisition. The experimental results of the proposed approach show a significant quality gain.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127644935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Integration of Heterogeneous Features from Co-registered Hyperspectral and LiDAR Data for Land Cover Classification 结合高光谱和激光雷达数据的非均匀特征进行土地覆盖分类
Pub Date : 2018-08-01 DOI: 10.1109/PRRS44410.2018.9396733
Farah Jahan, Jun Zhou, M. Awrangjeb, Yongsheng Gao
Exploiting the multi-source data is an effective but challenging problem for land cover classification. Popular remote sensor data, e.g., hyperspectral (HS) and light detection and ranging (LiDAR), contain complementary information for land cover if they are co-registered. In this paper, we aim to integrate information extracted from these data sources for land cover classification. At first, we propose a novel feature extraction method by calculating the inverse coefficient of variation (ICV) using the Gaussian probability of neighbourhood between every pair of bands in HS data. This is calculated for each band with respect to every other band to form an ICV cube. We reduce the number of planes in the cube by applying principal component analysis (PCA) on it and spatial features are then extracted for significant principal components. The spectral information from HS data, their ICV responses, and spatial information from ICV responses have complementary information; that is why we fuse them together by layer stacking to generate discriminant features. Secondly, we also derive height and spatial features from LiDAR Digital Elevation Model (DSM), which are later concatenated with the HS derived features. Finally, these features are classified using linear discriminant analysis (LDA) classifier. The classification results prove the effectiveness of the derived features from both data sources.
利用多源数据进行土地覆盖分类是一个有效但具有挑战性的问题。流行的遥感数据,如高光谱(HS)和光探测和测距(LiDAR),如果它们共同注册,则包含有关土地覆盖的补充信息。在本文中,我们的目标是整合从这些数据源中提取的信息进行土地覆盖分类。首先,我们提出了一种新的特征提取方法,即利用HS数据中每对波段之间的高斯邻域概率来计算变异系数逆(ICV)。这是计算每个波段相对于其他波段形成一个ICV立方体。我们通过主成分分析(PCA)减少立方体中的平面数量,然后提取重要主成分的空间特征。HS数据的光谱信息、ICV响应信息和ICV响应的空间信息具有互补信息;这就是为什么我们通过层堆叠将它们融合在一起以生成判别特征。其次,我们还从激光雷达数字高程模型(DSM)中导出高度和空间特征,然后将其与HS导出的特征进行连接。最后,使用线性判别分析(LDA)分类器对这些特征进行分类。分类结果证明了从两个数据源中提取的特征的有效性。
{"title":"Integration of Heterogeneous Features from Co-registered Hyperspectral and LiDAR Data for Land Cover Classification","authors":"Farah Jahan, Jun Zhou, M. Awrangjeb, Yongsheng Gao","doi":"10.1109/PRRS44410.2018.9396733","DOIUrl":"https://doi.org/10.1109/PRRS44410.2018.9396733","url":null,"abstract":"Exploiting the multi-source data is an effective but challenging problem for land cover classification. Popular remote sensor data, e.g., hyperspectral (HS) and light detection and ranging (LiDAR), contain complementary information for land cover if they are co-registered. In this paper, we aim to integrate information extracted from these data sources for land cover classification. At first, we propose a novel feature extraction method by calculating the inverse coefficient of variation (ICV) using the Gaussian probability of neighbourhood between every pair of bands in HS data. This is calculated for each band with respect to every other band to form an ICV cube. We reduce the number of planes in the cube by applying principal component analysis (PCA) on it and spatial features are then extracted for significant principal components. The spectral information from HS data, their ICV responses, and spatial information from ICV responses have complementary information; that is why we fuse them together by layer stacking to generate discriminant features. Secondly, we also derive height and spatial features from LiDAR Digital Elevation Model (DSM), which are later concatenated with the HS derived features. Finally, these features are classified using linear discriminant analysis (LDA) classifier. The classification results prove the effectiveness of the derived features from both data sources.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126092497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Monitoring and Assessment of the Space Pattern of Ports Based on GF-1 Satellite Remote-Sensing Images 基于GF-1卫星遥感影像的港口空间格局监测与评价
Pub Date : 2018-08-01 DOI: 10.1109/PRRS.2018.8486388
Xuchun Li, Huimin Xu, Fushan Zhang, A. Suo
In this paper, domestic GF-1 satellite remote sensing imagery is used to analyze the internal spatial pattern of the port and the characteristics of its constituent elements, and an object-oriented remote sensing monitoring method and process for port space pattern is established. The dock shoreline index and the dock coastline utilization index are explored and constructed. Dock index, storage yard index and dock basin index were used to evaluate the intensive use of port space patterns, and an empirical study was conducted in the Yingkou Bayuquan port area. The results showed that the dock shoreline index of Yingkou Bayuquan Port area was 0.51, the dock coastline utilization index was 15.08 million tons/km, the dock index was 12.23 hm2/km, the dock basin index was 242.76 hm2/km, and the storage yard index was 108.46 hm2/km. The utilization index of the dock coastline is basically 150 million tons/km, and the basic ratio of the dock and dock area, storage yard area and dock basin area is 1.00:12.00:108.00:250.00. Yingkou Bayuquan Port still has a potential of 88.21 million tons of throughput per year.
本文利用国产GF-1卫星遥感影像,对港口内部空间格局及其构成要素特征进行分析,建立了面向对象的港口空间格局遥感监测方法和流程。探索构建了码头岸线指数和码头岸线利用指数。采用码头指数、堆场指数和码头流域指数对港口空间集约利用模式进行评价,并以营口巴峪泉港区为研究对象进行了实证研究。结果表明:营口巴峪泉港区码头岸线指数为0.51,码头岸线利用指数为1508万吨/km,码头指数为12.23 hm2/km,码头流域指数为242.76 hm2/km,堆场指数为108.46 hm2/km。码头岸线利用指标基本为1.5亿吨/公里,码头与船坞面积、堆场面积、船坞盆地面积的基本比为1.00:12:108:250.00。营口八玉泉港年吞吐量仍有8821万吨的潜力。
{"title":"Monitoring and Assessment of the Space Pattern of Ports Based on GF-1 Satellite Remote-Sensing Images","authors":"Xuchun Li, Huimin Xu, Fushan Zhang, A. Suo","doi":"10.1109/PRRS.2018.8486388","DOIUrl":"https://doi.org/10.1109/PRRS.2018.8486388","url":null,"abstract":"In this paper, domestic GF-1 satellite remote sensing imagery is used to analyze the internal spatial pattern of the port and the characteristics of its constituent elements, and an object-oriented remote sensing monitoring method and process for port space pattern is established. The dock shoreline index and the dock coastline utilization index are explored and constructed. Dock index, storage yard index and dock basin index were used to evaluate the intensive use of port space patterns, and an empirical study was conducted in the Yingkou Bayuquan port area. The results showed that the dock shoreline index of Yingkou Bayuquan Port area was 0.51, the dock coastline utilization index was 15.08 million tons/km, the dock index was 12.23 hm2/km, the dock basin index was 242.76 hm2/km, and the storage yard index was 108.46 hm2/km. The utilization index of the dock coastline is basically 150 million tons/km, and the basic ratio of the dock and dock area, storage yard area and dock basin area is 1.00:12.00:108.00:250.00. Yingkou Bayuquan Port still has a potential of 88.21 million tons of throughput per year.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126116483","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
End-to-End Road Centerline Extraction via Learning a Confidence Map 端到端道路中心线提取通过学习一个置信度地图
Pub Date : 2018-08-01 DOI: 10.1109/PRRS.2018.8486185
Wei Yujun, Xiangyun Hu, Gong Jinqi
Road extraction from aerial and satellite image is one of complex and challenging tasks in remote sensing field. The task is required for a wide range of application, such as autonomous driving, urban planning and automatic mapping for GIS data collection. Most approaches cast the road extraction as image segmentation and use thinning algorithm to get road centerline. However, these methods can easily produce spurs around the true centerline which affects the accuracy of road centerline extraction and lacks the topology of road network. In this paper, we propose a novel method to directly extract accurate road centerline from aerial images and construct the topology of the road network. First, an end-to-end regression network based on convolutional neural network is designed to learn and predict a road centerline confidence map which is a 2D representation of the probability of each pixel to be on the road centerline. Our network combines multi-scale and multi-level feature information to produce refined confidence map. Then a canny-like non-maximum suppression is followed to attain accurate road centerline. Finally, we use spoke wheel to find the road direction of the initialized road center point and take advantage of road tracking to construct the topology of road network. The results on the Massachusetts Road dataset shows an significant improvement on the accuracy of location of extracted road centerline.
从航空和卫星图像中提取道路是遥感领域中复杂而富有挑战性的任务之一。该任务需要广泛的应用,如自动驾驶,城市规划和GIS数据收集的自动制图。大多数方法将道路提取作为图像分割,使用细化算法得到道路中心线。然而,这些方法容易在真实中心线周围产生杂散,影响道路中心线提取的精度,并且缺乏路网的拓扑结构。本文提出了一种从航拍图像中直接提取精确道路中心线并构建路网拓扑结构的新方法。首先,设计基于卷积神经网络的端到端回归网络来学习和预测道路中心线置信图,该置信图是每个像素在道路中心线上的概率的二维表示。我们的网络结合了多尺度和多层次的特征信息,生成了精细的置信图谱。然后采用非最大抑制法获得精确的道路中心线。最后,利用辐条轮求出初始化道路中心点的道路方向,并利用道路跟踪构造路网拓扑。在马萨诸塞州道路数据集上的结果表明,提取的道路中心线的定位精度有了显著提高。
{"title":"End-to-End Road Centerline Extraction via Learning a Confidence Map","authors":"Wei Yujun, Xiangyun Hu, Gong Jinqi","doi":"10.1109/PRRS.2018.8486185","DOIUrl":"https://doi.org/10.1109/PRRS.2018.8486185","url":null,"abstract":"Road extraction from aerial and satellite image is one of complex and challenging tasks in remote sensing field. The task is required for a wide range of application, such as autonomous driving, urban planning and automatic mapping for GIS data collection. Most approaches cast the road extraction as image segmentation and use thinning algorithm to get road centerline. However, these methods can easily produce spurs around the true centerline which affects the accuracy of road centerline extraction and lacks the topology of road network. In this paper, we propose a novel method to directly extract accurate road centerline from aerial images and construct the topology of the road network. First, an end-to-end regression network based on convolutional neural network is designed to learn and predict a road centerline confidence map which is a 2D representation of the probability of each pixel to be on the road centerline. Our network combines multi-scale and multi-level feature information to produce refined confidence map. Then a canny-like non-maximum suppression is followed to attain accurate road centerline. Finally, we use spoke wheel to find the road direction of the initialized road center point and take advantage of road tracking to construct the topology of road network. The results on the Massachusetts Road dataset shows an significant improvement on the accuracy of location of extracted road centerline.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114918935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
A Comparative Study on Airborne Lidar Waveform Decomposition Methods 机载激光雷达波形分解方法的比较研究
Pub Date : 2018-08-01 DOI: 10.1109/PRRS.2018.8486228
Qinghua Li, S. Ural, J. Shan
This paper applies pattern recognition methods to airborne lidar waveform decomposition. The parametric and nonparametric approaches are compared in the experiments. The popular Gaussian mixture model (GMM) and expectation-maximization (EM) decomposition algorithm are selected as the parametric approach. Nonparametric mixture model (NMM) and fuzzy mean-shift (FMS) are used as the nonparametric approach. We first run our experiment on simulated waveforms. The experiment setup is in favor of the parametric approach because GMM is used to generate the waveforms. We show that both parametric and nonparametric approaches return satisfying results on the simulated mixture of Gaussian components. In the second experiment, real data acquired with an airborne lidar are used. We find that NMM fits the data better than GMM because the Gaussian assumption is not well satisfied in the real dataset. Considering that the emitted signals of a laser scanner may even not satisfy the Gaussian assumption, we conclude that nonparametric approaches should generally be utilized for practical applications.
本文将模式识别方法应用于机载激光雷达的波形分解。在实验中对参数方法和非参数方法进行了比较。选取流行的高斯混合模型(GMM)和期望最大化(EM)分解算法作为参数化方法。采用非参数混合模型(NMM)和模糊均值移(FMS)作为非参数方法。我们首先在模拟波形上进行实验。实验设置有利于参数化方法,因为使用GMM来产生波形。我们证明了参数和非参数方法在模拟高斯分量的混合上都能得到令人满意的结果。在第二个实验中,使用机载激光雷达获得的真实数据。我们发现NMM比GMM更适合数据,因为在真实数据集中高斯假设不能很好地满足。考虑到激光扫描仪的发射信号甚至可能不满足高斯假设,我们得出结论,非参数方法通常应用于实际应用。
{"title":"A Comparative Study on Airborne Lidar Waveform Decomposition Methods","authors":"Qinghua Li, S. Ural, J. Shan","doi":"10.1109/PRRS.2018.8486228","DOIUrl":"https://doi.org/10.1109/PRRS.2018.8486228","url":null,"abstract":"This paper applies pattern recognition methods to airborne lidar waveform decomposition. The parametric and nonparametric approaches are compared in the experiments. The popular Gaussian mixture model (GMM) and expectation-maximization (EM) decomposition algorithm are selected as the parametric approach. Nonparametric mixture model (NMM) and fuzzy mean-shift (FMS) are used as the nonparametric approach. We first run our experiment on simulated waveforms. The experiment setup is in favor of the parametric approach because GMM is used to generate the waveforms. We show that both parametric and nonparametric approaches return satisfying results on the simulated mixture of Gaussian components. In the second experiment, real data acquired with an airborne lidar are used. We find that NMM fits the data better than GMM because the Gaussian assumption is not well satisfied in the real dataset. Considering that the emitted signals of a laser scanner may even not satisfy the Gaussian assumption, we conclude that nonparametric approaches should generally be utilized for practical applications.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133734839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Neighbor Consistency Baced Unsupervised Manifold Alignment for Classification of Remote Sensing Image 基于邻域一致性的无监督流形对准遥感图像分类
Pub Date : 2018-08-01 DOI: 10.1109/PRRS.2018.8486168
Chuang Luo, Li Ma
We perform unsupervised domain adaptation for classification of remote sensing images by exploiting unsupervised manifold alignment approach. Manifold alignment method utilized corresponding points between domains to align data manifolds of source and target domains, where the corresponding points can be constructed by labeled information. Supposing labeled samples are not available in target domain, we proposed neighbor consistency (NC) constraint to select some target points that have reliable predictions. These points and labeled source data are then used to construct corresponding relationships, resulting in unsupervised manifold alignment. The neighbor consistency based unsupervised manifold alignment is denoted as NCUMA in this paper. Both multispectral and hyperspectral remote sensing data have been used to demonstrate the effectiveness of the NCUMA approach.
我们利用无监督流形对齐方法对遥感图像进行无监督域自适应分类。流形对齐方法利用域间的对应点对源域和目标域的数据流形进行对齐,其中对应点可以通过标记信息来构造。假设目标域中没有标记样本,提出邻域一致性约束,选择具有可靠预测的目标点。然后使用这些点和标记的源数据来构建相应的关系,从而产生无监督的流形对齐。本文将基于邻居一致性的无监督流形对齐方法称为NCUMA。利用多光谱和高光谱遥感数据验证了NCUMA方法的有效性。
{"title":"Neighbor Consistency Baced Unsupervised Manifold Alignment for Classification of Remote Sensing Image","authors":"Chuang Luo, Li Ma","doi":"10.1109/PRRS.2018.8486168","DOIUrl":"https://doi.org/10.1109/PRRS.2018.8486168","url":null,"abstract":"We perform unsupervised domain adaptation for classification of remote sensing images by exploiting unsupervised manifold alignment approach. Manifold alignment method utilized corresponding points between domains to align data manifolds of source and target domains, where the corresponding points can be constructed by labeled information. Supposing labeled samples are not available in target domain, we proposed neighbor consistency (NC) constraint to select some target points that have reliable predictions. These points and labeled source data are then used to construct corresponding relationships, resulting in unsupervised manifold alignment. The neighbor consistency based unsupervised manifold alignment is denoted as NCUMA in this paper. Both multispectral and hyperspectral remote sensing data have been used to demonstrate the effectiveness of the NCUMA approach.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116998237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Integrating Active Learning and Contextually Guide for Semantic Labeling of LiDAR Point Cloud 集成主动学习和上下文引导的激光雷达点云语义标注
Pub Date : 2018-08-01 DOI: 10.1109/PRRS.2018.8486166
Tengping Jiang, Yongjun Wang, Shuaibing Tao, Yunli Li, Shan Liu
To alleviate the difficulties in obtaining training data sets of 3D point clouds, an active learning (AL) framework is proposed to iteratively select a small portion of unlabeled points to query their labels, and creates a minimum manually-annotated training set. To handle the biased sampling problem caused by category imbalance and local similarities, a neighbor-consistency prior is used to conduct an unbiased sampling for selecting the value samples into the training set. Additionally, to reduce the number of categories used in labeling, a higher-order MRF containing a regional label cost term, is exploited to refine the labeling results.
为了解决三维点云训练数据集获取困难的问题,提出了一种主动学习框架,迭代选择一小部分未标记点进行标记查询,生成最小人工标注训练集。为了解决类别不平衡和局部相似导致的偏抽样问题,采用邻居一致性先验进行无偏抽样,选择训练集中的值样本。此外,为了减少标签中使用的类别数量,利用包含区域标签成本项的高阶MRF来改进标签结果。
{"title":"Integrating Active Learning and Contextually Guide for Semantic Labeling of LiDAR Point Cloud","authors":"Tengping Jiang, Yongjun Wang, Shuaibing Tao, Yunli Li, Shan Liu","doi":"10.1109/PRRS.2018.8486166","DOIUrl":"https://doi.org/10.1109/PRRS.2018.8486166","url":null,"abstract":"To alleviate the difficulties in obtaining training data sets of 3D point clouds, an active learning (AL) framework is proposed to iteratively select a small portion of unlabeled points to query their labels, and creates a minimum manually-annotated training set. To handle the biased sampling problem caused by category imbalance and local similarities, a neighbor-consistency prior is used to conduct an unbiased sampling for selecting the value samples into the training set. Additionally, to reduce the number of categories used in labeling, a higher-order MRF containing a regional label cost term, is exploited to refine the labeling results.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115432416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Instance Segmentation of Trees in Urban Areas from MLS Point Clouds Using Supervoxel Contexts and Graph-Based Optimization 基于超体素上下文和图优化的MLS点云城市树木实例分割
Pub Date : 2018-08-01 DOI: 10.1109/PRRS.2018.8486220
Yusheng Xu, Zhenghao Sun, L. Hoegner, Uwe Stilla, W. Yao
In this paper, an instance segmentation method for tree extraction from MLS data sets in urban scenes is developed. The proposed method utilizes a supervoxel structure to organize the point clouds, and then extracts the detrended geometric features from the local context of supervoxels. Combined with the detrended features of the local context, the Random Forest (RF) classifier will be adopted to obtain the initial semantic labeling results of trees from point clouds. Afterwards, a local context-based regularization is iteratively performed to achieve global optimum on a global graphical model, in order to spatially smoothing the semantic labeling results. Finally, a graph-based segmentation is conducted to separate individual trees according to the semantic labeling results. The use of supervoxel structure can preserve the geometric boundaries of objects in the scene, and compared with point-based solutions, the supervoxel-based method can largely decrease the number of basic elements during the processing. Besides, the introduction of supervoxel contexts can extract the local information of an object making the feature extraction more robust and representative. Detrended geometric features can get over the redundant and in-salient information in the local context, so that discriminative features are obtained. Benefiting from the regularization process, the spatial smoothing is obtained based on initial labeling results from classic classifications such as RF classification. As a result, misclassification errors are removed to a large degree and semantic labeling results are thus smoothed. Based on the constructed global graphical model during the spatially smoothing process, a graph-based segmentation is applied to partition the graphical model for the clustering the instances of trees. The experiments on two test datasets have shown promising results, with an accuracy of the semantic labeling of trees reaching around 0.9. The segmentation of trees using graph-based algorithm also show acceptable results, with trees having simple structures and sparse distributions correctly separated, but for those cramped trees with complex structures, the points are over- or under-segmented.
本文提出了一种城市场景MLS数据集的实例分割方法。该方法利用超体素结构对点云进行组织,然后从超体素局部环境中提取去趋势的几何特征。结合局部上下文的去趋势特征,采用随机森林(Random Forest, RF)分类器从点云中获得树的初始语义标注结果。然后,对全局图形模型进行基于局部上下文的正则化迭代,实现全局最优,使语义标注结果在空间上平滑。最后,根据语义标注结果进行基于图的分割,分离出单个树。使用超体素结构可以保持场景中物体的几何边界,与基于点的方法相比,基于超体素的方法可以大大减少处理过程中基本元素的数量。此外,超体素上下文的引入可以提取对象的局部信息,使特征提取更具鲁棒性和代表性。去趋势几何特征可以克服局部环境中的冗余和不显著信息,从而得到判别特征。利用正则化过程,基于经典分类(如RF分类)的初始标记结果获得空间平滑。因此,在很大程度上消除了误分类错误,从而平滑了语义标注结果。在空间平滑过程中构建全局图形模型的基础上,采用基于图的分割方法对图形模型进行分割,用于对树实例进行聚类。在两个测试数据集上的实验显示了很好的结果,树的语义标记的准确性达到了0.9左右。使用基于图的算法对树进行分割也显示出可以接受的结果,结构简单、分布稀疏的树被正确分割,但对于结构复杂的局域树,则存在点分割过度或点分割不足的问题。
{"title":"Instance Segmentation of Trees in Urban Areas from MLS Point Clouds Using Supervoxel Contexts and Graph-Based Optimization","authors":"Yusheng Xu, Zhenghao Sun, L. Hoegner, Uwe Stilla, W. Yao","doi":"10.1109/PRRS.2018.8486220","DOIUrl":"https://doi.org/10.1109/PRRS.2018.8486220","url":null,"abstract":"In this paper, an instance segmentation method for tree extraction from MLS data sets in urban scenes is developed. The proposed method utilizes a supervoxel structure to organize the point clouds, and then extracts the detrended geometric features from the local context of supervoxels. Combined with the detrended features of the local context, the Random Forest (RF) classifier will be adopted to obtain the initial semantic labeling results of trees from point clouds. Afterwards, a local context-based regularization is iteratively performed to achieve global optimum on a global graphical model, in order to spatially smoothing the semantic labeling results. Finally, a graph-based segmentation is conducted to separate individual trees according to the semantic labeling results. The use of supervoxel structure can preserve the geometric boundaries of objects in the scene, and compared with point-based solutions, the supervoxel-based method can largely decrease the number of basic elements during the processing. Besides, the introduction of supervoxel contexts can extract the local information of an object making the feature extraction more robust and representative. Detrended geometric features can get over the redundant and in-salient information in the local context, so that discriminative features are obtained. Benefiting from the regularization process, the spatial smoothing is obtained based on initial labeling results from classic classifications such as RF classification. As a result, misclassification errors are removed to a large degree and semantic labeling results are thus smoothed. Based on the constructed global graphical model during the spatially smoothing process, a graph-based segmentation is applied to partition the graphical model for the clustering the instances of trees. The experiments on two test datasets have shown promising results, with an accuracy of the semantic labeling of trees reaching around 0.9. The segmentation of trees using graph-based algorithm also show acceptable results, with trees having simple structures and sparse distributions correctly separated, but for those cramped trees with complex structures, the points are over- or under-segmented.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114851195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Sensitivity Analysis on Performance of Different Unsupervised Threshold Selection Methods in Hyperspectral Change Detection 不同无监督阈值选择方法在高光谱变化检测中的灵敏度分析
Pub Date : 2018-08-01 DOI: 10.1109/PRRS.2018.8486355
Mahdi Hasanlau, S. T. Seydi
This paper investigated the performance of different automatic binary threshold selection methods on hyperspectral change detection. For this purpose, 10 recent and most common algorithm for binary threshold selection implemented namely and evaluated. To evaluate these methods first, the sub-space based hyperspectral change detection method applied on the multi-temporal hyperspectral dataset. In the second part, the gray level change map converts to binary change map by mentioned thresholding methods. In this work, real-world hyperspectral dataset utilized to evaluate the related performance of threshold selection methods. The results show that Active-Contour method has high efficiency in comparison to other methods with overall accuracy more than 93.53% and a kappa coefficient of 0.851.
研究了不同的自动二值阈值选择方法在高光谱变化检测中的性能。为此,对10种最新最常用的二值阈值选择算法进行了实现和评价。为了对这些方法进行评价,首先将基于子空间的高光谱变化检测方法应用于多时相高光谱数据集。在第二部分中,通过上述阈值化方法将灰度变化图转换为二值变化图。本研究利用真实高光谱数据集对阈值选择方法的相关性能进行了评价。结果表明,与其他方法相比,主动轮廓法具有较高的效率,总体精度超过93.53%,kappa系数为0.851。
{"title":"Sensitivity Analysis on Performance of Different Unsupervised Threshold Selection Methods in Hyperspectral Change Detection","authors":"Mahdi Hasanlau, S. T. Seydi","doi":"10.1109/PRRS.2018.8486355","DOIUrl":"https://doi.org/10.1109/PRRS.2018.8486355","url":null,"abstract":"This paper investigated the performance of different automatic binary threshold selection methods on hyperspectral change detection. For this purpose, 10 recent and most common algorithm for binary threshold selection implemented namely and evaluated. To evaluate these methods first, the sub-space based hyperspectral change detection method applied on the multi-temporal hyperspectral dataset. In the second part, the gray level change map converts to binary change map by mentioned thresholding methods. In this work, real-world hyperspectral dataset utilized to evaluate the related performance of threshold selection methods. The results show that Active-Contour method has high efficiency in comparison to other methods with overall accuracy more than 93.53% and a kappa coefficient of 0.851.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129640519","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Multi-Modal Human Detection from Aerial Views by Fast Shape-Aware Clustering and Classification 基于快速形状感知聚类和分类的鸟瞰图多模态人体检测
Pub Date : 2018-08-01 DOI: 10.1109/PRRS.2018.8486236
Csaba Beleznai, Daniel Steininger, G. Croonen, Elisabeth Broneder
Recognizing humans from aerial views represents an increasingly relevant endeavor; a trend mainly driven by the widespread use of unmanned aerial vehicles (UAVs). An accurate and real-time visual human recognition task, however, represents a scientific challenge because typical UAV imaging and computational capabilities and conditions introduce complexities and constraints. Motion blur, the non-specific top-view appearance of humans, low-image resolution and limited onboard computational resources are among the most important limiting factors to be considered. In this paper we propose a run-time-efficient multi-modal detection framework performing clustering and recognition on thermal infrared, passive stereo depth and intensity channels in order to cope with the above complexities and to achieve accurate human detection results. Thermal infrared and depth data are used to generate proposals in combination with an explicit, tree-structured shape representation driven clustering scheme. Generated proposals are used as an input for a discriminatively trained deep classification step to recognize humans. The proposed clustering and classification scheme is validated in qualitative and quantitative terms on four large aerial datasets representing complex (small objects, clutter, occlusions) situations.
从鸟瞰图中识别人类代表着一项日益相关的努力;这一趋势主要是由无人驾驶飞行器的广泛使用推动的。然而,精确和实时的视觉人类识别任务代表了一项科学挑战,因为典型的无人机成像和计算能力和条件引入了复杂性和限制。运动模糊、人类的非特定俯视图外观、低图像分辨率和有限的机载计算资源是需要考虑的最重要的限制因素。本文提出了一种运行时高效的多模态检测框架,对热红外、被动立体深度和强度通道进行聚类和识别,以应对上述复杂性,并获得准确的人体检测结果。利用热红外和深度数据结合明确的树状结构形状表示驱动的聚类方案生成建议。生成的建议被用作判别训练的深度分类步骤的输入,以识别人类。在代表复杂情况(小目标、杂波、遮挡)的四个大型航空数据集上,对所提出的聚类和分类方案进行了定性和定量验证。
{"title":"Multi-Modal Human Detection from Aerial Views by Fast Shape-Aware Clustering and Classification","authors":"Csaba Beleznai, Daniel Steininger, G. Croonen, Elisabeth Broneder","doi":"10.1109/PRRS.2018.8486236","DOIUrl":"https://doi.org/10.1109/PRRS.2018.8486236","url":null,"abstract":"Recognizing humans from aerial views represents an increasingly relevant endeavor; a trend mainly driven by the widespread use of unmanned aerial vehicles (UAVs). An accurate and real-time visual human recognition task, however, represents a scientific challenge because typical UAV imaging and computational capabilities and conditions introduce complexities and constraints. Motion blur, the non-specific top-view appearance of humans, low-image resolution and limited onboard computational resources are among the most important limiting factors to be considered. In this paper we propose a run-time-efficient multi-modal detection framework performing clustering and recognition on thermal infrared, passive stereo depth and intensity channels in order to cope with the above complexities and to achieve accurate human detection results. Thermal infrared and depth data are used to generate proposals in combination with an explicit, tree-structured shape representation driven clustering scheme. Generated proposals are used as an input for a discriminatively trained deep classification step to recognize humans. The proposed clustering and classification scheme is validated in qualitative and quantitative terms on four large aerial datasets representing complex (small objects, clutter, occlusions) situations.","PeriodicalId":197319,"journal":{"name":"2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125746746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
期刊
2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1