Pub Date : 2023-11-09DOI: 10.1080/19479832.2023.2278671
Li Ma, Lei Huang
ABSTRACTTo address the issues of inaccurate estimation of registration parameters and high mismatch rate in feature based remote sensing image registration, a registration method based on global feature triangle similarity is proposed. This method utilizes the similarity principle of feature triangles to evaluate the global geometric similarity of matching feature points to eliminate mismatched points. In addition, due to the sensitivity of phase information in the frequency domain to spatial transformations and structural differences, as well as its robustness to lighting and noise, a phase structure consistency measurement method is proposed for developing feature point position adjustment strategies. The results indicate that the registration method proposed by the research institute achieved the lowest RMSE with a size of 1.51. In terms of IRMSE indicators, compared to the RANSAC measurement model, the PH SSIM measurement model has a mean decrease of 0.253. This indicates that the improved registration model proposed in the study has advantages in improving registration accuracy. The innovation of this study lies in constructing a matching feature point evaluation model to eliminate mismatched points, and proposing a remote sensing image registration method based on mismatch point removal and feature point position adjustment.KEYWORDS: Baker mappingregistration accuracymisalignment pointsfeature pointsRMSEPH-SSIM Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationFundingThe research is supported by: Scientific Research and Innovation Team of Chongqing Youth Vocational & Technical College, Enterprise Software Application Digital Transformation Technology Service Team (No., CQYFUTD202207).
{"title":"Research on multi-source remote sensing image registration technology based on Baker mapping","authors":"Li Ma, Lei Huang","doi":"10.1080/19479832.2023.2278671","DOIUrl":"https://doi.org/10.1080/19479832.2023.2278671","url":null,"abstract":"ABSTRACTTo address the issues of inaccurate estimation of registration parameters and high mismatch rate in feature based remote sensing image registration, a registration method based on global feature triangle similarity is proposed. This method utilizes the similarity principle of feature triangles to evaluate the global geometric similarity of matching feature points to eliminate mismatched points. In addition, due to the sensitivity of phase information in the frequency domain to spatial transformations and structural differences, as well as its robustness to lighting and noise, a phase structure consistency measurement method is proposed for developing feature point position adjustment strategies. The results indicate that the registration method proposed by the research institute achieved the lowest RMSE with a size of 1.51. In terms of IRMSE indicators, compared to the RANSAC measurement model, the PH SSIM measurement model has a mean decrease of 0.253. This indicates that the improved registration model proposed in the study has advantages in improving registration accuracy. The innovation of this study lies in constructing a matching feature point evaluation model to eliminate mismatched points, and proposing a remote sensing image registration method based on mismatch point removal and feature point position adjustment.KEYWORDS: Baker mappingregistration accuracymisalignment pointsfeature pointsRMSEPH-SSIM Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationFundingThe research is supported by: Scientific Research and Innovation Team of Chongqing Youth Vocational & Technical College, Enterprise Software Application Digital Transformation Technology Service Team (No., CQYFUTD202207).","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":" 7","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135243971","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1080/19479832.2023.2252817
Yhesly López, E. Pawelko, Daniel Nisperuza
ABSTRACT As an alternative to the current technologies, we explored the feasibility of using low cost and massive use of digital cameras as photometric sensors to retrieve the atmospheric total optical depth (τ) in the urban area of a city in the Colombian Andes. This study proposes a simple way to estimate τ from digital processing of images of the Sun based on the Beer-Bouguer-Lambert law Langley’s linear fitting for the colour levels in channels red, green, and blue registered by the pixels of cameras’ sensors. From February to March 2022, the τ values retrieved from the images were correlated to the retrieved values from a solar spectral radiometer (SSR). We found that τ is sensible to the featured changes in the local atmosphere and to the cameras’ exposure parameters setup. Under conditions of partly clear sky, around 80% (r > 0.8) of the τ values from cameras showed a linear correspondence to those retrieved from SSR system. Its spectral dependency (τ _red < τ _green < τ _blue) is in accordance with the physical phenomena in light-atmosphere interaction. The results suggest that the methodology applied can be used for monitoring the atmosphere at any geographical location in the world.
{"title":"Digital image processing for atmospheric monitoring at Colombian Andes","authors":"Yhesly López, E. Pawelko, Daniel Nisperuza","doi":"10.1080/19479832.2023.2252817","DOIUrl":"https://doi.org/10.1080/19479832.2023.2252817","url":null,"abstract":"ABSTRACT As an alternative to the current technologies, we explored the feasibility of using low cost and massive use of digital cameras as photometric sensors to retrieve the atmospheric total optical depth (τ) in the urban area of a city in the Colombian Andes. This study proposes a simple way to estimate τ from digital processing of images of the Sun based on the Beer-Bouguer-Lambert law Langley’s linear fitting for the colour levels in channels red, green, and blue registered by the pixels of cameras’ sensors. From February to March 2022, the τ values retrieved from the images were correlated to the retrieved values from a solar spectral radiometer (SSR). We found that τ is sensible to the featured changes in the local atmosphere and to the cameras’ exposure parameters setup. Under conditions of partly clear sky, around 80% (r > 0.8) of the τ values from cameras showed a linear correspondence to those retrieved from SSR system. Its spectral dependency (τ _red < τ _green < τ _blue) is in accordance with the physical phenomena in light-atmosphere interaction. The results suggest that the methodology applied can be used for monitoring the atmosphere at any geographical location in the world.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"14 1","pages":"324 - 335"},"PeriodicalIF":2.3,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41985302","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1080/19479832.2023.2252818
Anupam Pandey, Arun Mondal, S. Guha, P. K. Upadhyay, Rashmi, S. Kundu
ABSTRACT The present study analyses the seasonal influence of error estimated in downscaled land surface temperatures (LSTs) in a humid subtropical city using Landsat 8 data of summer and winter seasons in 2021. Thermal sharpening (TsHARP) algorithm is one of the most frequently used downscaling techniques which is originally based on normalised difference vegetation index (NDVI). This study assesses the capability of the TsHARP technique with a separate combination of four selected spectral indices (modified normalised difference water index, normalised difference bareness index, normalised difference built-up index [NDBI], and NDVI), and by determining the root mean square error (RMSE) and mean error produced by the sharpened LST. Besides, sharpened LST has also been estimated by combining the four spectral indices. It is observed that NDBI provides the most effective output (RMSE is 1.11 [30 m], 1.05 [120 m], 1.02 [240 m], and 0.99 [480 m] in summer, whereas RMSE is 0.61 [30 m], 0.59 [120 m], 0.57 [240 m], and 0.56 [480 m] in winter). NDBI-based sharpened LST generates the best relationship (R = 0.565 in summer and R = 0.537 in winter) with surface features. Fallow land generates the best relationship (R = 0.512 in summer and R = 0.530 in winter) with sharpened LST. The summer season (R = 0.438) generates a better relationship between surface features and sharpened LST than the winter season (R = 0.409).
{"title":"Analysis of spectral indices-based downscaled land surface temperature in a humid subtropical city","authors":"Anupam Pandey, Arun Mondal, S. Guha, P. K. Upadhyay, Rashmi, S. Kundu","doi":"10.1080/19479832.2023.2252818","DOIUrl":"https://doi.org/10.1080/19479832.2023.2252818","url":null,"abstract":"ABSTRACT The present study analyses the seasonal influence of error estimated in downscaled land surface temperatures (LSTs) in a humid subtropical city using Landsat 8 data of summer and winter seasons in 2021. Thermal sharpening (TsHARP) algorithm is one of the most frequently used downscaling techniques which is originally based on normalised difference vegetation index (NDVI). This study assesses the capability of the TsHARP technique with a separate combination of four selected spectral indices (modified normalised difference water index, normalised difference bareness index, normalised difference built-up index [NDBI], and NDVI), and by determining the root mean square error (RMSE) and mean error produced by the sharpened LST. Besides, sharpened LST has also been estimated by combining the four spectral indices. It is observed that NDBI provides the most effective output (RMSE is 1.11 [30 m], 1.05 [120 m], 1.02 [240 m], and 0.99 [480 m] in summer, whereas RMSE is 0.61 [30 m], 0.59 [120 m], 0.57 [240 m], and 0.56 [480 m] in winter). NDBI-based sharpened LST generates the best relationship (R = 0.565 in summer and R = 0.537 in winter) with surface features. Fallow land generates the best relationship (R = 0.512 in summer and R = 0.530 in winter) with sharpened LST. The summer season (R = 0.438) generates a better relationship between surface features and sharpened LST than the winter season (R = 0.409).","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"14 1","pages":"336 - 358"},"PeriodicalIF":2.3,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46878403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-06-05DOI: 10.1080/19479832.2023.2218376
Hiba Al-Assaad, C. Boucher, A. Daher, Ahmad Shahin, J. Noyer
ABSTRACT Recently, smart mobility has become a important activity in transportation systems such as public, autonomous and shared transports. These systems require reliable navigation applications that lead to precise localisation and optimised route. The GPS system may face problems such as signal degradation caused by conical effects, affecting the reliability and accuracy of the signal, or signal loss in poor visibility environments. By using other sensors, the vehicle location system can overcome these GPS problems. This work focuses on the estimation of the inclination, which will be used to optimise the route planning for the EV or HEV especially in order to control the energy consumption. This paper presents a multi-sensor fusion method, based on GNSS, INS, OSM and DEM data fused using a non-linear particle filter, to estimate and improve the slopes of road segments. A new statistical modelling of the DEM errors related to the spatial sampling of elevation data is proposed. This method is based on the definition of a geometrical window, called Adjacent Sliding Window (ASW), which dynamically selects the elevation data in the vicinity of the road. The proposed method is evaluated in a suburban transport network. The experimental results show the benefits of the vehicle attitude and road slope estimation accuracies.
{"title":"Statistical modelling of digital elevation models for GNSS-based navigation","authors":"Hiba Al-Assaad, C. Boucher, A. Daher, Ahmad Shahin, J. Noyer","doi":"10.1080/19479832.2023.2218376","DOIUrl":"https://doi.org/10.1080/19479832.2023.2218376","url":null,"abstract":"ABSTRACT Recently, smart mobility has become a important activity in transportation systems such as public, autonomous and shared transports. These systems require reliable navigation applications that lead to precise localisation and optimised route. The GPS system may face problems such as signal degradation caused by conical effects, affecting the reliability and accuracy of the signal, or signal loss in poor visibility environments. By using other sensors, the vehicle location system can overcome these GPS problems. This work focuses on the estimation of the inclination, which will be used to optimise the route planning for the EV or HEV especially in order to control the energy consumption. This paper presents a multi-sensor fusion method, based on GNSS, INS, OSM and DEM data fused using a non-linear particle filter, to estimate and improve the slopes of road segments. A new statistical modelling of the DEM errors related to the spatial sampling of elevation data is proposed. This method is based on the definition of a geometrical window, called Adjacent Sliding Window (ASW), which dynamically selects the elevation data in the vicinity of the road. The proposed method is evaluated in a suburban transport network. The experimental results show the benefits of the vehicle attitude and road slope estimation accuracies.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"14 1","pages":"205 - 224"},"PeriodicalIF":2.3,"publicationDate":"2023-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45971141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-04-10DOI: 10.1080/19479832.2023.2199005
LeiLei Xu, Shanqiu Shi, Yujun Liu, Hao Zhang, Dan Wang, Lu Zhang, Wan Liang, Hao Chen
ABSTRACT As fuelled by the advancement of deep learning for computer vision tasks, its application in other fields has been boosted. This technology has been increasingly applied to the interpretation of remote sensing image, showing high potential economic and societal significance, such as automatically mapping land cover. However, the model requires a considerable number of samples for training, and it is now adversely affected by the lack of a large-scale dataset. Moreover, labelling samples is a time-consuming and laborious task, and a complete land classification system suitable for deep learning has not been established. This limitation hinders the development and application of deep learning. To meet the data needs of deep learning in the field of remote sensing, this study develops JSsampleP, a large-scale dataset for segmentation, generating 110,170 data samples that cover various categories of scenes within Jiangsu Province, China. The existing Geographical Condition Dataset (GCD) and Basic Surveying and Mapping Dataset (BSMD) in Jiangsu were fully utilised, significantly reducing the cost of labelling samples. Furthermore, the samples were subject to a rigorous cleaning process to ensure data quality. Finally, the accuracy of the dataset is verified using the U-Net model, and the future version will be optimised continuously.
{"title":"A large-scale remote sensing scene dataset construction for semantic segmentation","authors":"LeiLei Xu, Shanqiu Shi, Yujun Liu, Hao Zhang, Dan Wang, Lu Zhang, Wan Liang, Hao Chen","doi":"10.1080/19479832.2023.2199005","DOIUrl":"https://doi.org/10.1080/19479832.2023.2199005","url":null,"abstract":"ABSTRACT As fuelled by the advancement of deep learning for computer vision tasks, its application in other fields has been boosted. This technology has been increasingly applied to the interpretation of remote sensing image, showing high potential economic and societal significance, such as automatically mapping land cover. However, the model requires a considerable number of samples for training, and it is now adversely affected by the lack of a large-scale dataset. Moreover, labelling samples is a time-consuming and laborious task, and a complete land classification system suitable for deep learning has not been established. This limitation hinders the development and application of deep learning. To meet the data needs of deep learning in the field of remote sensing, this study develops JSsampleP, a large-scale dataset for segmentation, generating 110,170 data samples that cover various categories of scenes within Jiangsu Province, China. The existing Geographical Condition Dataset (GCD) and Basic Surveying and Mapping Dataset (BSMD) in Jiangsu were fully utilised, significantly reducing the cost of labelling samples. Furthermore, the samples were subject to a rigorous cleaning process to ensure data quality. Finally, the accuracy of the dataset is verified using the U-Net model, and the future version will be optimised continuously.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"14 1","pages":"299 - 323"},"PeriodicalIF":2.3,"publicationDate":"2023-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43341264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-03-16DOI: 10.1080/19479832.2023.2186957
M. B. Mulik, J. V., Pandurangarao N. Kulkarni
ABSTRACT The satellite images are more attracted in the field of flood detection. For planning actions during emergencies, flood detection plays a vital role, but the major barrier is that using satellite images to detect flooded regions. For flood detection, this method innovates a model named Whale-crow search algorithm on the basis of deep convolutional neural network (W-CSA DCNN) approach. Pre-processing, classification, segmentation and feature extraction are the four steps which is included in this model. For obtaining sound and antiquity from the input image initially, the satellite imagery is given to pre-processing and then for obtaining the features on the basis of vegetation indices the pre-processed image is put through the feature extraction process. By means of Kernel Fuzzy Auto regressive (KFAR) model, the acquire features are subsequently used in the segmentation process. After obtaining the segments, it is given to the classification, which is carried out by means of DCNN and qualified excellently via the W-CSA that is the combination of the Crow Search Algorithm (CSA) and Whale optimisation algorithm (WOA). Based on the specificity, accuracy and sensitivity with values 0.982, 0.972 and 0.975, the efficiency of this process deliberates advanced performance than the existing process.
{"title":"Whale- crow search optimisation enabled deep convolutional neural network for flood detection","authors":"M. B. Mulik, J. V., Pandurangarao N. Kulkarni","doi":"10.1080/19479832.2023.2186957","DOIUrl":"https://doi.org/10.1080/19479832.2023.2186957","url":null,"abstract":"ABSTRACT The satellite images are more attracted in the field of flood detection. For planning actions during emergencies, flood detection plays a vital role, but the major barrier is that using satellite images to detect flooded regions. For flood detection, this method innovates a model named Whale-crow search algorithm on the basis of deep convolutional neural network (W-CSA DCNN) approach. Pre-processing, classification, segmentation and feature extraction are the four steps which is included in this model. For obtaining sound and antiquity from the input image initially, the satellite imagery is given to pre-processing and then for obtaining the features on the basis of vegetation indices the pre-processed image is put through the feature extraction process. By means of Kernel Fuzzy Auto regressive (KFAR) model, the acquire features are subsequently used in the segmentation process. After obtaining the segments, it is given to the classification, which is carried out by means of DCNN and qualified excellently via the W-CSA that is the combination of the Crow Search Algorithm (CSA) and Whale optimisation algorithm (WOA). Based on the specificity, accuracy and sensitivity with values 0.982, 0.972 and 0.975, the efficiency of this process deliberates advanced performance than the existing process.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"14 1","pages":"278 - 298"},"PeriodicalIF":2.3,"publicationDate":"2023-03-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44499897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-16DOI: 10.1080/19479832.2023.2167874
Mohamed A. Ali, F. Eltohamy, Adel Abd-Elrazek, Mohamed Hanafy
ABSTRACT Recently, there is a growing interest in analysing the degrading effect of satellite micro-vibrations due to the rapid growth in satellite technologies and the urgent need to precisely extract a huge amount of information from satellite images. Different kinds of micro-vibration have a notable effect on the quality of satellite images. The main objective of this paper is to demonstrate and analyse the effect of all types of micro-vibration on the quality of images acquired by high-resolution satellites. An algorithm to simulate micro-vibrations is proposed. A very high-resolution satellite image from the Pleiades-neo satellite is selected as an example to be used in addressing the degrading effects of micro-vibrations. In this paper, the modulation transfer function (MTF) is used as a major function to model the degradation that has been conducted. Also, several quality metrics are used to quantitatively assess the degradation. The key result of this paper is the significant effect of micro-vibrations on the quality of remote sensing satellite images which is attributed to the main influential parameters. These parameters like blur diameter, vibration displacement, number of Time Delay and Integration (TDI) stages of the camera, and the ratio of the integration time to the vibration period.
{"title":"Assessment of micro-vibrations effect on the quality of remote sensing satellites images","authors":"Mohamed A. Ali, F. Eltohamy, Adel Abd-Elrazek, Mohamed Hanafy","doi":"10.1080/19479832.2023.2167874","DOIUrl":"https://doi.org/10.1080/19479832.2023.2167874","url":null,"abstract":"ABSTRACT Recently, there is a growing interest in analysing the degrading effect of satellite micro-vibrations due to the rapid growth in satellite technologies and the urgent need to precisely extract a huge amount of information from satellite images. Different kinds of micro-vibration have a notable effect on the quality of satellite images. The main objective of this paper is to demonstrate and analyse the effect of all types of micro-vibration on the quality of images acquired by high-resolution satellites. An algorithm to simulate micro-vibrations is proposed. A very high-resolution satellite image from the Pleiades-neo satellite is selected as an example to be used in addressing the degrading effects of micro-vibrations. In this paper, the modulation transfer function (MTF) is used as a major function to model the degradation that has been conducted. Also, several quality metrics are used to quantitatively assess the degradation. The key result of this paper is the significant effect of micro-vibrations on the quality of remote sensing satellite images which is attributed to the main influential parameters. These parameters like blur diameter, vibration displacement, number of Time Delay and Integration (TDI) stages of the camera, and the ratio of the integration time to the vibration period.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"14 1","pages":"243 - 260"},"PeriodicalIF":2.3,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44246295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-12-01DOI: 10.1080/19479832.2022.2149629
T. Quaife, E. Pinnington, P. Marzahn, T. Kaminski, M. Vossbeck, J. Timmermans, C. Isola, B. Rommen, A. Loew
ABSTRACT Joint retrieval of vegetation status from synthetic aperture radar (SAR) and optical data holds much promise due to the complimentary of the information in the two wavelength domains. SAR penetrates the canopy and includes information about the water status of the soil and vegetation, whereas optical data contains information about the amount and health of leaves. However, due to inherent complexities of combining these data sources there has been relatively little progress in joint retrieval of information over vegetation canopies. In this study, data from Sentinel–1 and Sentinel–2 were used to invert coupled radiative transfer models to provide synergistic retrievals of leaf area index and soil moisture. Results for leaf area are excellent and enhanced by the use of both data sources (RSME is always less than and has a correlation of better than when using both together), but results for soil moisture are mixed with joint retrievals generally showing the lowest RMSE but underestimating the variability of the field data. Examples of such synergistic retrieval of plant properties from optical and SAR data using physically based radiative transfer models are uncommon in the literature, but these results highlight the potential for this approach.
{"title":"Synergistic retrievals of leaf area index and soil moisture from Sentinel-1 and Sentinel-2","authors":"T. Quaife, E. Pinnington, P. Marzahn, T. Kaminski, M. Vossbeck, J. Timmermans, C. Isola, B. Rommen, A. Loew","doi":"10.1080/19479832.2022.2149629","DOIUrl":"https://doi.org/10.1080/19479832.2022.2149629","url":null,"abstract":"ABSTRACT Joint retrieval of vegetation status from synthetic aperture radar (SAR) and optical data holds much promise due to the complimentary of the information in the two wavelength domains. SAR penetrates the canopy and includes information about the water status of the soil and vegetation, whereas optical data contains information about the amount and health of leaves. However, due to inherent complexities of combining these data sources there has been relatively little progress in joint retrieval of information over vegetation canopies. In this study, data from Sentinel–1 and Sentinel–2 were used to invert coupled radiative transfer models to provide synergistic retrievals of leaf area index and soil moisture. Results for leaf area are excellent and enhanced by the use of both data sources (RSME is always less than and has a correlation of better than when using both together), but results for soil moisture are mixed with joint retrievals generally showing the lowest RMSE but underestimating the variability of the field data. Examples of such synergistic retrieval of plant properties from optical and SAR data using physically based radiative transfer models are uncommon in the literature, but these results highlight the potential for this approach.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"14 1","pages":"225 - 242"},"PeriodicalIF":2.3,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43091119","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-23DOI: 10.1080/19479832.2022.2149630
Qin Dong
ABSTRACT Contrast enhancement and histogram equalisation are two image enhancement methods, which can lead to changes in the edge position of the resulting image, blurring or even loss of details. Therefore, this paper introduces a multi-scale filter to adaptively enhance the robot visual image, improve the brightness of the robot visual image, enrich the image details and reduce the image enhancement time. According to Retinex theory, the characteristic information of robot visual image is obtained, the logarithmic domain operation form of Retinex algorithm is obtained, the robot visual reflection image of high-frequency part is determined, the robot illumination visual image is estimated by multiscale filter, and the scale constant of Gaussian filter is obtained; According to the Retinex algorithm of weighted guided filtering, the robot visual image enhancement process is designed. The experimental results show that the average value of the robot visual image enhanced by this method is 88.63, the standard deviation is 62.78, the information entropy is 8.18, the robot visual image enhancement time is only 5.9s, and the PSNR of the robot visual image is up to 39.92, which proves that the robot visual image enhancement effect of this method is good.
{"title":"Research on adaptive enhancement of robot vision image based on multi-scale filter","authors":"Qin Dong","doi":"10.1080/19479832.2022.2149630","DOIUrl":"https://doi.org/10.1080/19479832.2022.2149630","url":null,"abstract":"ABSTRACT Contrast enhancement and histogram equalisation are two image enhancement methods, which can lead to changes in the edge position of the resulting image, blurring or even loss of details. Therefore, this paper introduces a multi-scale filter to adaptively enhance the robot visual image, improve the brightness of the robot visual image, enrich the image details and reduce the image enhancement time. According to Retinex theory, the characteristic information of robot visual image is obtained, the logarithmic domain operation form of Retinex algorithm is obtained, the robot visual reflection image of high-frequency part is determined, the robot illumination visual image is estimated by multiscale filter, and the scale constant of Gaussian filter is obtained; According to the Retinex algorithm of weighted guided filtering, the robot visual image enhancement process is designed. The experimental results show that the average value of the robot visual image enhanced by this method is 88.63, the standard deviation is 62.78, the information entropy is 8.18, the robot visual image enhancement time is only 5.9s, and the PSNR of the robot visual image is up to 39.92, which proves that the robot visual image enhancement effect of this method is good.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"14 1","pages":"261 - 277"},"PeriodicalIF":2.3,"publicationDate":"2022-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43985195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-23DOI: 10.1080/19479832.2022.2144955
A. Maurya, A. Kukunuri, D. Singh
ABSTRACT The applications of scatterometer data (σ°) are limited due to their coarser resolution (25–50 km). Some image reconstruction techniques are available to generate high-resolution products, but they require various sensor parameters and multiset observation, making them complex to use. Therefore, this paper proposes an information fusion approach to disaggregate the coarse resolution σ° product. The coarse resolution backscattering signal includes the contribution from more than one land cover class, such as short vegetation, soil, urban and tall vegetation, the information of which can be obtained from normalised difference vegetation index (NDVI), vegetation temperature condition index (VTCI), and fraction cover of urban and forests, respectively. Disaggregating this coarse resolution pixel, an optimum weight information is required that provides the distribution of each class. Since the distribution of land cover classes is not homogeneous for every pixel, a variance-based fusion approach has been used to obtain the optimum weight factors to fuse NDVI, VTCI, and fraction cover. These weight factors are used to disaggregate every coarse-resolution pixel into high-resolution pixels. The developed model is applied to Sentinel-1 and Scatsat-1 level-3 products, and the obtained results are quite satisfactory.
{"title":"Information fusion approach for downscaling coarse resolution scatterometer data","authors":"A. Maurya, A. Kukunuri, D. Singh","doi":"10.1080/19479832.2022.2144955","DOIUrl":"https://doi.org/10.1080/19479832.2022.2144955","url":null,"abstract":"ABSTRACT The applications of scatterometer data (σ°) are limited due to their coarser resolution (25–50 km). Some image reconstruction techniques are available to generate high-resolution products, but they require various sensor parameters and multiset observation, making them complex to use. Therefore, this paper proposes an information fusion approach to disaggregate the coarse resolution σ° product. The coarse resolution backscattering signal includes the contribution from more than one land cover class, such as short vegetation, soil, urban and tall vegetation, the information of which can be obtained from normalised difference vegetation index (NDVI), vegetation temperature condition index (VTCI), and fraction cover of urban and forests, respectively. Disaggregating this coarse resolution pixel, an optimum weight information is required that provides the distribution of each class. Since the distribution of land cover classes is not homogeneous for every pixel, a variance-based fusion approach has been used to obtain the optimum weight factors to fuse NDVI, VTCI, and fraction cover. These weight factors are used to disaggregate every coarse-resolution pixel into high-resolution pixels. The developed model is applied to Sentinel-1 and Scatsat-1 level-3 products, and the obtained results are quite satisfactory.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"14 1","pages":"89 - 106"},"PeriodicalIF":2.3,"publicationDate":"2022-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48503442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}