{"title":"三种常见的机器学习算法既不能提高预测精度,也不能降低残差的空间自相关:对25个社会经济数据集的分析","authors":"Insang Song, Daehyun Kim","doi":"10.1111/gean.12351","DOIUrl":null,"url":null,"abstract":"<p>Machine learning (ML) is being applied in an increasing volume of geographical research. However, the aspects of spatial autocorrelation (SAC) in the residuals produced by ML models have been understudied compared to the benefit of ML, namely, reduction of prediction errors. In this study, we examined the relationship between predictive accuracy and the reduction in the residual SAC for 597 variables from 25 geographical socio-economic data sets using spatial and nonspatial cross-validation of three ML algorithms such as random forests, support vector machine, and artificial neural network (ANN) to provide an extensive empirical diagnosis—but not a definitive theory—of the relationship between SAC and ML. Our results highlighted that the ML algorithms with tuned hyperparameters yielded marginal predictive accuracy gains and the minimal decreases in residual SAC. ANN revealed lower accuracy and higher reduction in the residual SAC than others. This implies ML algorithms in geographical research in socio-economic domains would not always result in higher prediction accuracy. We suggest that ML in geographical research should be cautiously employed when the main objective is related to the residual SAC. We also showed that spatial cross-validation neither improves predictive accuracy substantially nor reduce the residual SAC effectively.</p>","PeriodicalId":12533,"journal":{"name":"Geographical Analysis","volume":"55 4","pages":"585-620"},"PeriodicalIF":3.3000,"publicationDate":"2022-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Three Common Machine Learning Algorithms Neither Enhance Prediction Accuracy Nor Reduce Spatial Autocorrelation in Residuals: An Analysis of Twenty-five Socioeconomic Data Sets\",\"authors\":\"Insang Song, Daehyun Kim\",\"doi\":\"10.1111/gean.12351\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Machine learning (ML) is being applied in an increasing volume of geographical research. However, the aspects of spatial autocorrelation (SAC) in the residuals produced by ML models have been understudied compared to the benefit of ML, namely, reduction of prediction errors. In this study, we examined the relationship between predictive accuracy and the reduction in the residual SAC for 597 variables from 25 geographical socio-economic data sets using spatial and nonspatial cross-validation of three ML algorithms such as random forests, support vector machine, and artificial neural network (ANN) to provide an extensive empirical diagnosis—but not a definitive theory—of the relationship between SAC and ML. Our results highlighted that the ML algorithms with tuned hyperparameters yielded marginal predictive accuracy gains and the minimal decreases in residual SAC. ANN revealed lower accuracy and higher reduction in the residual SAC than others. This implies ML algorithms in geographical research in socio-economic domains would not always result in higher prediction accuracy. We suggest that ML in geographical research should be cautiously employed when the main objective is related to the residual SAC. We also showed that spatial cross-validation neither improves predictive accuracy substantially nor reduce the residual SAC effectively.</p>\",\"PeriodicalId\":12533,\"journal\":{\"name\":\"Geographical Analysis\",\"volume\":\"55 4\",\"pages\":\"585-620\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2022-10-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Geographical Analysis\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/gean.12351\",\"RegionNum\":3,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Geographical Analysis","FirstCategoryId":"89","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/gean.12351","RegionNum":3,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY","Score":null,"Total":0}
Three Common Machine Learning Algorithms Neither Enhance Prediction Accuracy Nor Reduce Spatial Autocorrelation in Residuals: An Analysis of Twenty-five Socioeconomic Data Sets
Machine learning (ML) is being applied in an increasing volume of geographical research. However, the aspects of spatial autocorrelation (SAC) in the residuals produced by ML models have been understudied compared to the benefit of ML, namely, reduction of prediction errors. In this study, we examined the relationship between predictive accuracy and the reduction in the residual SAC for 597 variables from 25 geographical socio-economic data sets using spatial and nonspatial cross-validation of three ML algorithms such as random forests, support vector machine, and artificial neural network (ANN) to provide an extensive empirical diagnosis—but not a definitive theory—of the relationship between SAC and ML. Our results highlighted that the ML algorithms with tuned hyperparameters yielded marginal predictive accuracy gains and the minimal decreases in residual SAC. ANN revealed lower accuracy and higher reduction in the residual SAC than others. This implies ML algorithms in geographical research in socio-economic domains would not always result in higher prediction accuracy. We suggest that ML in geographical research should be cautiously employed when the main objective is related to the residual SAC. We also showed that spatial cross-validation neither improves predictive accuracy substantially nor reduce the residual SAC effectively.
期刊介绍:
First in its specialty area and one of the most frequently cited publications in geography, Geographical Analysis has, since 1969, presented significant advances in geographical theory, model building, and quantitative methods to geographers and scholars in a wide spectrum of related fields. Traditionally, mathematical and nonmathematical articulations of geographical theory, and statements and discussions of the analytic paradigm are published in the journal. Spatial data analyses and spatial econometrics and statistics are strongly represented.