A framework for assessing the computational reproducibility of geo-simulation experiments

IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Environmental Modelling & Software Pub Date : 2025-01-17 DOI:10.1016/j.envsoft.2025.106323
Zhiyi Zhu, Min Chen, Guangjin Ren, Yuanqing He, Lingzhi Sun, Fengyuan Zhang, Yongning Wen, Songshan Yue, Guonian Lü
{"title":"A framework for assessing the computational reproducibility of geo-simulation experiments","authors":"Zhiyi Zhu, Min Chen, Guangjin Ren, Yuanqing He, Lingzhi Sun, Fengyuan Zhang, Yongning Wen, Songshan Yue, Guonian Lü","doi":"10.1016/j.envsoft.2025.106323","DOIUrl":null,"url":null,"abstract":"Recent advances in computational technologies have enhanced geo-simulation experiments (GSEs), making computational reproducibility assessments increasingly critical. However, existing methods often focus on isolated aspects, lacking a comprehensive framework. This study proposes an integrated framework for assessing reproducibility in GSEs, structured into two parts: (1) evaluating overall computational workflows, and (2) investigating individual processes to identify inconsistencies. The framework employs a detailed assessment model using hierarchical dimensions and metrics that combine quantitative measures (e.g., output consistency) and qualitative evaluations (e.g., clarity of descriptions). These components address both broad and granular aspects of computational processes. The framework is implemented in a prototype system to support reproducibility assessments and demonstrated through practical applications. This systematic approach provides a robust and adaptable method for assessing reproducibility, promoting the resolution of challenges in existing methods.","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":"38 1","pages":""},"PeriodicalIF":4.8000,"publicationDate":"2025-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Environmental Modelling & Software","FirstCategoryId":"93","ListUrlMain":"https://doi.org/10.1016/j.envsoft.2025.106323","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

Recent advances in computational technologies have enhanced geo-simulation experiments (GSEs), making computational reproducibility assessments increasingly critical. However, existing methods often focus on isolated aspects, lacking a comprehensive framework. This study proposes an integrated framework for assessing reproducibility in GSEs, structured into two parts: (1) evaluating overall computational workflows, and (2) investigating individual processes to identify inconsistencies. The framework employs a detailed assessment model using hierarchical dimensions and metrics that combine quantitative measures (e.g., output consistency) and qualitative evaluations (e.g., clarity of descriptions). These components address both broad and granular aspects of computational processes. The framework is implemented in a prototype system to support reproducibility assessments and demonstrated through practical applications. This systematic approach provides a robust and adaptable method for assessing reproducibility, promoting the resolution of challenges in existing methods.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
求助全文
约1分钟内获得全文 去求助
来源期刊
Environmental Modelling & Software
Environmental Modelling & Software 工程技术-工程:环境
CiteScore
9.30
自引率
8.20%
发文量
241
审稿时长
60 days
期刊介绍: Environmental Modelling & Software publishes contributions, in the form of research articles, reviews and short communications, on recent advances in environmental modelling and/or software. The aim is to improve our capacity to represent, understand, predict or manage the behaviour of environmental systems at all practical scales, and to communicate those improvements to a wide scientific and professional audience.
期刊最新文献
Doing hydrology when no in-situ data exists: Surrogate River discharge Model (SRM) GeoAI-based drainage crossing detection for elevation-derived hydrographic mapping Simple analysis of biodiversity response functions and multipliers for biodiversity offsetting and other applications A systemic approach to managing uncertainties in repetitive multibeam bathymetric surveys Integrated models of nutrient dynamics in lake and reservoir watersheds: A systematic review and integrated modelling decision pathway
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1