一个简化Tikhonov正则化的软件包,包括基于矩阵的SMPS和HTDMA数据反演示例

M. Petters
{"title":"一个简化Tikhonov正则化的软件包,包括基于矩阵的SMPS和HTDMA数据反演示例","authors":"M. Petters","doi":"10.5194/AMT-2021-51","DOIUrl":null,"url":null,"abstract":"Abstract. Tikhonov regularization is a tool for reducing noise amplification during data inversion. This work introduces RegularizationTools.jl, a general-purpose software package to apply Tikhonov regularization to data. The package implements well-established numerical algorithms and is suitable for systems of up to ~1000 equations. Included is an abstraction to systematically categorize specific inversion configurations and their associated hyperparameters. A generic interface translates arbitrary linear forward models defined by a computer function into the corresponding design matrix. This obviates the need to explicitly write out and discretize the Fredholm integral equation, thus facilitating fast prototyping of new regularization schemes associated with measurement techniques. Example applications include the inversion involving data from scanning mobility particle sizers (SMPS) and humidified tandem differential mobility analyzers (HTDMA). Inversion of SMPS size distributions reported in this work builds upon the freely-available software DifferentialMobilityAnalyzers.jl. The speed of inversion is improved by a factor of ~200, now requiring between 2 and 5 ms per SMPS scan when using 120 size bins. Previously reported occasional failure to converge to a valid solution is reduced by switching from the L-curve method to generalized cross-validation as the metric to search for the optimal regularization parameter. Higher-order inversions resulting in smooth, denoised reconstructions of size distributions are now included in DifferentialMobilityAnalyzers.jl. This work also demonstrates that an SMPS-style matrix-based inversion can be applied to find the growth factor frequency distribution from raw HTDMA data, while also accounting for multiply-charged particles. The outcome of the aerosol-related inversion methods is showcased by inverting multi-week SMPS and HTDMA datasets from ground-based observations, including SMPS data obtained at Bodega Bay Marine Laboratory during the Calwater 2/ACAPEX campaign, and co-located SMPS and HTDMA data collected at the U.S. Department of Energy observatory located at the Southern Great Plains site in Oklahoma, U.S.A. Results show that the proposed approaches are suitable for unsupervised, nonparametric inversion of large-scale datasets as well as inversion in real-time during data acquisition on low-cost reduced-instruction-set architectures used in single-board computers. The included software implementation of Tikhonov regularization is freely-available, general, and domain-independent, and thus can be applied to many other inverse problems arising in atmospheric measurement techniques and beyond.","PeriodicalId":441110,"journal":{"name":"Atmospheric Measurement Techniques Discussions","volume":"30 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"A Software Package to Simplify Tikhonov Regularization with\\nExamples for Matrix-Based Inversion of SMPS and HTDMA Data\",\"authors\":\"M. Petters\",\"doi\":\"10.5194/AMT-2021-51\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract. Tikhonov regularization is a tool for reducing noise amplification during data inversion. This work introduces RegularizationTools.jl, a general-purpose software package to apply Tikhonov regularization to data. The package implements well-established numerical algorithms and is suitable for systems of up to ~1000 equations. Included is an abstraction to systematically categorize specific inversion configurations and their associated hyperparameters. A generic interface translates arbitrary linear forward models defined by a computer function into the corresponding design matrix. This obviates the need to explicitly write out and discretize the Fredholm integral equation, thus facilitating fast prototyping of new regularization schemes associated with measurement techniques. Example applications include the inversion involving data from scanning mobility particle sizers (SMPS) and humidified tandem differential mobility analyzers (HTDMA). Inversion of SMPS size distributions reported in this work builds upon the freely-available software DifferentialMobilityAnalyzers.jl. The speed of inversion is improved by a factor of ~200, now requiring between 2 and 5 ms per SMPS scan when using 120 size bins. Previously reported occasional failure to converge to a valid solution is reduced by switching from the L-curve method to generalized cross-validation as the metric to search for the optimal regularization parameter. Higher-order inversions resulting in smooth, denoised reconstructions of size distributions are now included in DifferentialMobilityAnalyzers.jl. This work also demonstrates that an SMPS-style matrix-based inversion can be applied to find the growth factor frequency distribution from raw HTDMA data, while also accounting for multiply-charged particles. The outcome of the aerosol-related inversion methods is showcased by inverting multi-week SMPS and HTDMA datasets from ground-based observations, including SMPS data obtained at Bodega Bay Marine Laboratory during the Calwater 2/ACAPEX campaign, and co-located SMPS and HTDMA data collected at the U.S. Department of Energy observatory located at the Southern Great Plains site in Oklahoma, U.S.A. Results show that the proposed approaches are suitable for unsupervised, nonparametric inversion of large-scale datasets as well as inversion in real-time during data acquisition on low-cost reduced-instruction-set architectures used in single-board computers. The included software implementation of Tikhonov regularization is freely-available, general, and domain-independent, and thus can be applied to many other inverse problems arising in atmospheric measurement techniques and beyond.\",\"PeriodicalId\":441110,\"journal\":{\"name\":\"Atmospheric Measurement Techniques Discussions\",\"volume\":\"30 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-03-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Atmospheric Measurement Techniques Discussions\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.5194/AMT-2021-51\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Atmospheric Measurement Techniques Discussions","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5194/AMT-2021-51","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

摘要吉洪诺夫正则化是一种减少数据反演过程中噪声放大的工具。这项工作介绍了RegularizationTools。jl,一个通用软件包,用于将吉洪诺夫正则化应用于数据。该软件包实现了完善的数值算法,适用于高达~1000个方程的系统。包括一个抽象,系统地分类特定的反演配置及其相关的超参数。通用接口将由计算机功能定义的任意线性正向模型转换为相应的设计矩阵。这避免了明确地写出和离散Fredholm积分方程的需要,从而促进了与测量技术相关的新正则化方案的快速原型。示例应用包括涉及扫描迁移率粒度仪(SMPS)和加湿串联差分迁移率分析仪(HTDMA)数据的反演。在这项工作中报告的SMPS大小分布的反演建立在免费软件DifferentialMobilityAnalyzers.jl之上。反演速度提高了约200倍,当使用120个大小的箱子时,现在每次SMPS扫描需要2到5毫秒。通过从l曲线方法切换到广义交叉验证作为搜索最优正则化参数的度量,减少了以前报道的偶尔收敛到有效解的失败。高阶反演导致平滑,去噪的大小分布重建现在包括在differalmobilityanalysers .jl。这项工作还表明,smps风格的基于矩阵的反演可以应用于从原始HTDMA数据中找到生长因子频率分布,同时也考虑到多重带电粒子。通过对多周地面观测的SMPS和HTDMA数据集进行反演,展示了气溶胶相关反演方法的结果,包括在Calwater 2/ACAPEX活动期间在Bodega Bay海洋实验室获得的SMPS数据,以及位于美国俄克拉荷马州南部大平原的美国能源部观测站收集的SMPS和HTDMA数据。大规模数据集的非参数反演以及在单板计算机低成本精简指令集架构下数据采集过程中的实时反演。所包含的Tikhonov正则化软件实现是免费的,通用的,和领域无关的,因此可以应用于大气测量技术和其他领域中出现的许多其他逆问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A Software Package to Simplify Tikhonov Regularization with Examples for Matrix-Based Inversion of SMPS and HTDMA Data
Abstract. Tikhonov regularization is a tool for reducing noise amplification during data inversion. This work introduces RegularizationTools.jl, a general-purpose software package to apply Tikhonov regularization to data. The package implements well-established numerical algorithms and is suitable for systems of up to ~1000 equations. Included is an abstraction to systematically categorize specific inversion configurations and their associated hyperparameters. A generic interface translates arbitrary linear forward models defined by a computer function into the corresponding design matrix. This obviates the need to explicitly write out and discretize the Fredholm integral equation, thus facilitating fast prototyping of new regularization schemes associated with measurement techniques. Example applications include the inversion involving data from scanning mobility particle sizers (SMPS) and humidified tandem differential mobility analyzers (HTDMA). Inversion of SMPS size distributions reported in this work builds upon the freely-available software DifferentialMobilityAnalyzers.jl. The speed of inversion is improved by a factor of ~200, now requiring between 2 and 5 ms per SMPS scan when using 120 size bins. Previously reported occasional failure to converge to a valid solution is reduced by switching from the L-curve method to generalized cross-validation as the metric to search for the optimal regularization parameter. Higher-order inversions resulting in smooth, denoised reconstructions of size distributions are now included in DifferentialMobilityAnalyzers.jl. This work also demonstrates that an SMPS-style matrix-based inversion can be applied to find the growth factor frequency distribution from raw HTDMA data, while also accounting for multiply-charged particles. The outcome of the aerosol-related inversion methods is showcased by inverting multi-week SMPS and HTDMA datasets from ground-based observations, including SMPS data obtained at Bodega Bay Marine Laboratory during the Calwater 2/ACAPEX campaign, and co-located SMPS and HTDMA data collected at the U.S. Department of Energy observatory located at the Southern Great Plains site in Oklahoma, U.S.A. Results show that the proposed approaches are suitable for unsupervised, nonparametric inversion of large-scale datasets as well as inversion in real-time during data acquisition on low-cost reduced-instruction-set architectures used in single-board computers. The included software implementation of Tikhonov regularization is freely-available, general, and domain-independent, and thus can be applied to many other inverse problems arising in atmospheric measurement techniques and beyond.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Improved monitoring of shipping NO2 with TROPOMI: decreasing NOx emissions in European seas during the COVID-19 pandemic Continuous mapping of fine particulate matter (PM2.5) air quality in East Asia at daily 6×6 km2 resolution by application of a random forest algorithm to 2011–2019 GOCI geostationary satellite data Fill dynamics and sample mixing in the AirCore  Relative errors of derived multi-wavelengths intensive aerosol optical properties using CAPS_SSA, Nephelometer and TAP measurements Laboratory evaluation of the scattering matrix of ragweed, ash, birch and pine pollens towards pollen classification
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1