Sun-Young Kim, Amanda J Gassett, Magali N Blanco, Lianne Sheppard
{"title":"Ultrafine particle mobile monitoring study designs for epidemiology: Cost and performance comparisons.","authors":"Sun-Young Kim, Amanda J Gassett, Magali N Blanco, Lianne Sheppard","doi":"10.1289/EHP15100","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Given the difficulty of collecting air pollution measurements for individuals, researchers use mobile monitoring to develop accurate models that predict long-term average exposure to air pollution allowing the investigation of its association with human health. While recent mobile monitoring studies focused on predictive models' abilities to select optimal designs, cost is also an important feature.</p><p><strong>Objectives: </strong>This study aims to compare costs to predictive model performance for different mobile monitoring designs.</p><p><strong>Methods: </strong>We used data on ultrafine particle stationary roadside mobile monitoring and associated costs collected by the Adult Changes in Thought Air Pollution (ACT-AP) study. By assuming a single-instrument, local monitoring, and constant costs of equipment and investigator oversight, we focused on the incremental cost of staff work days composed mostly of sampling drives and quality control procedures. The ACT-AP complete design included data collection from 309 sites, ~29 visits per site, during 4 seasons, every day of the week. We considered alternative designs by selecting subsets of fewer sites, visits, seasons, days of week, and hours of day. Then, we developed exposure prediction models from each alternative design and calculated cross-validation (CV) statistics using all observations from the complete design. Finally, we compared CV R<sup>2</sup>s and the numbers of staff work days from alternative designs to those from the complete design and demonstrate this exercise in a web application.</p><p><strong>Results: </strong>For designs with less visits per site, the costs for number of work days were lower and model performance (CV R<sup>2</sup>) also worsened, but with mild decline above 12 visits per site. The costs were also less for designs with fewer sites when considering at least 100 sites, while the reduction in performance was minimal. For temporally-restricted designs that were constrained to have the same number of work days and thus the same cost, restrictions on the number of seasons, days of week, and/or hours of the day adversely impacted model performance.</p><p><strong>Discussion: </strong>Our study provides practical guidance to future mobile monitoring campaigns that have the ultimate goal of assessing the health effect of long-term air pollution. Temporally-balanced designs with 12 visits per site are a cost-effective option that provide relatively good prediction accuracy with reduced costs. https://doi.org/10.1289/EHP15100.</p>","PeriodicalId":11862,"journal":{"name":"Environmental Health Perspectives","volume":" ","pages":""},"PeriodicalIF":10.1000,"publicationDate":"2025-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Environmental Health Perspectives","FirstCategoryId":"93","ListUrlMain":"https://doi.org/10.1289/EHP15100","RegionNum":1,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Given the difficulty of collecting air pollution measurements for individuals, researchers use mobile monitoring to develop accurate models that predict long-term average exposure to air pollution allowing the investigation of its association with human health. While recent mobile monitoring studies focused on predictive models' abilities to select optimal designs, cost is also an important feature.
Objectives: This study aims to compare costs to predictive model performance for different mobile monitoring designs.
Methods: We used data on ultrafine particle stationary roadside mobile monitoring and associated costs collected by the Adult Changes in Thought Air Pollution (ACT-AP) study. By assuming a single-instrument, local monitoring, and constant costs of equipment and investigator oversight, we focused on the incremental cost of staff work days composed mostly of sampling drives and quality control procedures. The ACT-AP complete design included data collection from 309 sites, ~29 visits per site, during 4 seasons, every day of the week. We considered alternative designs by selecting subsets of fewer sites, visits, seasons, days of week, and hours of day. Then, we developed exposure prediction models from each alternative design and calculated cross-validation (CV) statistics using all observations from the complete design. Finally, we compared CV R2s and the numbers of staff work days from alternative designs to those from the complete design and demonstrate this exercise in a web application.
Results: For designs with less visits per site, the costs for number of work days were lower and model performance (CV R2) also worsened, but with mild decline above 12 visits per site. The costs were also less for designs with fewer sites when considering at least 100 sites, while the reduction in performance was minimal. For temporally-restricted designs that were constrained to have the same number of work days and thus the same cost, restrictions on the number of seasons, days of week, and/or hours of the day adversely impacted model performance.
Discussion: Our study provides practical guidance to future mobile monitoring campaigns that have the ultimate goal of assessing the health effect of long-term air pollution. Temporally-balanced designs with 12 visits per site are a cost-effective option that provide relatively good prediction accuracy with reduced costs. https://doi.org/10.1289/EHP15100.
期刊介绍:
Environmental Health Perspectives (EHP) is a monthly peer-reviewed journal supported by the National Institute of Environmental Health Sciences, part of the National Institutes of Health under the U.S. Department of Health and Human Services. Its mission is to facilitate discussions on the connections between the environment and human health by publishing top-notch research and news. EHP ranks third in Public, Environmental, and Occupational Health, fourth in Toxicology, and fifth in Environmental Sciences.