首页 > 最新文献

Medical Decision Making最新文献

英文 中文
Health Utilities in People with Hepatitis C Virus Infection: A Study Using Real-World Population-Level Data.
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-04-01 Epub Date: 2025-02-22 DOI: 10.1177/0272989X251319342
Yasmin A Saeed, Nicholas Mitsakakis, Jordan J Feld, Murray D Krahn, Jeffrey C Kwong, William W L Wong

BackgroundHepatitis C virus (HCV) infection is associated with reduced quality of life and health utility. It is unclear whether this is primarily due to HCV infection itself or commonly co-occurring patient characteristics such as low income and mental health issues. This study aims to estimate and separate the effects of HCV infection on health utility from the effects of clinical and sociodemographic factors using real-world population-level data.MethodsWe conducted a cross-sectional retrospective cohort study to estimate health utilities in people with and without HCV infection in Ontario, Canada, from 2000 to 2014 using linked survey data from the Canadian Community Health Survey and health administrative data. Utilities were derived from the Health Utilities Index Mark 3 instrument. We used propensity score matching and multivariable linear regression to examine the impact of HCV infection on utility scores while adjusting for clinical and sociodemographic factors.ResultsThere were 7,102 individuals with hepatitis C status and health utility data available (506 HCV-positive, 6,596 HCV-negative). Factors associated with marginalization were more prevalent in the HCV-positive cohort (e.g., household income <$20,000: 36% versus 15%). Propensity score matching resulted in 454 matched pairs of HCV-positive and HCV-negative individuals. HCV-positive individuals had substantially lower unadjusted utilities than HCV-negative individuals did (mean ± standard error: 0.662 ± 0.016 versus 0.734 ± 0.015). The regression model showed that HCV positivity (coefficient: -0.066), age, comorbidity, mental health history, and household income had large impacts on health utility.ConclusionsHCV infection is associated with low health utility even after controlling for clinical and sociodemographic variables. Individuals with HCV infection may benefit from additional social services and supports alongside antiviral therapy to improve their quality of life.HighlightsHepatitis C virus (HCV) infection is associated with reduced quality of life and health utility. There is debate in the literature on whether this is primarily due to HCV infection itself or commonly co-occurring patient characteristics such as low income and mental health issues.We showed that individuals with HCV infection have substantially lower health utilities than uninfected individuals do even after controlling for clinical and sociodemographic variables, based on a large, real-world population-level dataset. Socioeconomically marginalized individuals with HCV infection had particularly low health utilities.In addition to improving access to HCV testing and treatment, it may be beneficial to provide social services such as mental health and financial supports to improve the quality of life and health utility of people living with HCV.

{"title":"Health Utilities in People with Hepatitis C Virus Infection: A Study Using Real-World Population-Level Data.","authors":"Yasmin A Saeed, Nicholas Mitsakakis, Jordan J Feld, Murray D Krahn, Jeffrey C Kwong, William W L Wong","doi":"10.1177/0272989X251319342","DOIUrl":"10.1177/0272989X251319342","url":null,"abstract":"<p><p>BackgroundHepatitis C virus (HCV) infection is associated with reduced quality of life and health utility. It is unclear whether this is primarily due to HCV infection itself or commonly co-occurring patient characteristics such as low income and mental health issues. This study aims to estimate and separate the effects of HCV infection on health utility from the effects of clinical and sociodemographic factors using real-world population-level data.MethodsWe conducted a cross-sectional retrospective cohort study to estimate health utilities in people with and without HCV infection in Ontario, Canada, from 2000 to 2014 using linked survey data from the Canadian Community Health Survey and health administrative data. Utilities were derived from the Health Utilities Index Mark 3 instrument. We used propensity score matching and multivariable linear regression to examine the impact of HCV infection on utility scores while adjusting for clinical and sociodemographic factors.ResultsThere were 7,102 individuals with hepatitis C status and health utility data available (506 HCV-positive, 6,596 HCV-negative). Factors associated with marginalization were more prevalent in the HCV-positive cohort (e.g., household income <$20,000: 36% versus 15%). Propensity score matching resulted in 454 matched pairs of HCV-positive and HCV-negative individuals. HCV-positive individuals had substantially lower unadjusted utilities than HCV-negative individuals did (mean ± standard error: 0.662 ± 0.016 versus 0.734 ± 0.015). The regression model showed that HCV positivity (coefficient: -0.066), age, comorbidity, mental health history, and household income had large impacts on health utility.ConclusionsHCV infection is associated with low health utility even after controlling for clinical and sociodemographic variables. Individuals with HCV infection may benefit from additional social services and supports alongside antiviral therapy to improve their quality of life.HighlightsHepatitis C virus (HCV) infection is associated with reduced quality of life and health utility. There is debate in the literature on whether this is primarily due to HCV infection itself or commonly co-occurring patient characteristics such as low income and mental health issues.We showed that individuals with HCV infection have substantially lower health utilities than uninfected individuals do even after controlling for clinical and sociodemographic variables, based on a large, real-world population-level dataset. Socioeconomically marginalized individuals with HCV infection had particularly low health utilities.In addition to improving access to HCV testing and treatment, it may be beneficial to provide social services such as mental health and financial supports to improve the quality of life and health utility of people living with HCV.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"332-343"},"PeriodicalIF":3.1,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11894892/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143476923","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Segmenting the Population and Estimating Transition Probabilities Using Data on Health and Health-Related Social Service Needs from the US Health and Retirement Study.
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-04-01 Epub Date: 2025-02-24 DOI: 10.1177/0272989X251320887
Lize Duminy

BackgroundSimulation modeling is a promising tool to help policy makers and providers make evidence-based decisions when evaluating integrated care programs. The functionality of such models, however, depends on 2 prerequisites: 1) the analytical segmentation of populations to capture both health and health-related social service (HASS) needs and 2) the precise estimation of transition probabilities among the various states of need.MethodsWe took a validated instrument for segmenting the population by HASS needs and adapted it to the Health and Retirement Study, a nationally representative survey dataset from the US population older than 50 y. We then estimated the transition probabilities across all 10 need states and death using multistate modeling. A need state was defined as a combination of any of the 5 ordinal global impression segments and a complicating factor status.ResultsKaplan-Meier survival curves, log-rank tests, and c-indices were used to assess predictive validity in relation to mortality. The Markov traces, using the estimated transition probability to replicate 2 closed cohorts, resembled the proportion of individuals per health state across subsequent waves well enough to indicate adequate fit of the estimated transition probabilities.ConclusionsThis article provides a population segmentation approach that incorporates HASS needs for the US population and 1-y transition probabilities across HASS need states and death. This is the first application of HASS segmentation that can estimate transitions between all 10 HASS need states, facilitating novel analysis of policy decisions related to integrated care.ImplicationsOur results will be used as input for a simulation model that performs scenario analysis on the long-term effects of various integrated care policies on population health.HighlightsWe took a validated tool for segmenting the population according to health and health-related social service (HASS) needs and adapted it to the Health and Retirement Study, a nationally representative survey dataset from the US population over the age of 50 y.We estimated the 1-y transition probabilities across all 10 HASS segments and death.This is the first application of a version of this HASS segmentation tool that includes HASSs in the various need states when estimating transition probabilities.Our results will be used as input for a simulation model that performs scenario analysis on the long-term effects of various integrated care policies on population health.

{"title":"Segmenting the Population and Estimating Transition Probabilities Using Data on Health and Health-Related Social Service Needs from the US Health and Retirement Study.","authors":"Lize Duminy","doi":"10.1177/0272989X251320887","DOIUrl":"10.1177/0272989X251320887","url":null,"abstract":"<p><p>BackgroundSimulation modeling is a promising tool to help policy makers and providers make evidence-based decisions when evaluating integrated care programs. The functionality of such models, however, depends on 2 prerequisites: 1) the analytical segmentation of populations to capture both health and health-related social service (HASS) needs and 2) the precise estimation of transition probabilities among the various states of need.MethodsWe took a validated instrument for segmenting the population by HASS needs and adapted it to the Health and Retirement Study, a nationally representative survey dataset from the US population older than 50 y. We then estimated the transition probabilities across all 10 need states and death using multistate modeling. A need state was defined as a combination of any of the 5 ordinal global impression segments and a complicating factor status.ResultsKaplan-Meier survival curves, log-rank tests, and c-indices were used to assess predictive validity in relation to mortality. The Markov traces, using the estimated transition probability to replicate 2 closed cohorts, resembled the proportion of individuals per health state across subsequent waves well enough to indicate adequate fit of the estimated transition probabilities.ConclusionsThis article provides a population segmentation approach that incorporates HASS needs for the US population and 1-y transition probabilities across HASS need states and death. This is the first application of HASS segmentation that can estimate transitions between all 10 HASS need states, facilitating novel analysis of policy decisions related to integrated care.ImplicationsOur results will be used as input for a simulation model that performs scenario analysis on the long-term effects of various integrated care policies on population health.HighlightsWe took a validated tool for segmenting the population according to health and health-related social service (HASS) needs and adapted it to the Health and Retirement Study, a nationally representative survey dataset from the US population over the age of 50 y.We estimated the 1-y transition probabilities across all 10 HASS segments and death.This is the first application of a version of this HASS segmentation tool that includes HASSs in the various need states when estimating transition probabilities.Our results will be used as input for a simulation model that performs scenario analysis on the long-term effects of various integrated care policies on population health.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"286-301"},"PeriodicalIF":3.1,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143484476","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Directed Acyclic Graphs in Decision-Analytic Modeling: Bridging Causal Inference and Effective Model Design in Medical Decision Making.
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-04-01 Epub Date: 2025-01-23 DOI: 10.1177/0272989X241310898
Stijntje W Dijk, Maurice Korf, Jeremy A Labrecque, Ankur Pandya, Bart S Ferket, Lára R Hallsson, John B Wong, Uwe Siebert, M G Myriam Hunink

Decision-analytic models (DAMs) are essentially informative yet complex tools for solving questions in medical decision making. When their complexity grows, the need for causal inference techniques becomes evident as causal relationships between variables become unclear. In this methodological commentary, we argue that graphical representations of assumptions on such relationships, directed acyclic graphs (DAGs), can enhance the transparency of decision models and aid in parameter selection and estimation through visually specifying backdoor paths (i.e., potential biases in parameter estimates) and visually clarifying structural modeling choices of frontdoor paths (i.e., the effect of the model structure on the outcome). This commentary discusses the benefit of integrating DAGs and DAMs in medical decision making and in particular health economics with 2 applications: the first examines statin use for prevention of cardiovascular disease, and the second considers mindfulness-based interventions for students' stress. Despite the potential application of DAGs in the decision science framework, challenges remain, including simplicity, defining the scope of a DAG, unmeasured confounding, noncausal aspects, and limited data availability or quality. Broader adoption of DAGs in decision science requires full-model applications and further debate.HighlightsOur commentary proposes the application of directed acyclic graphs (DAGs) in the design of decision-analytic models, offering researchers a valuable and structured tool to enhance transparency and accuracy by bridging the gap between causal inference and model design in medical decision making.The practical examples in this article showcase the transformative effect DAGs can have on model structure, parameter selection, and the resulting conclusions on effectiveness and cost-effectiveness.This methodological article invites a broader conversation on decision-modeling choices grounded in causal assumptions.

{"title":"Directed Acyclic Graphs in Decision-Analytic Modeling: Bridging Causal Inference and Effective Model Design in Medical Decision Making.","authors":"Stijntje W Dijk, Maurice Korf, Jeremy A Labrecque, Ankur Pandya, Bart S Ferket, Lára R Hallsson, John B Wong, Uwe Siebert, M G Myriam Hunink","doi":"10.1177/0272989X241310898","DOIUrl":"10.1177/0272989X241310898","url":null,"abstract":"<p><p>Decision-analytic models (DAMs) are essentially informative yet complex tools for solving questions in medical decision making. When their complexity grows, the need for causal inference techniques becomes evident as causal relationships between variables become unclear. In this methodological commentary, we argue that graphical representations of assumptions on such relationships, directed acyclic graphs (DAGs), can enhance the transparency of decision models and aid in parameter selection and estimation through visually specifying backdoor paths (i.e., potential biases in parameter estimates) and visually clarifying structural modeling choices of frontdoor paths (i.e., the effect of the model structure on the outcome). This commentary discusses the benefit of integrating DAGs and DAMs in medical decision making and in particular health economics with 2 applications: the first examines statin use for prevention of cardiovascular disease, and the second considers mindfulness-based interventions for students' stress. Despite the potential application of DAGs in the decision science framework, challenges remain, including simplicity, defining the scope of a DAG, unmeasured confounding, noncausal aspects, and limited data availability or quality. Broader adoption of DAGs in decision science requires full-model applications and further debate.HighlightsOur commentary proposes the application of directed acyclic graphs (DAGs) in the design of decision-analytic models, offering researchers a valuable and structured tool to enhance transparency and accuracy by bridging the gap between causal inference and model design in medical decision making.The practical examples in this article showcase the transformative effect DAGs can have on model structure, parameter selection, and the resulting conclusions on effectiveness and cost-effectiveness.This methodological article invites a broader conversation on decision-modeling choices grounded in causal assumptions.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"223-231"},"PeriodicalIF":3.1,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11894903/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143025164","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Recalibrating an Established Microsimulation Model to Capture Trends and Projections of Colorectal Cancer Incidence and Mortality.
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-04-01 Epub Date: 2025-02-06 DOI: 10.1177/0272989X251314050
Jie-Bin Lew, Qingwei Luo, Joachim Worthington, Han Ge, Emily He, Julia Steinberg, Michael Caruana, Dianne L O'Connell, Eleonora Feletto, Karen Canfell

BackgroundChanging colorectal cancer (CRC) incidence rates, including recent increases for people younger than 50 y, need to be considered in planning for future cancer control and screening initiatives. Reliable estimates of the impact of changing CRC trends on the National Bowel Cancer Screening Program (NBCSP) are essential for programmatic planning in Australia. An existing microsimulation model of CRC, Policy1-Bowel, was updated to reproduce Australian CRC trends data and provide updated projections of CRC- and screening-related outcomes to inform clinical practice guidelines for the prevention of CRC.MethodsPolicy1-Bowel was recalibrated to reproduce statistical age-period-cohort model trends and projections of CRC incidence for 1995-2045 in the absence of the NBCSP as well as published data on CRC incidence trends, stage distribution, and survival in 1995-2020 in Australia. The recalibrated Policy1-Bowel predictions were validated by comparison with published Australian CRC mortality trends for 1995-2015 and statistical projections to 2040. Metamodels were developed to aid the calibration process and significantly reduce the computational burden.ResultsPolicy1-Bowel was recalibrated, and best-fit parameter sets were identified for lesion incidence, CRC stage progression rates, detection rates, and survival rates by age, sex, bowel location, cancer stage, and birth year. The recalibrated model was validated and successfully reproduced observed CRC mortality rates for 1995-2015 and statistical projections for 2016-2030.ConclusionThe recalibrated Policy1-Bowel model captures significant additional detail on the future incidence and mortality burden of CRC in Australia. This is particularly relevant as younger cohorts with higher CRC incidence rates approach screening ages to inform decision making for these groups. The metamodeling approach allows fast recalibration and makes regular updates to incorporate new evidence feasible.HighlightsIn Australia, colorectal cancer incidence rates are increasing for people younger than 50 y but decreasing for people older than 50 y, and colorectal cancer survival is improving as new treatment technologies emerge.To evaluate the future health and economic impact of screening and inform policy, modeling must include detailed trends and projections of colorectal cancer incidence, mortality, and diagnosis stage.We used novel techniques including integrative age-period cohort projections and metamodel calibration to update Policy1-Bowel, a detailed microsimulation of colorectal cancer and screening in Australia.

{"title":"Recalibrating an Established Microsimulation Model to Capture Trends and Projections of Colorectal Cancer Incidence and Mortality.","authors":"Jie-Bin Lew, Qingwei Luo, Joachim Worthington, Han Ge, Emily He, Julia Steinberg, Michael Caruana, Dianne L O'Connell, Eleonora Feletto, Karen Canfell","doi":"10.1177/0272989X251314050","DOIUrl":"10.1177/0272989X251314050","url":null,"abstract":"<p><p>BackgroundChanging colorectal cancer (CRC) incidence rates, including recent increases for people younger than 50 y, need to be considered in planning for future cancer control and screening initiatives. Reliable estimates of the impact of changing CRC trends on the National Bowel Cancer Screening Program (NBCSP) are essential for programmatic planning in Australia. An existing microsimulation model of CRC, <i>Policy1-Bowel</i>, was updated to reproduce Australian CRC trends data and provide updated projections of CRC- and screening-related outcomes to inform clinical practice guidelines for the prevention of CRC.Methods<i>Policy1-Bowel</i> was recalibrated to reproduce statistical age-period-cohort model trends and projections of CRC incidence for 1995-2045 in the absence of the NBCSP as well as published data on CRC incidence trends, stage distribution, and survival in 1995-2020 in Australia. The recalibrated <i>Policy1-Bowel</i> predictions were validated by comparison with published Australian CRC mortality trends for 1995-2015 and statistical projections to 2040. Metamodels were developed to aid the calibration process and significantly reduce the computational burden.Results<i>Policy1-Bowel</i> was recalibrated, and best-fit parameter sets were identified for lesion incidence, CRC stage progression rates, detection rates, and survival rates by age, sex, bowel location, cancer stage, and birth year. The recalibrated model was validated and successfully reproduced observed CRC mortality rates for 1995-2015 and statistical projections for 2016-2030.ConclusionThe recalibrated <i>Policy1-Bowel</i> model captures significant additional detail on the future incidence and mortality burden of CRC in Australia. This is particularly relevant as younger cohorts with higher CRC incidence rates approach screening ages to inform decision making for these groups. The metamodeling approach allows fast recalibration and makes regular updates to incorporate new evidence feasible.HighlightsIn Australia, colorectal cancer incidence rates are increasing for people younger than 50 y but decreasing for people older than 50 y, and colorectal cancer survival is improving as new treatment technologies emerge.To evaluate the future health and economic impact of screening and inform policy, modeling must include detailed trends and projections of colorectal cancer incidence, mortality, and diagnosis stage.We used novel techniques including integrative age-period cohort projections and metamodel calibration to update <i>Policy1-Bowel</i>, a detailed microsimulation of colorectal cancer and screening in Australia.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"257-275"},"PeriodicalIF":3.1,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143366553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development of a Microsimulation Model to Project the Future Prevalence of Childhood Cancer in Ontario, Canada. 开发微观模拟模型,预测加拿大安大略省儿童癌症的未来发病率。
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-04-01 Epub Date: 2025-02-04 DOI: 10.1177/0272989X251314031
Alexandra Moskalewicz, Sumit Gupta, Paul C Nathan, Petros Pechlivanoglou

BackgroundEstimates of the future prevalence of childhood cancer are informative for health system planning but are underutilized. We describe the development of a pediatric oncology microsimulation model for prevalence (POSIM-Prev) and illustrate its application to produce projections of incidence, survival, and limited-duration prevalence of childhood cancer in Ontario, Canada, until 2040.MethodsPOSIM-Prev is a population-based, open-cohort, discrete-time microsimulation model. The model population was updated annually from 1970 to 2040 to account for births, deaths, net migration, and incident cases of childhood cancer. Prevalent individuals were followed until death, emigration, or the last year of simulation. Median population-based outcomes with 95% credible intervals (CrIs) were generated using Monte Carlo simulation. The methodology to derive model inputs included generalized additive modeling of cancer incidence, parametric survival modeling, and stochastic population forecasting. Individual-level data from provincial cancer registries for years 1970 to 2019 informed cancer-related model inputs and internal validation.ResultsThe number of children (aged 0-14 y) diagnosed with cancer in Ontario is projected to rise from 414 (95% CrI: 353-486) in 2020 to 561 (95% CrI: 481-653) in 2039. The 5-y overall survival rate for 2030-2034 is estimated to reach 90% (95% CrI: 88%-92%). By 2040, 24,088 (95% CrI: 22,764-25,648) individuals with a history of childhood cancer (diagnosed in Ontario or elsewhere) are projected to reside in the province. The model accurately reproduced historical trends in incidence, survival, and prevalence when validated.ConclusionsThe rising incidence and prevalence of childhood cancer will create increased demand for both acute cancer care and long-term follow-up services in Ontario. The POSIM-Prev model can be used to support long-range health system planning and future health technology assessments in jurisdictions that have access to similar model inputs.HighlightsThis article describes the development of a population-based, discrete-time microsimulation model that can simulate incident and prevalent cases of childhood cancer in Ontario, Canada, until 2040.Use of an open cohort framework allowed for estimation of the potential impact of net migration on childhood cancer prevalence.In addition to supporting long-term health system planning, this model can be used in future health technology assessments, by providing a demographic profile of incident and prevalent cases for model conceptualization and budget impact purposes.This modeling framework is adaptable to other jurisdictions and disease areas where individual-level data for incidence and survival are available.

{"title":"Development of a Microsimulation Model to Project the Future Prevalence of Childhood Cancer in Ontario, Canada.","authors":"Alexandra Moskalewicz, Sumit Gupta, Paul C Nathan, Petros Pechlivanoglou","doi":"10.1177/0272989X251314031","DOIUrl":"10.1177/0272989X251314031","url":null,"abstract":"<p><p>BackgroundEstimates of the future prevalence of childhood cancer are informative for health system planning but are underutilized. We describe the development of a pediatric oncology microsimulation model for prevalence (POSIM-Prev) and illustrate its application to produce projections of incidence, survival, and limited-duration prevalence of childhood cancer in Ontario, Canada, until 2040.MethodsPOSIM-Prev is a population-based, open-cohort, discrete-time microsimulation model. The model population was updated annually from 1970 to 2040 to account for births, deaths, net migration, and incident cases of childhood cancer. Prevalent individuals were followed until death, emigration, or the last year of simulation. Median population-based outcomes with 95% credible intervals (CrIs) were generated using Monte Carlo simulation. The methodology to derive model inputs included generalized additive modeling of cancer incidence, parametric survival modeling, and stochastic population forecasting. Individual-level data from provincial cancer registries for years 1970 to 2019 informed cancer-related model inputs and internal validation.ResultsThe number of children (aged 0-14 y) diagnosed with cancer in Ontario is projected to rise from 414 (95% CrI: 353-486) in 2020 to 561 (95% CrI: 481-653) in 2039. The 5-y overall survival rate for 2030-2034 is estimated to reach 90% (95% CrI: 88%-92%). By 2040, 24,088 (95% CrI: 22,764-25,648) individuals with a history of childhood cancer (diagnosed in Ontario or elsewhere) are projected to reside in the province. The model accurately reproduced historical trends in incidence, survival, and prevalence when validated.ConclusionsThe rising incidence and prevalence of childhood cancer will create increased demand for both acute cancer care and long-term follow-up services in Ontario. The POSIM-Prev model can be used to support long-range health system planning and future health technology assessments in jurisdictions that have access to similar model inputs.HighlightsThis article describes the development of a population-based, discrete-time microsimulation model that can simulate incident and prevalent cases of childhood cancer in Ontario, Canada, until 2040.Use of an open cohort framework allowed for estimation of the potential impact of net migration on childhood cancer prevalence.In addition to supporting long-term health system planning, this model can be used in future health technology assessments, by providing a demographic profile of incident and prevalent cases for model conceptualization and budget impact purposes.This modeling framework is adaptable to other jurisdictions and disease areas where individual-level data for incidence and survival are available.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"245-256"},"PeriodicalIF":3.1,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143191036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development of a Decision Model to Estimate the Outcomes of Treatment Sequences in Advanced Melanoma.
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-04-01 Epub Date: 2025-02-22 DOI: 10.1177/0272989X251319338
Saskia de Groot, Hedwig M Blommestein, Brenda Leeneman, Carin A Uyl-de Groot, John B A G Haanen, Michel W J M Wouters, Maureen J B Aarts, Franchette W P J van den Berkmortel, Willeke A M Blokx, Marye J Boers-Sonderen, Alfons J M van den Eertwegh, Jan Willem B de Groot, Geke A P Hospers, Ellen Kapiteijn, Olivier J van Not, Astrid A M van der Veldt, Karijn P M Suijkerbuijk, Pieter H M van Baal

BackgroundA decision model for patients with advanced melanoma to estimate outcomes of a wide range of treatment sequences is lacking.ObjectivesTo develop a decision model for advanced melanoma to estimate outcomes of treatment sequences in clinical practice with the aim of supporting decision making. The article focuses on methodology and long-term health benefits.MethodsA semi-Markov model with a lifetime horizon was developed. Transitions describing disease progression, time to next treatment, and mortality were estimated from real-world data (RWD) as a function of time since starting treatment or disease progression and patient characteristics. Transitions were estimated separately for melanoma with and without a BRAF mutation and for patients with favorable and intermediate prognostic factors. All transitions can be adjusted using relative effectiveness of treatments derived from a network meta-analysis of randomized controlled trials (RCTs). The duration of treatment effect can be adjusted to obtain outcomes under different assumptions.ResultsThe model distinguishes 3 lines of systemic treatment for melanoma with a BRAF mutation and 2 lines of systemic treatment for melanoma without a BRAF mutation. Life expectancy ranged from 7.8 to 12.0 years in patients with favorable prognostic factors and from 5.1 to 8.7 years in patients with intermediate prognostic factors when treated with sequences consisting of targeted therapies and immunotherapies. Scenario analyses illustrate how estimates of life expectancy depend on the duration of treatment effect.ConclusionThe model is flexible because it can accommodate different treatments and treatment sequences, and the duration of treatment effects and the transitions influenced by treatment can be adjusted. We show how using RWD and data from RCTs can harness advantages of both data sources, guiding the development of future decision models.HighlightsThe model is flexible because it can accommodate different treatments and treatment sequences, and the duration of treatment effects as well as the transitions that are influenced by treatment can be adjusted.The long-term health benefits of treatment sequences depend on the place of different therapies within a treatment sequence.Assumptions about the duration of relative treatment effects influence the estimates of long-term health benefits.We show how the use of real-world data and data from randomized controlled trials harness the advantages of both data sources, guiding the development of future decision models.

{"title":"Development of a Decision Model to Estimate the Outcomes of Treatment Sequences in Advanced Melanoma.","authors":"Saskia de Groot, Hedwig M Blommestein, Brenda Leeneman, Carin A Uyl-de Groot, John B A G Haanen, Michel W J M Wouters, Maureen J B Aarts, Franchette W P J van den Berkmortel, Willeke A M Blokx, Marye J Boers-Sonderen, Alfons J M van den Eertwegh, Jan Willem B de Groot, Geke A P Hospers, Ellen Kapiteijn, Olivier J van Not, Astrid A M van der Veldt, Karijn P M Suijkerbuijk, Pieter H M van Baal","doi":"10.1177/0272989X251319338","DOIUrl":"10.1177/0272989X251319338","url":null,"abstract":"<p><p>BackgroundA decision model for patients with advanced melanoma to estimate outcomes of a wide range of treatment sequences is lacking.ObjectivesTo develop a decision model for advanced melanoma to estimate outcomes of treatment sequences in clinical practice with the aim of supporting decision making. The article focuses on methodology and long-term health benefits.MethodsA semi-Markov model with a lifetime horizon was developed. Transitions describing disease progression, time to next treatment, and mortality were estimated from real-world data (RWD) as a function of time since starting treatment or disease progression and patient characteristics. Transitions were estimated separately for melanoma with and without a BRAF mutation and for patients with favorable and intermediate prognostic factors. All transitions can be adjusted using relative effectiveness of treatments derived from a network meta-analysis of randomized controlled trials (RCTs). The duration of treatment effect can be adjusted to obtain outcomes under different assumptions.ResultsThe model distinguishes 3 lines of systemic treatment for melanoma with a BRAF mutation and 2 lines of systemic treatment for melanoma without a BRAF mutation. Life expectancy ranged from 7.8 to 12.0 years in patients with favorable prognostic factors and from 5.1 to 8.7 years in patients with intermediate prognostic factors when treated with sequences consisting of targeted therapies and immunotherapies. Scenario analyses illustrate how estimates of life expectancy depend on the duration of treatment effect.ConclusionThe model is flexible because it can accommodate different treatments and treatment sequences, and the duration of treatment effects and the transitions influenced by treatment can be adjusted. We show how using RWD and data from RCTs can harness advantages of both data sources, guiding the development of future decision models.HighlightsThe model is flexible because it can accommodate different treatments and treatment sequences, and the duration of treatment effects as well as the transitions that are influenced by treatment can be adjusted.The long-term health benefits of treatment sequences depend on the place of different therapies within a treatment sequence.Assumptions about the duration of relative treatment effects influence the estimates of long-term health benefits.We show how the use of real-world data and data from randomized controlled trials harness the advantages of both data sources, guiding the development of future decision models.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"302-317"},"PeriodicalIF":3.1,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11894896/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143476920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Leveling up: Treating Uptake as Endogenous May Increase the Value of Screening Programs.
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-04-01 Epub Date: 2025-02-24 DOI: 10.1177/0272989X251319794
Jose A Robles-Zurita, Neil Hawkins, Janet Bouttell

BackgroundWe aimed to illustrate that health economists should consider individual heterogeneity when solving the problem of finding the optimal combination of sensitivity and specificity that maximizes the average health utility of a target population in a screening program.MethodsA theoretical framework compares the solution under standard economics of diagnoses to the optimal combination under an endogenous uptake analysis, where screening participation is given by heterogenous health preferences. An applied example used calibrated parameters with real data from the bowel cancer screening program in the United Kingdom. Scenario analyses show how the results would change with parameter values, if disease risk and health utilities were not independent and if screening uptake were not completely determined by health preferences.ResultsA general theoretical result states that the endogenous uptake analysis leads to a weakly higher true- and false-positive rate than would be optimal under the standard approach. In the same way, the endogenous solution would lead to a lower uptake rate. The base-case scenario of the applied example illustrates that a screening program using the endogenous solution would generate 21.1% more quality-adjusted life-years than when using the standard solution. The scenario analyses show when the endogenous analysis is most valued and that the general result applies for a wide range of situations when theoretical assumptions are relaxed.LimitationsThe results obtained are valid under the assumptions made. Analysts should evaluate if those could hold in the applied screening context.ConclusionsIndividual heterogeneity and uptake decisions are relevant factors to consider in the problem of finding an optimal combination of sensitivity and specificity for a screening test.HighlightsThe value of screening programs can be higher if heterogeneity of preferences in the target population is considered.The optimal operation of a screening test depends on health utilities of the target population and on the heterogeneity of these health utilities.Under heterogeneity of health utilities, the optimal operation of a screening test does not maximize screening uptake.A general theoretical result states that the endogenous uptake analysis leads to a weakly higher true- and false-positive rate than would be optimal under a standard approach; this is true for a wide range of situations.

{"title":"Leveling up: Treating Uptake as Endogenous May Increase the Value of Screening Programs.","authors":"Jose A Robles-Zurita, Neil Hawkins, Janet Bouttell","doi":"10.1177/0272989X251319794","DOIUrl":"10.1177/0272989X251319794","url":null,"abstract":"<p><p>BackgroundWe aimed to illustrate that health economists should consider individual heterogeneity when solving the problem of finding the optimal combination of sensitivity and specificity that maximizes the average health utility of a target population in a screening program.MethodsA theoretical framework compares the solution under standard economics of diagnoses to the optimal combination under an endogenous uptake analysis, where screening participation is given by heterogenous health preferences. An applied example used calibrated parameters with real data from the bowel cancer screening program in the United Kingdom. Scenario analyses show how the results would change with parameter values, if disease risk and health utilities were not independent and if screening uptake were not completely determined by health preferences.ResultsA general theoretical result states that the endogenous uptake analysis leads to a weakly higher true- and false-positive rate than would be optimal under the standard approach. In the same way, the endogenous solution would lead to a lower uptake rate. The base-case scenario of the applied example illustrates that a screening program using the endogenous solution would generate 21.1% more quality-adjusted life-years than when using the standard solution. The scenario analyses show when the endogenous analysis is most valued and that the general result applies for a wide range of situations when theoretical assumptions are relaxed.LimitationsThe results obtained are valid under the assumptions made. Analysts should evaluate if those could hold in the applied screening context.ConclusionsIndividual heterogeneity and uptake decisions are relevant factors to consider in the problem of finding an optimal combination of sensitivity and specificity for a screening test.HighlightsThe value of screening programs can be higher if heterogeneity of preferences in the target population is considered.The optimal operation of a screening test depends on health utilities of the target population and on the heterogeneity of these health utilities.Under heterogeneity of health utilities, the optimal operation of a screening test does not maximize screening uptake.A general theoretical result states that the endogenous uptake analysis leads to a weakly higher true- and false-positive rate than would be optimal under a standard approach; this is true for a wide range of situations.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"318-331"},"PeriodicalIF":3.1,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143484436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Changing Time Representation in Microsimulation Models.
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-04-01 Epub Date: 2025-02-25 DOI: 10.1177/0272989X251319808
Eric Kai-Chung Wong, Wanrudee Isaranuwatchai, Joanna E M Sale, Andrea C Tricco, Sharon E Straus, David M J Naimark

BackgroundIn microsimulation models of diseases with an early, acute phase requiring short cycle lengths followed by a chronic phase, fixed short cycles may lead to computational inefficiency. Examples include epidemic or resource constraint models with early short cycles where long-term economic consequences are of interest for individuals surviving the epidemic or ultimately obtaining the resource. In this article, we demonstrate methods to improve efficiency in such scenarios. Furthermore, we show that care must be taken when applying these methods to epidemic or resource constraint models to avoid bias.MethodsTo demonstrate efficiency, we compared the model runtime among 3 versions of a microsimulation model: with short fixed cycles for all states (FCL), with dynamic cycle length (DCL) defined locally for each state, and with DCL features plus a discrete-event-like hybrid component. To demonstrate bias mitigation, we compared discounted lifetime costs for 3 versions of a resource constraint model: with a fixed horizon where simulation stops, with a fixed entry horizon beyond which new individuals could not enter the model, and with a fixed entry horizon plus a mechanism to maintain a constant level of competition for the resource after the horizon.ResultsThe 3 versions of the microsimulation model had average runtimes of 515 (95% credible interval [CI]: 477 to 545; FCL), 2.70 (95% CI: 1.48 to 2.92; DCL), and 1.45 (95% CI: 1.26 to 2.61; DCL-pseudo discrete event simulation) seconds, respectively. The first 2 resource constraint versions underestimated costs relative to the constant competition version: $20,055 (95% CI: $19,000 to $21,120), $27,030 (95% CI: $24,680 to $29,412), and $33,424 (95% CI: $27,510 to $44,484), respectively.LimitationsThe magnitude of improvements in efficiency and reduction in bias may be model specific.ConclusionChanging time representation in microsimulation may offer computational advantages.HighlightsShort cycle lengths may be required to model the acute phase of an illness but lead to computational inefficiency in a subsequent chronic phase in microsimulation models.A solution is to create state-specific cycle lengths so that cycle lengths change dynamically as the simulation progresses.Computational efficiency can be enhanced further by using a hybrid model containing discrete-event-simulation-like features.Hybrid models can efficiently handle events subsequent to exit from an epidemic or resource constraint model provided steps are taken to mitigate potential bias.

背景:在疾病的微观模拟模型中,早期急性期需要较短的周期长度,随后是慢性期,固定的短周期可能会导致计算效率低下。这方面的例子包括具有早期短周期的流行病或资源约束模型,在这些模型中,个人在流行病中存活或最终获得资源的长期经济后果很重要。在本文中,我们展示了在这种情况下提高效率的方法。此外,我们还展示了将这些方法应用于流行病或资源限制模型时必须注意的问题,以避免偏差:为了证明效率,我们比较了微观模拟模型 3 个版本的模型运行时间:所有状态的短固定周期(FCL)、每个状态局部定义的动态周期长度(DCL)以及 DCL 特征加上类似离散事件的混合组件。为了证明偏差的缓解,我们比较了 3 个版本的资源约束模型的贴现寿命成本:模拟停止的固定时间跨度、超过时间跨度新个体无法进入模型的固定进入时间跨度,以及固定进入时间跨度加上在时间跨度后保持资源竞争水平不变的机制:三个版本的微观模拟模型的平均运行时间分别为 515 秒(95% 可信区间[CI]:477 至 545;FCL)、2.70 秒(95% 可信区间[CI]:1.48 至 2.92;DCL)和 1.45 秒(95% 可信区间[CI]:1.26 至 2.61;DCL-伪离散事件模拟)。与恒定竞争版本相比,前两个资源限制版本低估了成本:分别为 20,055 美元(95% CI:19,000 美元至 21,120 美元)、27,030 美元(95% CI:24,680 美元至 29,412 美元)和 33,424 美元(95% CI:27,510 美元至 44,484 美元):局限性:提高效率和减少偏差的幅度可能与模型有关:结论:在微观模拟中改变时间表示可能会带来计算优势:在微观模拟模型中,可能需要较短的周期长度来模拟疾病的急性期,但在随后的慢性期会导致计算效率低下。解决方法是创建特定状态的周期长度,使周期长度随着模拟的进行而动态变化。
{"title":"Changing Time Representation in Microsimulation Models.","authors":"Eric Kai-Chung Wong, Wanrudee Isaranuwatchai, Joanna E M Sale, Andrea C Tricco, Sharon E Straus, David M J Naimark","doi":"10.1177/0272989X251319808","DOIUrl":"10.1177/0272989X251319808","url":null,"abstract":"<p><p>BackgroundIn microsimulation models of diseases with an early, acute phase requiring short cycle lengths followed by a chronic phase, fixed short cycles may lead to computational inefficiency. Examples include epidemic or resource constraint models with early short cycles where long-term economic consequences are of interest for individuals surviving the epidemic or ultimately obtaining the resource. In this article, we demonstrate methods to improve efficiency in such scenarios. Furthermore, we show that care must be taken when applying these methods to epidemic or resource constraint models to avoid bias.MethodsTo demonstrate efficiency, we compared the model runtime among 3 versions of a microsimulation model: with short fixed cycles for all states (FCL), with dynamic cycle length (DCL) defined locally for each state, and with DCL features plus a discrete-event-like hybrid component. To demonstrate bias mitigation, we compared discounted lifetime costs for 3 versions of a resource constraint model: with a fixed horizon where simulation stops, with a fixed entry horizon beyond which new individuals could not enter the model, and with a fixed entry horizon plus a mechanism to maintain a constant level of competition for the resource after the horizon.ResultsThe 3 versions of the microsimulation model had average runtimes of 515 (95% credible interval [CI]: 477 to 545; FCL), 2.70 (95% CI: 1.48 to 2.92; DCL), and 1.45 (95% CI: 1.26 to 2.61; DCL-pseudo discrete event simulation) seconds, respectively. The first 2 resource constraint versions underestimated costs relative to the constant competition version: $20,055 (95% CI: $19,000 to $21,120), $27,030 (95% CI: $24,680 to $29,412), and $33,424 (95% CI: $27,510 to $44,484), respectively.LimitationsThe magnitude of improvements in efficiency and reduction in bias may be model specific.ConclusionChanging time representation in microsimulation may offer computational advantages.HighlightsShort cycle lengths may be required to model the acute phase of an illness but lead to computational inefficiency in a subsequent chronic phase in microsimulation models.A solution is to create state-specific cycle lengths so that cycle lengths change dynamically as the simulation progresses.Computational efficiency can be enhanced further by using a hybrid model containing discrete-event-simulation-like features.Hybrid models can efficiently handle events subsequent to exit from an epidemic or resource constraint model provided steps are taken to mitigate potential bias.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"276-285"},"PeriodicalIF":3.1,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11894904/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143494530","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Expected Value of Sample Information Calculations for Risk Prediction Model Validation.
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-04-01 Epub Date: 2025-02-18 DOI: 10.1177/0272989X251314010
Mohsen Sadatsafavi, Andrew J Vickers, Tae Yoon Lee, Paul Gustafson, Laure Wynants

BackgroundThe purpose of external validation of a risk prediction model is to evaluate its performance before recommending it for use in a new population. Sample size calculations for such validation studies are currently based on classical inferential statistics around metrics of discrimination, calibration, and net benefit (NB). For NB as a measure of clinical utility, the relevance of inferential statistics is doubtful. Value-of-information methodology enables quantifying the value of collecting validation data in terms of expected gain in clinical utility.MethodsWe define the validation expected value of sample information (EVSI) as the expected gain in NB by procuring a validation sample of a given size. We propose 3 algorithms for EVSI computation and compare their face validity and computation time in simulation studies. In a case study, we use the non-US subset of a clinical trial to create a risk prediction model for short-term mortality after myocardial infarction and calculate validation EVSI at a range of sample sizes for the US population.ResultsComputation methods generated similar EVSI values in simulation studies, although they differed in numerical accuracy and computation times. At 2% risk threshold, procuring 1,000 observations for external validation, had an EVSI of 0.00101 in true-positive units or 0.04938 in false-positive units. Scaled by heart attack incidence in the United States, the population EVSI was 806 in true positives gained, or 39,500 in false positives averted, annually. Validation studies with >4,000 observations had diminishing returns, as the EVSIs were approaching their maximum possible value.ConclusionValue-of-information methodology quantifies the return on investment from conducting an external validation study and can provide a value-based perspective when designing such studies.HighlightsIn external validation studies of risk prediction models, the finite size of the validation sample leads to uncertain conclusions about the performance of the model. This uncertainty has hitherto been approached from a classical inferential perspective (e.g., confidence interval around the c-statistic).Correspondingly, sample size calculations for validation studies have been based on classical inferential statistics. For measures of clinical utility such as net benefit, the relevance of this approach is doubtful.This article defines the expected value of sample information (EVSI) for model validation and suggests algorithms for its computation. Validation EVSI quantifies the return on investment from conducting a validation study.Value-based approaches rooted in decision theory can complement contemporary study design and sample size calculation methods in predictive analytics.

{"title":"Expected Value of Sample Information Calculations for Risk Prediction Model Validation.","authors":"Mohsen Sadatsafavi, Andrew J Vickers, Tae Yoon Lee, Paul Gustafson, Laure Wynants","doi":"10.1177/0272989X251314010","DOIUrl":"10.1177/0272989X251314010","url":null,"abstract":"<p><p>BackgroundThe purpose of external validation of a risk prediction model is to evaluate its performance before recommending it for use in a new population. Sample size calculations for such validation studies are currently based on classical inferential statistics around metrics of discrimination, calibration, and net benefit (NB). For NB as a measure of clinical utility, the relevance of inferential statistics is doubtful. Value-of-information methodology enables quantifying the value of collecting validation data in terms of expected gain in clinical utility.MethodsWe define the validation expected value of sample information (EVSI) as the expected gain in NB by procuring a validation sample of a given size. We propose 3 algorithms for EVSI computation and compare their face validity and computation time in simulation studies. In a case study, we use the non-US subset of a clinical trial to create a risk prediction model for short-term mortality after myocardial infarction and calculate validation EVSI at a range of sample sizes for the US population.ResultsComputation methods generated similar EVSI values in simulation studies, although they differed in numerical accuracy and computation times. At 2% risk threshold, procuring 1,000 observations for external validation, had an EVSI of 0.00101 in true-positive units or 0.04938 in false-positive units. Scaled by heart attack incidence in the United States, the population EVSI was 806 in true positives gained, or 39,500 in false positives averted, annually. Validation studies with >4,000 observations had diminishing returns, as the EVSIs were approaching their maximum possible value.ConclusionValue-of-information methodology quantifies the return on investment from conducting an external validation study and can provide a value-based perspective when designing such studies.HighlightsIn external validation studies of risk prediction models, the finite size of the validation sample leads to uncertain conclusions about the performance of the model. This uncertainty has hitherto been approached from a classical inferential perspective (e.g., confidence interval around the c-statistic).Correspondingly, sample size calculations for validation studies have been based on classical inferential statistics. For measures of clinical utility such as net benefit, the relevance of this approach is doubtful.This article defines the expected value of sample information (EVSI) for model validation and suggests algorithms for its computation. Validation EVSI quantifies the return on investment from conducting a validation study.Value-based approaches rooted in decision theory can complement contemporary study design and sample size calculation methods in predictive analytics.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"232-244"},"PeriodicalIF":3.1,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11894915/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143442599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
People Living with Chronic Pain Experience a High Prevalence of Decision Regret in Canada: A Pan-Canadian Online Survey.
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-03-22 DOI: 10.1177/0272989X251326069
Florian Naye, Yannick Tousignant-Laflamme, Maxime Sasseville, Chloé Cachinho, Thomas Gérard, Karine Toupin-April, Olivia Dubois, Jean-Sébastien Paquette, Annie LeBlanc, Isabelle Gaboury, Marie-Ève Poitras, Linda C Li, Alison M Hoens, Marie-Dominique Poirier, France Légaré, Simon Décary

Background(1) To estimate the prevalence of decision regret in chronic pain care, and (2) to identify factors associated with decision regret.DesignWe conducted a pan-Canadian cross-sectional online survey and reported the results following the Checklist for Reporting of Survey Studies guidelines. We recruited a sample of adults experiencing chronic noncancer pain. We used a stratified proportional random sampling based on the population and chronic pain prevalence of each province. We measured decision regret with the Decision Regret Scale (DRS) and decisional needs with the Ottawa Decision Support Framework. We performed descriptive analysis to estimate the prevalence and level of decision regret and multilevel multivariable regression analysis to identify factors associated with regret according to the STRengthening Analytical Thinking for Observational Studies recommendations.ResultsWe surveyed 1,649 people living with chronic pain, and 1,373 reported a most difficult decision from the 10 prespecified ones, enabling the collection of a DRS score. On a scale ranging from 0 to 100 where 1 reflects the presence of decision regret and 25 constitutes important decision regret, the mean DRS score in our sample was 28.8 (s = 19.6). Eighty-four percent of respondents experienced some decision regret and 50% at an important level. We identified 15 factors associated with decision regret, including 4 personal and 9 decision-making characteristics, and 2 consequences of the chosen option. Respondents with low education level and higher decisional conflict experienced more decision regret when the decision was deemed difficult.ConclusionsThis pan-Canadian survey highlighted a high prevalence and level of decision regret associated with difficult decisions for pain care. Decision making in pain care could be enhanced by addressing factors that contribute to decision regret.HighlightsWe conducted an online pan-Canadian survey and collected responses from a wide diversity of people living with chronic pain.More than 84% of respondents experienced decision regret and approximately 50% at an important level.We identified 15 factors associated with decision regret, including 4 personal and 9 decision-making characteristics, and 2 consequences of the chosen option.Our pan-Canadian survey reveals an urgent need of a shared decision-making approach in chronic pain care that can be potentiated by targeting multiple factors associated with decision regret.

{"title":"People Living with Chronic Pain Experience a High Prevalence of Decision Regret in Canada: A Pan-Canadian Online Survey.","authors":"Florian Naye, Yannick Tousignant-Laflamme, Maxime Sasseville, Chloé Cachinho, Thomas Gérard, Karine Toupin-April, Olivia Dubois, Jean-Sébastien Paquette, Annie LeBlanc, Isabelle Gaboury, Marie-Ève Poitras, Linda C Li, Alison M Hoens, Marie-Dominique Poirier, France Légaré, Simon Décary","doi":"10.1177/0272989X251326069","DOIUrl":"https://doi.org/10.1177/0272989X251326069","url":null,"abstract":"<p><p>Background(1) To estimate the prevalence of decision regret in chronic pain care, and (2) to identify factors associated with decision regret.DesignWe conducted a pan-Canadian cross-sectional online survey and reported the results following the Checklist for Reporting of Survey Studies guidelines. We recruited a sample of adults experiencing chronic noncancer pain. We used a stratified proportional random sampling based on the population and chronic pain prevalence of each province. We measured decision regret with the Decision Regret Scale (DRS) and decisional needs with the Ottawa Decision Support Framework. We performed descriptive analysis to estimate the prevalence and level of decision regret and multilevel multivariable regression analysis to identify factors associated with regret according to the STRengthening Analytical Thinking for Observational Studies recommendations.ResultsWe surveyed 1,649 people living with chronic pain, and 1,373 reported a most difficult decision from the 10 prespecified ones, enabling the collection of a DRS score. On a scale ranging from 0 to 100 where 1 reflects the presence of decision regret and 25 constitutes important decision regret, the mean DRS score in our sample was 28.8 (<i>s</i> = 19.6). Eighty-four percent of respondents experienced some decision regret and 50% at an important level. We identified 15 factors associated with decision regret, including 4 personal and 9 decision-making characteristics, and 2 consequences of the chosen option. Respondents with low education level and higher decisional conflict experienced more decision regret when the decision was deemed difficult.ConclusionsThis pan-Canadian survey highlighted a high prevalence and level of decision regret associated with difficult decisions for pain care. Decision making in pain care could be enhanced by addressing factors that contribute to decision regret.HighlightsWe conducted an online pan-Canadian survey and collected responses from a wide diversity of people living with chronic pain.More than 84% of respondents experienced decision regret and approximately 50% at an important level.We identified 15 factors associated with decision regret, including 4 personal and 9 decision-making characteristics, and 2 consequences of the chosen option.Our pan-Canadian survey reveals an urgent need of a shared decision-making approach in chronic pain care that can be potentiated by targeting multiple factors associated with decision regret.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":" ","pages":"272989X251326069"},"PeriodicalIF":3.1,"publicationDate":"2025-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143677338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Medical Decision Making
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1