Pub Date : 2021-03-09DOI: 10.1007/s10742-021-00245-9
Katelyn Cordell, H. Rao, John Lyons
{"title":"Authentic assessments: a method to detect anomalies in assessment response patterns via neural network","authors":"Katelyn Cordell, H. Rao, John Lyons","doi":"10.1007/s10742-021-00245-9","DOIUrl":"https://doi.org/10.1007/s10742-021-00245-9","url":null,"abstract":"","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78030617","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-03-01Epub Date: 2021-01-04DOI: 10.1007/s10742-020-00230-8
Guanqing Chen, Valerie A Lewis, Daniel Gottlieb, A James O'Malley
First introduced in early 2000s, the accountable care organization (ACO) is designed to lower health care costs while improving quality of care and has become one of the most important coordinated care technologies in the United States. In this research, we use the Medicare fee-for-service claims data from 2009-2014 to estimate the heterogeneous effects of Medicare ACO programs on hospital admissions across hospital referral regions (HRRs) and provider groups. To conduct our analysis, a model for a difference-in-difference (DID) study is embellished in multiple ways to account for intricacies and complexity with the data not able to be accounted for using existing models. Of particular note, we propose a Gaussian mixture model to account for the inability to observe the practice group affiliation of physicians if the organization they worked for did not become an ACO, which is needed to ensure appropriate partitioning of variation across the different units. The results suggest that the ACO programs reduced the rate of readmission to hospital, that the ACO program may have reduced heterogeneity in readmission rates, and that the effect of joining an ACO varied considerably across medical groups.
{"title":"Estimating Heterogeneous Effects of a Policy Intervention across Organizations when Organization Affiliation is Missing for the Control Group: Application to the Evaluation of Accountable Care Organizations.","authors":"Guanqing Chen, Valerie A Lewis, Daniel Gottlieb, A James O'Malley","doi":"10.1007/s10742-020-00230-8","DOIUrl":"https://doi.org/10.1007/s10742-020-00230-8","url":null,"abstract":"<p><p>First introduced in early 2000s, the accountable care organization (ACO) is designed to lower health care costs while improving quality of care and has become one of the most important coordinated care technologies in the United States. In this research, we use the Medicare fee-for-service claims data from 2009-2014 to estimate the heterogeneous effects of Medicare ACO programs on hospital admissions across hospital referral regions (HRRs) and provider groups. To conduct our analysis, a model for a difference-in-difference (DID) study is embellished in multiple ways to account for intricacies and complexity with the data not able to be accounted for using existing models. Of particular note, we propose a Gaussian mixture model to account for the inability to observe the practice group affiliation of physicians if the organization they worked for did not become an ACO, which is needed to ensure appropriate partitioning of variation across the different units. The results suggest that the ACO programs reduced the rate of readmission to hospital, that the ACO program may have reduced heterogeneity in readmission rates, and that the effect of joining an ACO varied considerably across medical groups.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s10742-020-00230-8","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"25426299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-03-01Epub Date: 2020-11-12DOI: 10.1007/s10742-020-00228-2
Megan S Schuler, Beth Ann Griffin, Magdalena Cerdá, Emma E McGinty, Elizabeth A Stuart
Opioid-related mortality increased by nearly 400% between 2000 and 2018. In response, federal, state, and local governments have enacted a heterogeneous collection of opioid-related policies in an effort to reverse the opioid crisis, producing a policy landscape that is both complex and dynamic. Correspondingly, there has been a rise in opioid-policy related evaluation studies, as policymakers and other stakeholders seek to understand which policies are most effective. In this paper, we provide an overview of methodological challenges facing opioid policy researchers when evaluating the effects of opioid policies using observational data, as well as some potential solutions to those challenges. In particular, we discuss the following key challenges: (1) Obtaining high-quality opioid policy data; (2) Appropriately operationalizing and specifying opioid policies; (3) Obtaining high-quality opioid outcome data; (4) Addressing confounding due to systematic differences between policy and non-policy states; (5) Identifying heterogeneous policy effects across states, population subgroups, and time; (6) Disentangling effects of concurrent policies; and (7) Overcoming limited statistical power to detect policy effects afforded by commonly-used methods. We discuss each of these challenges and propose some ways forward to address them. Increasing the methodological rigor of opioid evaluation studies is imperative to identifying and implementing opioid policies that are most effective at reducing opioid-related harms.
{"title":"Methodological Challenges and Proposed Solutions for Evaluating Opioid Policy Effectiveness.","authors":"Megan S Schuler, Beth Ann Griffin, Magdalena Cerdá, Emma E McGinty, Elizabeth A Stuart","doi":"10.1007/s10742-020-00228-2","DOIUrl":"10.1007/s10742-020-00228-2","url":null,"abstract":"<p><p>Opioid-related mortality increased by nearly 400% between 2000 and 2018. In response, federal, state, and local governments have enacted a heterogeneous collection of opioid-related policies in an effort to reverse the opioid crisis, producing a policy landscape that is both complex and dynamic. Correspondingly, there has been a rise in opioid-policy related evaluation studies, as policymakers and other stakeholders seek to understand which policies are most effective. In this paper, we provide an overview of methodological challenges facing opioid policy researchers when evaluating the effects of opioid policies using observational data, as well as some potential solutions to those challenges. In particular, we discuss the following key challenges: (1) Obtaining high-quality opioid policy data; (2) Appropriately operationalizing and specifying opioid policies; (3) Obtaining high-quality opioid outcome data; (4) Addressing confounding due to systematic differences between policy and non-policy states; (5) Identifying heterogeneous policy effects across states, population subgroups, and time; (6) Disentangling effects of concurrent policies; and (7) Overcoming limited statistical power to detect policy effects afforded by commonly-used methods. We discuss each of these challenges and propose some ways forward to address them. Increasing the methodological rigor of opioid evaluation studies is imperative to identifying and implementing opioid policies that are most effective at reducing opioid-related harms.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8057700/pdf/nihms-1662029.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38817812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-03-01Epub Date: 2021-02-13DOI: 10.1007/s10742-020-00236-2
Brian G Vegetabile, Beth Ann Griffin, Donna L Coffman, Matthew Cefalu, Michael W Robbins, Daniel F McCaffrey
Weighted estimators are commonly used for estimating exposure effects in observational settings to establish causal relations. These estimators have a long history of development when the exposure of interest is binary and where the weights are typically functions of an estimated propensity score. Recent developments in optimization-based estimators for constructing weights in binary exposure settings, such as those based on entropy balancing, have shown more promise in estimating treatment effects than those methods that focus on the direct estimation of the propensity score using likelihood-based methods. This paper explores recent developments of entropy balancing methods to continuous exposure settings and the estimation of population dose-response curves using nonparametric estimation combined with entropy balancing weights, focusing on factors that would be important to applied researchers in medical or health services research. The methods developed here are applied to data from a study assessing the effect of non-randomized components of an evidence-based substance use treatment program on emotional and substance use clinical outcomes.
{"title":"Nonparametric Estimation of Population Average Dose-Response Curves using Entropy Balancing Weights for Continuous Exposures.","authors":"Brian G Vegetabile, Beth Ann Griffin, Donna L Coffman, Matthew Cefalu, Michael W Robbins, Daniel F McCaffrey","doi":"10.1007/s10742-020-00236-2","DOIUrl":"https://doi.org/10.1007/s10742-020-00236-2","url":null,"abstract":"<p><p>Weighted estimators are commonly used for estimating exposure effects in observational settings to establish causal relations. These estimators have a long history of development when the exposure of interest is binary and where the weights are typically functions of an estimated propensity score. Recent developments in optimization-based estimators for constructing weights in binary exposure settings, such as those based on entropy balancing, have shown more promise in estimating treatment effects than those methods that focus on the direct estimation of the propensity score using likelihood-based methods. This paper explores recent developments of entropy balancing methods to continuous exposure settings and the estimation of population dose-response curves using nonparametric estimation combined with entropy balancing weights, focusing on factors that would be important to applied researchers in medical or health services research. The methods developed here are applied to data from a study assessing the effect of non-randomized components of an evidence-based substance use treatment program on emotional and substance use clinical outcomes.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s10742-020-00236-2","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39385609","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-03-01Epub Date: 2020-11-05DOI: 10.1007/s10742-020-00227-3
David Kline, Yixuan Ji, Staci Hepler
Opioid misuse is a significant public health issue and a national epidemic with a high prevalence of associated morbidity and mortality. The epidemic is particularly severe in Ohio which has some of the highest overdose rates in the country. It is important to understand spatial and temporal trends of the opioid epidemic to learn more about areas that are most affected and to inform potential community interventions and resource allocation. We propose a multivariate spatio-temporal model to leverage existing surveillance measures, opioid-associated deaths and treatment admissions, to learn about the underlying epidemic for counties in Ohio. We do this using a temporally varying spatial factor that synthesizes information from both counts to estimate common underlying risk which we interpret as the burden of the epidemic. We demonstrate the use of this model with county-level data from 2007-2018 in Ohio. Through our model estimates, we identify counties with above and below average burden and examine how those regions have shifted over time given overall statewide trends. Specifically, we highlight the sustained above average burden of the opioid epidemic on southern Ohio throughout the 12 years examined.
{"title":"A multivariate spatio-temporal model of the opioid epidemic in Ohio: A factor model approach.","authors":"David Kline, Yixuan Ji, Staci Hepler","doi":"10.1007/s10742-020-00227-3","DOIUrl":"https://doi.org/10.1007/s10742-020-00227-3","url":null,"abstract":"<p><p>Opioid misuse is a significant public health issue and a national epidemic with a high prevalence of associated morbidity and mortality. The epidemic is particularly severe in Ohio which has some of the highest overdose rates in the country. It is important to understand spatial and temporal trends of the opioid epidemic to learn more about areas that are most affected and to inform potential community interventions and resource allocation. We propose a multivariate spatio-temporal model to leverage existing surveillance measures, opioid-associated deaths and treatment admissions, to learn about the underlying epidemic for counties in Ohio. We do this using a temporally varying spatial factor that synthesizes information from both counts to estimate common underlying risk which we interpret as the burden of the epidemic. We demonstrate the use of this model with county-level data from 2007-2018 in Ohio. Through our model estimates, we identify counties with above and below average burden and examine how those regions have shifted over time given overall statewide trends. Specifically, we highlight the sustained above average burden of the opioid epidemic on southern Ohio throughout the 12 years examined.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s10742-020-00227-3","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39219285","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-02-26DOI: 10.1007/s10742-021-00244-w
S. Lindner, K. McConnell
{"title":"Heterogeneous treatment effects and bias in the analysis of the stepped wedge design","authors":"S. Lindner, K. McConnell","doi":"10.1007/s10742-021-00244-w","DOIUrl":"https://doi.org/10.1007/s10742-021-00244-w","url":null,"abstract":"","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-02-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s10742-021-00244-w","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72398102","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-02-26DOI: 10.1007/s10742-023-00302-5
M. G. Kundu, S. Samanta, Shoubhik Mondal
{"title":"Conditional power, predictive power and probability of success in clinical trials with continuous, binary and time-to-event endpoints","authors":"M. G. Kundu, S. Samanta, Shoubhik Mondal","doi":"10.1007/s10742-023-00302-5","DOIUrl":"https://doi.org/10.1007/s10742-023-00302-5","url":null,"abstract":"","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-02-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81383892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-02-24DOI: 10.1007/s10742-021-00243-x
M. Olsen, K. Stechuchak, E. Oddone, L. Damschroder, M. Maciejewski
{"title":"Which patients benefit most from completing health risk assessments: comparing methods to identify heterogeneity of treatment effects","authors":"M. Olsen, K. Stechuchak, E. Oddone, L. Damschroder, M. Maciejewski","doi":"10.1007/s10742-021-00243-x","DOIUrl":"https://doi.org/10.1007/s10742-021-00243-x","url":null,"abstract":"","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81131509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-02-07DOI: 10.1007/s10742-021-00242-y
Lucas Godoy-Garraza, S. Campos, C. Walrath
{"title":"Using a spatiotemporal model to estimate the impact of suicide prevention in small areas","authors":"Lucas Godoy-Garraza, S. Campos, C. Walrath","doi":"10.1007/s10742-021-00242-y","DOIUrl":"https://doi.org/10.1007/s10742-021-00242-y","url":null,"abstract":"","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79253452","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-02-03DOI: 10.1007/s10742-021-00241-z
Dean M Resnick, Christine S Cox, Lisa B Mirel
While record linkage can expand analyses performable from survey microdata, it also incurs greater risk of privacy-encroaching disclosure. One way to mitigate this risk is to replace some of the information added through linkage with synthetic data elements. This paper describes a case study using the National Hospital Care Survey (NHCS), which collects patient records under a pledge of protecting patient privacy from a sample of U.S. hospitals for statistical analysis purposes. The NHCS data were linked to the National Death Index (NDI) to enhance the survey with mortality information. The added information from NDI linkage enables survival analyses related to hospitalization, but as the death information includes dates of death and detailed causes of death, having it joined with the patient records increases the risk of patient re-identification (albeit only for deceased persons). For this reason, an approach was tested to develop synthetic data that uses models from survival analysis to replace vital status and actual dates-of-death with synthetic values and uses classification tree analysis to replace actual causes of death with synthesized causes of death. The degree to which analyses performed on the synthetic data replicate results from analysis on the actual data is measured by comparing survival analysis parameter estimates from both data files. Because synthetic data only have value to the degree that they can be used to produce statistical estimates that are like those based on the actual data, this evaluation is an essential first step in assessing the potential utility of synthetic mortality data.
{"title":"Using Synthetic Data to Replace Linkage Derived Elements: A Case Study.","authors":"Dean M Resnick, Christine S Cox, Lisa B Mirel","doi":"10.1007/s10742-021-00241-z","DOIUrl":"https://doi.org/10.1007/s10742-021-00241-z","url":null,"abstract":"<p><p>While record linkage can expand analyses performable from survey microdata, it also incurs greater risk of privacy-encroaching disclosure. One way to mitigate this risk is to replace some of the information added through linkage with synthetic data elements. This paper describes a case study using the National Hospital Care Survey (NHCS), which collects patient records under a pledge of protecting patient privacy from a sample of U.S. hospitals for statistical analysis purposes. The NHCS data were linked to the National Death Index (NDI) to enhance the survey with mortality information. The added information from NDI linkage enables survival analyses related to hospitalization, but as the death information includes dates of death and detailed causes of death, having it joined with the patient records increases the risk of patient re-identification (albeit only for deceased persons). For this reason, an approach was tested to develop synthetic data that uses models from survival analysis to replace vital status and actual dates-of-death with synthetic values and uses classification tree analysis to replace actual causes of death with synthesized causes of death. The degree to which analyses performed on the synthetic data replicate results from analysis on the actual data is measured by comparing survival analysis parameter estimates from both data files. Because synthetic data only have value to the degree that they can be used to produce statistical estimates that are like those based on the actual data, this evaluation is an essential first step in assessing the potential utility of synthetic mortality data.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2021-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s10742-021-00241-z","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39680445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}