Pub Date : 2025-12-01Epub Date: 2025-06-07DOI: 10.1007/s10742-025-00344-x
Lihua Li, Chen Yang, Wei Zhang, Yulei He, John R Pleis, Lauren M Rossen, Bian Liu, Morgan Earp, Madhu Mazumdar
Propensity score weighting (PSW) is a valuable tool for estimating treatment effects on survival outcomes in observational studies. However, there is no clear best practice for applying PSW to complex survey data with survival outcomes. This paper addresses this gap by exploring how to integrate PSW into complex survey with design features (strata, clusters, sampling weights) for unbiased population-level estimates. We evaluate three PSW methods where: Method I: neither the propensity score (PS) model nor the outcome model accounts for the survey design; Method II: the PS model does not account for the survey design, but the outcome model does; Method III: both the PS model and outcome model account for the survey design. Through extensive simulations, we compare performance in estimating absolute treatment effects measured by population survival quantile effects and relative treatment effects measured by population marginal hazard ratios. Mean relative bias, mean absolute bias and coverage probability are estimated for model evaluations under various scenarios, including varying treatment effect magnitude, censoring type and rate, level of PS overlap, presence of outliers and nonresponse. Findings reveal that both survey-weighted Methods II and III outperform the unweighted Method I under most scenarios for both measures of treatment effects, especially when there is a true treatment effect. Both weighted methods II and III are found to perform closely, including when there exists informative censoring, influential outliers, or non-response. We recommend that when considering PSW with complex survey data for estimating population-level treatment effects on survival outcomes, both modelling stages should incorporate survey designs, but it is most critical for the outcome modelling. For illustration, all methods are applied to the public-use 2000-2018 National Health Interview Survey (NHIS) Linked to Mortality Files with mortality information through 2019 to estimate the effect of smoking cessation after a cancer diagnosis on subsequent overall survival.
{"title":"Propensity score weighting analysis with complex survey data for estimating population-level treatment effects on survival: a simulation study.","authors":"Lihua Li, Chen Yang, Wei Zhang, Yulei He, John R Pleis, Lauren M Rossen, Bian Liu, Morgan Earp, Madhu Mazumdar","doi":"10.1007/s10742-025-00344-x","DOIUrl":"10.1007/s10742-025-00344-x","url":null,"abstract":"<p><p>Propensity score weighting (PSW) is a valuable tool for estimating treatment effects on survival outcomes in observational studies. However, there is no clear best practice for applying PSW to complex survey data with survival outcomes. This paper addresses this gap by exploring how to integrate PSW into complex survey with design features (strata, clusters, sampling weights) for unbiased population-level estimates. We evaluate three PSW methods where: Method I: neither the propensity score (PS) model nor the outcome model accounts for the survey design; Method II: the PS model does not account for the survey design, but the outcome model does; Method III: both the PS model and outcome model account for the survey design. Through extensive simulations, we compare performance in estimating absolute treatment effects measured by population survival quantile effects and relative treatment effects measured by population marginal hazard ratios. Mean relative bias, mean absolute bias and coverage probability are estimated for model evaluations under various scenarios, including varying treatment effect magnitude, censoring type and rate, level of PS overlap, presence of outliers and nonresponse. Findings reveal that both survey-weighted Methods II and III outperform the unweighted Method I under most scenarios for both measures of treatment effects, especially when there is a true treatment effect. Both weighted methods II and III are found to perform closely, including when there exists informative censoring, influential outliers, or non-response. We recommend that when considering PSW with complex survey data for estimating population-level treatment effects on survival outcomes, both modelling stages should incorporate survey designs, but it is most critical for the outcome modelling. For illustration, all methods are applied to the public-use 2000-2018 National Health Interview Survey (NHIS) Linked to Mortality Files with mortality information through 2019 to estimate the effect of smoking cessation after a cancer diagnosis on subsequent overall survival.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":"25 4","pages":"382-409"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12700616/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145757776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-11DOI: 10.1007/s10742-025-00364-7
Kerry Ye, Alyssa Bilinski, Youjin Lee
Difference-in-differences (DiD) approach is one of the most widely used approaches for evaluating policy effects. However, traditional DiD methods may not recover the population-level average treatment effect on the treated (ATT) in the absence of population-level panel data, particularly when the composition of units in the treatment group changes over time. In this work, we address the following two challenges when applying DiD methods with repeated cross-sectional (RCS) survey data: (1) heterogeneous compositions of study samples across different time points, and (2) availability of data for only a sample of the population. We introduce a policy-relevant target estimand and establish its identification conditions. We then propose a new weighting approach that incorporates both estimated propensity scores and given survey weights. We establish the theoretical properties of the proposed method and examine its finite-sample performance through simulations. Finally, we apply our proposed method to a real-world data application, estimating the effect of a beverage tax on adolescent soda consumption in Philadelphia.
{"title":"Difference-in-differences analysis with repeated cross-sectional survey data.","authors":"Kerry Ye, Alyssa Bilinski, Youjin Lee","doi":"10.1007/s10742-025-00364-7","DOIUrl":"10.1007/s10742-025-00364-7","url":null,"abstract":"<p><p>Difference-in-differences (DiD) approach is one of the most widely used approaches for evaluating policy effects. However, traditional DiD methods may not recover the population-level average treatment effect on the treated (ATT) in the absence of population-level panel data, particularly when the composition of units in the treatment group changes over time. In this work, we address the following two challenges when applying DiD methods with repeated cross-sectional (RCS) survey data: (1) heterogeneous compositions of study samples across different time points, and (2) availability of data for only a sample of the population. We introduce a policy-relevant target estimand and establish its identification conditions. We then propose a new weighting approach that incorporates both estimated propensity scores and given survey weights. We establish the theoretical properties of the proposed method and examine its finite-sample performance through simulations. Finally, we apply our proposed method to a real-world data application, estimating the effect of a beverage tax on adolescent soda consumption in Philadelphia.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12674181/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145679055","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-09-01Epub Date: 2025-09-16DOI: 10.1007/s10742-025-00356-7
Eva Murphy, David Kline, Staci A Hepler
Understanding the interactions and spatio-temporal variations of public health outcomes is crucial for gaining insight into interrelated epidemics across different locations and time periods. Dynamic spatial factor models provide a flexible framework for capturing shared variability among multiple outcomes through a latent factor and its corresponding loadings. A common assumption in these models is that factor loadings are spatially constant, implying uniform relationships between outcomes across the study region. However, this assumption may overlook important regional differences in how outcomes relate to the underlying latent factor. In this study, we derive the covariance structure of the outcome vector to highlight how spatially varying versus constant loadings influence the overall correlation structure. We find that when loadings vary across space, the spatial covariance of the outcomes is shaped by both the spatial covariance of the loadings and the latent factors. In contrast, when loadings are spatially constant, the spatial covariance of the outcomes is determined primarily by the latent factors, leading to uniform variation across the spatial domain. To assess these differences in practice, we apply a Bayesian hierarchical spatial dynamic factor model to analyze the opioid syndemic in North Carolina. Our results suggest that incorporating spatially varying loadings provides a more detailed, county-specific understanding of the epidemic. This added flexibility enables a localized interpretation of opioid-related interactions and offers insights that could inform targeted public health interventions.
{"title":"The role of spatially varying loadings in dynamic spatial factor models for modeling the opioid syndemic.","authors":"Eva Murphy, David Kline, Staci A Hepler","doi":"10.1007/s10742-025-00356-7","DOIUrl":"10.1007/s10742-025-00356-7","url":null,"abstract":"<p><p>Understanding the interactions and spatio-temporal variations of public health outcomes is crucial for gaining insight into interrelated epidemics across different locations and time periods. Dynamic spatial factor models provide a flexible framework for capturing shared variability among multiple outcomes through a latent factor and its corresponding loadings. A common assumption in these models is that factor loadings are spatially constant, implying uniform relationships between outcomes across the study region. However, this assumption may overlook important regional differences in how outcomes relate to the underlying latent factor. In this study, we derive the covariance structure of the outcome vector to highlight how spatially varying versus constant loadings influence the overall correlation structure. We find that when loadings vary across space, the spatial covariance of the outcomes is shaped by both the spatial covariance of the loadings and the latent factors. In contrast, when loadings are spatially constant, the spatial covariance of the outcomes is determined primarily by the latent factors, leading to uniform variation across the spatial domain. To assess these differences in practice, we apply a Bayesian hierarchical spatial dynamic factor model to analyze the opioid syndemic in North Carolina. Our results suggest that incorporating spatially varying loadings provides a more detailed, county-specific understanding of the epidemic. This added flexibility enables a localized interpretation of opioid-related interactions and offers insights that could inform targeted public health interventions.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":"25 3","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12490277/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145233814","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-06-13DOI: 10.1007/s10742-025-00348-7
Chuanling Qin, Curtis Peterson, William B Weeks, A James O'Malley
Despite the rapid advancement of machine learning algorithms, the important problem of distinguishing patients based on the likelihood of their mortality remains a challenge. In this paper, we investigated the degree to which the incorporation of the time-varying factor, length of hospitalization could contribute to modeling mortality. A two-part modeling approach was proposed to capture the potential heterogeneity over follow-up time and to evaluate the extent to which allowing a predictor based on a fixed-time event like hospitalization (as a time-varying coefficient) enhanced mortality prediction. A test was then conducted to assess whether the association between hospitalization and mortality diminished with continued survival of a patient. Leveraging logistic regression models and the XGBoost procedure, the findings supported the claim that the baseline hospitalization is a risk factor whose importance diminishes the longer the patient survives. While simulation studies and theoretical considerations indicate that the two-part model provides deeper insight into the evolving dynamics of regression coefficients and enhances the prediction accuracy of the marginal probability of mortality, its application to the empirical data that motivated this research yielded less compelling results, a finding that aligns with previous findings. Factors such as class imbalance and the magnitude of heterogeneous effects can significantly impact the performance of the two-part model in empirical datasets.
{"title":"The impact of knowledge of hospitalization on mortality predictions.","authors":"Chuanling Qin, Curtis Peterson, William B Weeks, A James O'Malley","doi":"10.1007/s10742-025-00348-7","DOIUrl":"10.1007/s10742-025-00348-7","url":null,"abstract":"<p><p>Despite the rapid advancement of machine learning algorithms, the important problem of distinguishing patients based on the likelihood of their mortality remains a challenge. In this paper, we investigated the degree to which the incorporation of the time-varying factor, length of hospitalization could contribute to modeling mortality. A two-part modeling approach was proposed to capture the potential heterogeneity over follow-up time and to evaluate the extent to which allowing a predictor based on a fixed-time event like hospitalization (as a time-varying coefficient) enhanced mortality prediction. A test was then conducted to assess whether the association between hospitalization and mortality diminished with continued survival of a patient. Leveraging logistic regression models and the XGBoost procedure, the findings supported the claim that the baseline hospitalization is a risk factor whose importance diminishes the longer the patient survives. While simulation studies and theoretical considerations indicate that the two-part model provides deeper insight into the evolving dynamics of regression coefficients and enhances the prediction accuracy of the marginal probability of mortality, its application to the empirical data that motivated this research yielded less compelling results, a finding that aligns with previous findings. Factors such as class imbalance and the magnitude of heterogeneous effects can significantly impact the performance of the two-part model in empirical datasets.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12788376/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145953283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-03-20DOI: 10.1007/s10742-025-00343-y
Yifan Zhao, Carly A Bobak, Megan A Murphy, Olivia Sacks, Lili Liu, Natasha Ray, Amber E Barnato, A James O'Malley
Patient-sharing physician networks are increasingly recognized as valuable tools for examining physician relationships in healthcare research. However, very few studies have examined the reliability of such networks and summary measures derived from them in relation to directly measured physician relationships. In this paper, we evaluate the level of congruence between a survey-based network derived from survey responses to specific name-generator questions and a patient-sharing network derived from claims data. We also examine the association of summary measures derived from either network with physicians' beliefs about peer influence in medical practice. Statistical models with hierarchical and multiple-membership structures were used to estimate the strength of the associations. We found that a survey measure indicating whether a physician was nominated by others was statistically significantly associated with their survey reported beliefs about peer influence. We also observed notable associations between the physicians' structural importance in the network reflected in their eigenvector and betweenness centrality in the patient-sharing network and their beliefs about peer influence. This study of multi-source network relational information advances our understanding of physician survey responses and yields more precise predictions of physician beliefs toward peer-influence than either data source alone. Overall, we found that patient-sharing networks are an important alternative to directly measured survey-based name-generator questions in health services research and other applications. While patient-sharing networks recover some of the information in directly measured peer physician nominations, they also contain distinct information that is helpful for interpreting healthcare insights.
{"title":"Combining multiple sources of relationships in a network to advance understanding of physicians' beliefs regarding peer-effects.","authors":"Yifan Zhao, Carly A Bobak, Megan A Murphy, Olivia Sacks, Lili Liu, Natasha Ray, Amber E Barnato, A James O'Malley","doi":"10.1007/s10742-025-00343-y","DOIUrl":"https://doi.org/10.1007/s10742-025-00343-y","url":null,"abstract":"<p><p>Patient-sharing physician networks are increasingly recognized as valuable tools for examining physician relationships in healthcare research. However, very few studies have examined the reliability of such networks and summary measures derived from them in relation to directly measured physician relationships. In this paper, we evaluate the level of congruence between a survey-based network derived from survey responses to specific name-generator questions and a patient-sharing network derived from claims data. We also examine the association of summary measures derived from either network with physicians' beliefs about peer influence in medical practice. Statistical models with hierarchical and multiple-membership structures were used to estimate the strength of the associations. We found that a survey measure indicating whether a physician was nominated by others was statistically significantly associated with their survey reported beliefs about peer influence. We also observed notable associations between the physicians' structural importance in the network reflected in their eigenvector and betweenness centrality in the patient-sharing network and their beliefs about peer influence. This study of multi-source network relational information advances our understanding of physician survey responses and yields more precise predictions of physician beliefs toward peer-influence than either data source alone. Overall, we found that patient-sharing networks are an important alternative to directly measured survey-based name-generator questions in health services research and other applications. While patient-sharing networks recover some of the information in directly measured peer physician nominations, they also contain distinct information that is helpful for interpreting healthcare insights.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12385539/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144973490","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-01Epub Date: 2024-04-12DOI: 10.1007/s10742-024-00327-4
Megan S Schuler, Donna L Coffman, Elizabeth A Stuart, Trang Q Nguyen, Brian Vegetabile, Daniel F McCaffrey
Mediation analysis is a statistical approach that can provide insights regarding the intermediary processes by which an intervention or exposure affects a given outcome. Mediation analyses rose to prominence, particularly in social science research, with the publication of Baron and Kenny's seminal paper and is now commonly applied in many research disciplines, including health services research. Despite the growth in popularity, applied researchers may still encounter challenges in terms of conducting mediation analyses in practice. In this paper, we provide an overview of conceptual and methodological challenges that researchers face when conducting mediation analyses. Specifically, we discuss the following key challenges: (1) Conceptually differentiating mediators from other "third variables," (2) Extending beyond the single mediator context, (3) Identifying appropriate datasets in which measurement and temporal ordering support the hypothesized mediation model, (4) Selecting mediation effects that reflect the scientific question of interest, (5) Assessing the validity of underlying assumptions of no omitted confounders, (6) Addressing measurement error regarding the mediator, and (7) Clearly reporting results from mediation analyses. We discuss each challenge and highlight ways in which the applied researcher can approach these challenges.
{"title":"Practical challenges in mediation analysis: a guide for applied researchers.","authors":"Megan S Schuler, Donna L Coffman, Elizabeth A Stuart, Trang Q Nguyen, Brian Vegetabile, Daniel F McCaffrey","doi":"10.1007/s10742-024-00327-4","DOIUrl":"10.1007/s10742-024-00327-4","url":null,"abstract":"<p><p>Mediation analysis is a statistical approach that can provide insights regarding the intermediary processes by which an intervention or exposure affects a given outcome. Mediation analyses rose to prominence, particularly in social science research, with the publication of Baron and Kenny's seminal paper and is now commonly applied in many research disciplines, including health services research. Despite the growth in popularity, applied researchers may still encounter challenges in terms of conducting mediation analyses in practice. In this paper, we provide an overview of conceptual and methodological challenges that researchers face when conducting mediation analyses. Specifically, we discuss the following key challenges: (1) Conceptually differentiating mediators from other \"third variables,\" (2) Extending beyond the single mediator context, (3) Identifying appropriate datasets in which measurement and temporal ordering support the hypothesized mediation model, (4) Selecting mediation effects that reflect the scientific question of interest, (5) Assessing the validity of underlying assumptions of no omitted confounders, (6) Addressing measurement error regarding the mediator, and (7) Clearly reporting results from mediation analyses. We discuss each challenge and highlight ways in which the applied researcher can approach these challenges.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":"25 1","pages":"57-84"},"PeriodicalIF":1.6,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11821701/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143434197","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2023-08-09DOI: 10.1007/s10742-023-00310-5
Hyojung Kang, Min-Woong Sohn, Soyoun Kim, Siyao Zhang, Rajesh Balkrishnan, Roger Anderson, Anthony McCall, Timothy McMurry, Jennifer Mason Lobo
Annual preventive care is essential for diabetes patients to reduce the risk of complications including hypoglycemic events and blindness. Our aim was to examine the relative efficiency of Diabetes Belt (DB) and non-Diabetes Belt (NDB) counties in providing recommended preventive care for Medicare beneficiaries with diabetes using available health professional resources and to understand county-level socioeconomic factors associated with inefficient provision of preventive care. A data envelopment analysis (DEA) model was developed to assess relative efficiency of counties in providing diabetes preventive care. Logistic regression was performed to identify socioeconomic characteristics associated with inefficiencies. We used Medicare claims data to extract individual-level information of diabetes preventive service use and obtained county-level estimates of health resources information from the Area Health Resources File. More than 80% of counties had more than 10% inefficiencies on average. Compared to counties in the NDB, the odds of being inefficient were 2.44 times more likely in the DB (OR 2.44, CI 1.67-3.58). Counties with lower median income, with a smaller proportion of non-Hispanic Black population, and in a rural area had higher odds of being inefficient in providing preventive care. Our DEA results showed that counties in the DB and NDB were mostly inefficient. The availability of care providers may be less of a problem than how efficiently the resources are used in providing preventive care. Identifying sources of inefficiency within each community with low resource utilization and developing targeted strategies is needed to improve uptake of preventive care cost-effectively.
对于糖尿病患者来说,每年的预防性保健对于降低低血糖事件和失明等并发症的风险至关重要。我们的目的是检查糖尿病带(DB)和非糖尿病带(NDB)县在利用现有卫生专业资源为糖尿病医疗保险受益人提供推荐的预防保健方面的相对效率,并了解与预防保健提供效率低下相关的县级社会经济因素。采用数据包络分析(DEA)模型评估各县提供糖尿病预防护理的相对效率。进行逻辑回归以确定与效率低下相关的社会经济特征。我们使用医疗保险索赔数据提取糖尿病预防服务使用的个人水平信息,并从区域卫生资源文件中获得县级卫生资源信息估计。超过80%的县的平均低效率超过10%。与新开发银行的国家相比,低效率的可能性是新开发银行的2.44倍(OR 2.44, CI 1.67-3.58)。收入中位数较低、非西班牙裔黑人人口比例较小以及农村地区的县在提供预防保健方面效率较低的可能性更高。我们的DEA结果显示,在DB和NDB的县大多效率低下。保健提供者的可用性可能不是一个问题,而是如何有效地利用资源来提供预防性保健。需要在每个资源利用率低的社区内确定效率低下的根源,并制定有针对性的战略,以经济有效地提高预防保健的接受程度。
{"title":"Diabetes Belt has lower efficiency in providing diabetes preventive care than surrounding counties.","authors":"Hyojung Kang, Min-Woong Sohn, Soyoun Kim, Siyao Zhang, Rajesh Balkrishnan, Roger Anderson, Anthony McCall, Timothy McMurry, Jennifer Mason Lobo","doi":"10.1007/s10742-023-00310-5","DOIUrl":"10.1007/s10742-023-00310-5","url":null,"abstract":"<p><p>Annual preventive care is essential for diabetes patients to reduce the risk of complications including hypoglycemic events and blindness. Our aim was to examine the relative efficiency of Diabetes Belt (DB) and non-Diabetes Belt (NDB) counties in providing recommended preventive care for Medicare beneficiaries with diabetes using available health professional resources and to understand county-level socioeconomic factors associated with inefficient provision of preventive care. A data envelopment analysis (DEA) model was developed to assess relative efficiency of counties in providing diabetes preventive care. Logistic regression was performed to identify socioeconomic characteristics associated with inefficiencies. We used Medicare claims data to extract individual-level information of diabetes preventive service use and obtained county-level estimates of health resources information from the Area Health Resources File. More than 80% of counties had more than 10% inefficiencies on average. Compared to counties in the NDB, the odds of being inefficient were 2.44 times more likely in the DB (OR 2.44, CI 1.67-3.58). Counties with lower median income, with a smaller proportion of non-Hispanic Black population, and in a rural area had higher odds of being inefficient in providing preventive care. Our DEA results showed that counties in the DB and NDB were mostly inefficient. The availability of care providers may be less of a problem than how efficiently the resources are used in providing preventive care. Identifying sources of inefficiency within each community with low resource utilization and developing targeted strategies is needed to improve uptake of preventive care cost-effectively.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":"191 1","pages":"200-210"},"PeriodicalIF":1.6,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12392157/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73273693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2023-08-12DOI: 10.1007/s10742-023-00311-4
Luke J Matthews, Megan S Schuler, Raffaele Vardavas, Joshua Breslau, Ioana Popescu
Social processes and social context are increasingly recognized as key factors shaping health-related behaviors and outcomes. One social process that may be acting within social networks is social influence, in which an individual's characteristic (e.g., specific health behavior) is potentially impacted by the corresponding characteristic of connected individuals in the network. In the health services context, healthcare providers who work together and share patients may influence each other through the knowledge transmission or development of clinical practice norms. Although many statistical techniques assume independence of data points, when analyzing data that may reflect social processes acting across a social network, it is imperative to account for the interdependencies (i.e., non-independence) across individuals. In practice, studies account for nonindependence in the context of estimating bivariate relations (correlations or linear regression) using a variety of analytic methods (some of which have previously been shown to yield biased results). To date, it is unclear which methods yield acceptable false positive rates, unbiased coefficient estimates, and acceptable statistical power, because there have been no systematic simulation studies comparing methods for addressing network nonindependence arising from social influence. To address this gap, we compared eight commonly used methods that purport to account for nonindependence using simulated network data. While results indicated that none of the techniques reduced false positive rates to the predicted (nominal) 0.05 level, random sampling of network nodes was the method that yielded the smallest false positive rates, yet came at a price of reduced statistical power. Further methodological development is needed.
{"title":"Evaluation via simulation of statistical corrections for network nonindependence.","authors":"Luke J Matthews, Megan S Schuler, Raffaele Vardavas, Joshua Breslau, Ioana Popescu","doi":"10.1007/s10742-023-00311-4","DOIUrl":"10.1007/s10742-023-00311-4","url":null,"abstract":"<p><p>Social processes and social context are increasingly recognized as key factors shaping health-related behaviors and outcomes. One social process that may be acting within social networks is social influence, in which an individual's characteristic (e.g., specific health behavior) is potentially impacted by the corresponding characteristic of connected individuals in the network. In the health services context, healthcare providers who work together and share patients may influence each other through the knowledge transmission or development of clinical practice norms. Although many statistical techniques assume independence of data points, when analyzing data that may reflect social processes acting across a social network, it is imperative to account for the interdependencies (i.e., non-independence) across individuals. In practice, studies account for nonindependence in the context of estimating bivariate relations (correlations or linear regression) using a variety of analytic methods (some of which have previously been shown to yield biased results). To date, it is unclear which methods yield acceptable false positive rates, unbiased coefficient estimates, and acceptable statistical power, because there have been no systematic simulation studies comparing methods for addressing network nonindependence arising from social influence. To address this gap, we compared eight commonly used methods that purport to account for nonindependence using simulated network data. While results indicated that none of the techniques reduced false positive rates to the predicted (nominal) 0.05 level, random sampling of network nodes was the method that yielded the smallest false positive rates, yet came at a price of reduced statistical power. Further methodological development is needed.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":"37 1","pages":"211-226"},"PeriodicalIF":1.6,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12700765/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81696132","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-29DOI: 10.1007/s10742-023-00319-w
Marc L. Berger, William H. Crown, Jim Z. Li, Kelly H. Zou
{"title":"ATRAcTR (Authentic Transparent Relevant Accurate Track-Record): a screening tool to assess the potential for real-world data sources to support creation of credible real-world evidence for regulatory decision-making","authors":"Marc L. Berger, William H. Crown, Jim Z. Li, Kelly H. Zou","doi":"10.1007/s10742-023-00319-w","DOIUrl":"https://doi.org/10.1007/s10742-023-00319-w","url":null,"abstract":"","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":"22 1","pages":"1-18"},"PeriodicalIF":1.5,"publicationDate":"2023-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139211718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-28DOI: 10.1007/s10742-023-00320-3
N. Disher, Jennifer Scott, Anna Tyzik, S. Golden, Georgia Baker, Denise M. Hynes, C. Slatore
{"title":"Evaluation of survey delivery methods in a national study of Veteran’s healthcare preferences","authors":"N. Disher, Jennifer Scott, Anna Tyzik, S. Golden, Georgia Baker, Denise M. Hynes, C. Slatore","doi":"10.1007/s10742-023-00320-3","DOIUrl":"https://doi.org/10.1007/s10742-023-00320-3","url":null,"abstract":"","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":"257 1","pages":"1-21"},"PeriodicalIF":1.5,"publicationDate":"2023-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139219232","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}