Jared D Huling, Robin R Austin, Sheng-Chieh Lu, Michelle A Mathiason, Anna M Pirsch, Karen A Monsen
{"title":"Comparison of Weighting Methods to Understand Improved Outcomes Attributable to Public Health Nursing Interventions.","authors":"Jared D Huling, Robin R Austin, Sheng-Chieh Lu, Michelle A Mathiason, Anna M Pirsch, Karen A Monsen","doi":"10.1097/NNR.0000000000000750","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The complex work of public health nurses (PHNs) specifically related to mental health assessment, intervention, and outcomes makes it difficult to quantify and evaluate the improvement in client outcomes attributable to their interventions.</p><p><strong>Objectives: </strong>We examined heterogeneity across parents of infants served by PHNs receiving different interventions, compared the ability of traditional propensity scoring methods versus energy-balancing weight (EBW) techniques to adjust for the complex and stark differences in baseline characteristics among those receiving different interventions, and evaluated the causal effects of the quantity and variety of PHN interventions on client health and social outcomes.</p><p><strong>Methods: </strong>This retrospective study of 4,109 clients used existing Omaha System data generated during the routine documentation of PHN home visit data. We estimated the effects of intervention by computing and comparing weighted averages of the outcomes within the different treatment groups using two weighting methods: (a) inverse probability of treatment (propensity score) weighting and (b) EBWs.</p><p><strong>Results: </strong>Clients served by PHNs differed in baseline characteristics with clients with more signs/symptoms. Both weighting methods reduced heterogeneity in the sample. EBWs were more effective than inverse probability of treatment weighting in adjusting for multifaceted confounding and resulted in close balance of 105 baseline characteristics. Weighting the sample changed outcome patterns, especially when using EBWs. Clients who received more PHN interventions and a wider variety of them had improved knowledge, behavior, and status outcomes with no plateau over time, whereas the unweighted sample showed plateaus in outcomes over the course of home-visiting services.</p><p><strong>Discussion: </strong>Causal analysis of PHN-generated data demonstrated PHN intervention effectiveness for clients with mental health signs/symptoms. EBWs are a promising tool for evaluating the true causal effect of PHN home-visiting interventions.</p>","PeriodicalId":49723,"journal":{"name":"Nursing Research","volume":" ","pages":"390-398"},"PeriodicalIF":2.2000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nursing Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/NNR.0000000000000750","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/11 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"NURSING","Score":null,"Total":0}
引用次数: 0
Abstract
Background: The complex work of public health nurses (PHNs) specifically related to mental health assessment, intervention, and outcomes makes it difficult to quantify and evaluate the improvement in client outcomes attributable to their interventions.
Objectives: We examined heterogeneity across parents of infants served by PHNs receiving different interventions, compared the ability of traditional propensity scoring methods versus energy-balancing weight (EBW) techniques to adjust for the complex and stark differences in baseline characteristics among those receiving different interventions, and evaluated the causal effects of the quantity and variety of PHN interventions on client health and social outcomes.
Methods: This retrospective study of 4,109 clients used existing Omaha System data generated during the routine documentation of PHN home visit data. We estimated the effects of intervention by computing and comparing weighted averages of the outcomes within the different treatment groups using two weighting methods: (a) inverse probability of treatment (propensity score) weighting and (b) EBWs.
Results: Clients served by PHNs differed in baseline characteristics with clients with more signs/symptoms. Both weighting methods reduced heterogeneity in the sample. EBWs were more effective than inverse probability of treatment weighting in adjusting for multifaceted confounding and resulted in close balance of 105 baseline characteristics. Weighting the sample changed outcome patterns, especially when using EBWs. Clients who received more PHN interventions and a wider variety of them had improved knowledge, behavior, and status outcomes with no plateau over time, whereas the unweighted sample showed plateaus in outcomes over the course of home-visiting services.
Discussion: Causal analysis of PHN-generated data demonstrated PHN intervention effectiveness for clients with mental health signs/symptoms. EBWs are a promising tool for evaluating the true causal effect of PHN home-visiting interventions.
期刊介绍:
Nursing Research is a peer-reviewed journal celebrating over 60 years as the most sought-after nursing resource; it offers more depth, more detail, and more of what today''s nurses demand. Nursing Research covers key issues, including health promotion, human responses to illness, acute care nursing research, symptom management, cost-effectiveness, vulnerable populations, health services, and community-based nursing studies. Each issue highlights the latest research techniques, quantitative and qualitative studies, and new state-of-the-art methodological strategies, including information not yet found in textbooks. Expert commentaries and briefs are also included. In addition to 6 issues per year, Nursing Research from time to time publishes supplemental content not found anywhere else.