An Automated Malnutrition Screening Tool Using Routinely Collected Data for Older Adults in Long-Term Care: Development and Internal Validation of AutoMal.
Jonathan Foo, Melanie Roberts, Lauren T Williams, Christian Osadnik, Judy Bauer, Marie-Claire O'Shea
{"title":"An Automated Malnutrition Screening Tool Using Routinely Collected Data for Older Adults in Long-Term Care: Development and Internal Validation of AutoMal.","authors":"Jonathan Foo, Melanie Roberts, Lauren T Williams, Christian Osadnik, Judy Bauer, Marie-Claire O'Shea","doi":"10.1016/j.jamda.2024.105252","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To develop and internally validate a malnutrition screening tool based on routinely collected data in the long-term care setting.</p><p><strong>Design: </strong>Diagnostic prediction model development and internal validation study.</p><p><strong>Setting and participants: </strong>Residents (n = 539) from 10 long-term care facilities in Australia.</p><p><strong>Methods: </strong>Candidate variables identified through expert consultation were collected from routinely collected data in a convenience sample of long-term care facilities. Logistic regression using the Subjective Global Assessment as the reference standard was conducted on 500 samples derived using bootstrapping from the original sample. Candidate variables were selected if included in more than 95% of samples using backwards stepwise elimination. The final model was developed using logistic regression of selected variables. Internal validation was conducted using bootstrapping to calculate the optimism-adjusted performance. Overall discrimination was evaluated via receiver operator characteristic curve and calculation of the area under the curve. Youden's Index was used to identify the optimal threshold value for classifying malnutrition. Sensitivity and specificity were calculated.</p><p><strong>Results: </strong>Body mass index and weight change % over 6 months were included in the automated malnutrition screening model (AutoMal), identified in 100% of bootstrapped samples. AutoMal demonstrated excellent discrimination of malnutrition, with area under the curve of 0.8378 (95% CI, 0.80-0.87). Youden's Index value was 0.37, resulting in sensitivity of 78% (95% CI, 71%-83%) and specificity of 77% (72%-81%). Optimism-corrected area under the curve was 0.8354.</p><p><strong>Conclusions and implications: </strong>The AutoMal demonstrates excellent ability to differentiate malnutrition status. It makes automated identification of malnutrition possible by using 2 variables commonly found in electronic health records.</p>","PeriodicalId":17180,"journal":{"name":"Journal of the American Medical Directors Association","volume":null,"pages":null},"PeriodicalIF":4.2000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the American Medical Directors Association","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jamda.2024.105252","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"GERIATRICS & GERONTOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: To develop and internally validate a malnutrition screening tool based on routinely collected data in the long-term care setting.
Design: Diagnostic prediction model development and internal validation study.
Setting and participants: Residents (n = 539) from 10 long-term care facilities in Australia.
Methods: Candidate variables identified through expert consultation were collected from routinely collected data in a convenience sample of long-term care facilities. Logistic regression using the Subjective Global Assessment as the reference standard was conducted on 500 samples derived using bootstrapping from the original sample. Candidate variables were selected if included in more than 95% of samples using backwards stepwise elimination. The final model was developed using logistic regression of selected variables. Internal validation was conducted using bootstrapping to calculate the optimism-adjusted performance. Overall discrimination was evaluated via receiver operator characteristic curve and calculation of the area under the curve. Youden's Index was used to identify the optimal threshold value for classifying malnutrition. Sensitivity and specificity were calculated.
Results: Body mass index and weight change % over 6 months were included in the automated malnutrition screening model (AutoMal), identified in 100% of bootstrapped samples. AutoMal demonstrated excellent discrimination of malnutrition, with area under the curve of 0.8378 (95% CI, 0.80-0.87). Youden's Index value was 0.37, resulting in sensitivity of 78% (95% CI, 71%-83%) and specificity of 77% (72%-81%). Optimism-corrected area under the curve was 0.8354.
Conclusions and implications: The AutoMal demonstrates excellent ability to differentiate malnutrition status. It makes automated identification of malnutrition possible by using 2 variables commonly found in electronic health records.
期刊介绍:
JAMDA, the official journal of AMDA - The Society for Post-Acute and Long-Term Care Medicine, is a leading peer-reviewed publication that offers practical information and research geared towards healthcare professionals in the post-acute and long-term care fields. It is also a valuable resource for policy-makers, organizational leaders, educators, and advocates.
The journal provides essential information for various healthcare professionals such as medical directors, attending physicians, nurses, consultant pharmacists, geriatric psychiatrists, nurse practitioners, physician assistants, physical and occupational therapists, social workers, and others involved in providing, overseeing, and promoting quality