Purpose: Chat Generative Pre-trained Transformer (ChatGPT) is now utilized in various fields of healthcare in order to obtain answers to questions related to healthcare-related problems and to evaluate available information. Primary hyperparathyroidism is a common endocrine disorder. We aimed to evaluate the accuracy and quality of ChatGPT's responses to questions specific to hyperparathyroidism cases discussed at multidisciplinary endocrinology meetings.
Methods: ChatGPT-4 was asked to respond to 10 hyperparathyroidism cases evaluated at multidisciplinary endocrinology meetings. The accuracy, completeness, and quality of the responses were scored independently by two endocrinologists. Accuracy and completeness were evaluated on the Likert scale, and quality was evaluated on the global quality scale (GQS).
Results: No misleading information was detected in the responses. In terms of diagnosis, the mean accuracy scores (ranging from 1 to 5) were 4.9 ± 0.1 and the mean completeness scores (ranging from 1 to 3) were 3.0. In the responses given in terms of further examination, the mean accuracy and completeness scores were 4.8 ± 0.13 and 2.6 ± 0.16, respectively. The mean accuracy and completeness scores for treatment recommendations were 4.9 ± 0.1 and 2.4 ± 0.16, respectively. The GQS evaluation result was 80% high quality and 20% medium quality.
Conclusion: In this study, the accuracy and quality rates of ChatGPT-4 were generally high in responding to questions as to hyperparathyroidism patients. It can be concluded that artificial intelligence may serve as a valuable tool in healthcare. However, the limitations and risks of ChatGPT should also be evaluated.
{"title":"Evaluation of the accuracy and quality of ChatGPT-4 responses for hyperparathyroidism patients discussed at multidisciplinary endocrinology meetings.","authors":"Işılay Taşkaldıran, Çağatay Emir Önder, Püren Gökbulut, Gönül Koç, Şerife Mehlika Kuşkonmaz","doi":"10.1177/20552076241278692","DOIUrl":"10.1177/20552076241278692","url":null,"abstract":"<p><strong>Purpose: </strong>Chat Generative Pre-trained Transformer (ChatGPT) is now utilized in various fields of healthcare in order to obtain answers to questions related to healthcare-related problems and to evaluate available information. Primary hyperparathyroidism is a common endocrine disorder. We aimed to evaluate the accuracy and quality of ChatGPT's responses to questions specific to hyperparathyroidism cases discussed at multidisciplinary endocrinology meetings.</p><p><strong>Methods: </strong>ChatGPT-4 was asked to respond to 10 hyperparathyroidism cases evaluated at multidisciplinary endocrinology meetings. The accuracy, completeness, and quality of the responses were scored independently by two endocrinologists. Accuracy and completeness were evaluated on the Likert scale, and quality was evaluated on the global quality scale (GQS).</p><p><strong>Results: </strong>No misleading information was detected in the responses. In terms of diagnosis, the mean accuracy scores (ranging from 1 to 5) were 4.9 ± 0.1 and the mean completeness scores (ranging from 1 to 3) were 3.0. In the responses given in terms of further examination, the mean accuracy and completeness scores were 4.8 ± 0.13 and 2.6 ± 0.16, respectively. The mean accuracy and completeness scores for treatment recommendations were 4.9 ± 0.1 and 2.4 ± 0.16, respectively. The GQS evaluation result was 80% high quality and 20% medium quality.</p><p><strong>Conclusion: </strong>In this study, the accuracy and quality rates of ChatGPT-4 were generally high in responding to questions as to hyperparathyroidism patients. It can be concluded that artificial intelligence may serve as a valuable tool in healthcare. However, the limitations and risks of ChatGPT should also be evaluated.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11363241/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142114607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-28eCollection Date: 2024-01-01DOI: 10.1177/20552076241271823
Vanja Kljajevic
About one-third of stroke survivors experience aphasia, i.e., language dysfunction caused by brain damage. Aphasia affects not only a person's ability to communicate, but it often leads to the inability to return to work, loss of close relationships, diminished quality of life, negative self-perception, and depression. Yet persons with aphasia are globally underserved due to limited access to resources, which limits their chance for recovery. Immersive virtual reality (VR) has the potential to solve this problem and deliver efficient, personalized treatments to millions of people worldwide who need access to rehabilitation services or more flexibility in treatment delivery. To reduce the global burden of stroke experts recommend taking bold, pragmatic actions across all four pillars of stroke quadrangle-surveillance, prevention, acute care, and rehabilitation. Embracing immersive VR-based rehabilitation of poststroke aphasia would be one step in that direction.
{"title":"Embracing virtual reality in rehabilitation of post-stroke aphasia.","authors":"Vanja Kljajevic","doi":"10.1177/20552076241271823","DOIUrl":"10.1177/20552076241271823","url":null,"abstract":"<p><p>About one-third of stroke survivors experience aphasia, i.e., language dysfunction caused by brain damage. Aphasia affects not only a person's ability to communicate, but it often leads to the inability to return to work, loss of close relationships, diminished quality of life, negative self-perception, and depression. Yet persons with aphasia are globally underserved due to limited access to resources, which limits their chance for recovery. Immersive virtual reality (VR) has the potential to solve this problem and deliver efficient, personalized treatments to millions of people worldwide who need access to rehabilitation services or more flexibility in treatment delivery. To reduce the global burden of stroke experts recommend taking bold, pragmatic actions across all four pillars of stroke quadrangle-surveillance, prevention, acute care, and rehabilitation. Embracing immersive VR-based rehabilitation of poststroke aphasia would be one step in that direction.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11363242/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142117002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-28eCollection Date: 2024-01-01DOI: 10.1177/20552076241277458
Justin H Pham, Charat Thongprayoon, Supawadee Suppadungsuk, Jing Miao, Iasmina M Craici, Wisit Cheungpasitporn
Background: Professional opinion polling has become a popular means of seeking advice for complex nephrology questions in the #AskRenal community on X. ChatGPT is a large language model with remarkable problem-solving capabilities, but its ability to provide solutions for real-world clinical scenarios remains unproven. This study seeks to evaluate how closely ChatGPT's responses align with current prevailing medical opinions in nephrology.
Methods: Nephrology polls from X were submitted to ChatGPT-4, which generated answers without prior knowledge of the poll outcomes. Its responses were compared to the poll results (inter-rater) and a second set of responses given after a one-week interval (intra-rater) using Cohen's kappa statistic (κ). Subgroup analysis was performed based on question subject matter.
Results: Our analysis comprised two rounds of testing ChatGPT on 271 nephrology-related questions. In the first round, ChatGPT's responses agreed with poll results for 163 of the 271 questions (60.2%; κ = 0.42, 95% CI: 0.38-0.46). In the second round, conducted to assess reproducibility, agreement improved slightly to 171 out of 271 questions (63.1%; κ = 0.46, 95% CI: 0.42-0.50). Comparison of ChatGPT's responses between the two rounds demonstrated high internal consistency, with agreement in 245 out of 271 responses (90.4%; κ = 0.86, 95% CI: 0.82-0.90). Subgroup analysis revealed stronger performance in the combined areas of homeostasis, nephrolithiasis, and pharmacology (κ = 0.53, 95% CI: 0.47-0.59 in both rounds), compared to other nephrology subfields.
Conclusion: ChatGPT-4 demonstrates modest capability in replicating prevailing professional opinion in nephrology polls overall, with varying performance levels between question topics and excellent internal consistency. This study provides insights into the potential and limitations of using ChatGPT in medical decision making.
{"title":"Digital health tools in nephrology: A comparative analysis of AI and professional opinions via online polls.","authors":"Justin H Pham, Charat Thongprayoon, Supawadee Suppadungsuk, Jing Miao, Iasmina M Craici, Wisit Cheungpasitporn","doi":"10.1177/20552076241277458","DOIUrl":"10.1177/20552076241277458","url":null,"abstract":"<p><strong>Background: </strong>Professional opinion polling has become a popular means of seeking advice for complex nephrology questions in the #AskRenal community on X. ChatGPT is a large language model with remarkable problem-solving capabilities, but its ability to provide solutions for real-world clinical scenarios remains unproven. This study seeks to evaluate how closely ChatGPT's responses align with current prevailing medical opinions in nephrology.</p><p><strong>Methods: </strong>Nephrology polls from X were submitted to ChatGPT-4, which generated answers without prior knowledge of the poll outcomes. Its responses were compared to the poll results (inter-rater) and a second set of responses given after a one-week interval (intra-rater) using Cohen's kappa statistic (κ). Subgroup analysis was performed based on question subject matter.</p><p><strong>Results: </strong>Our analysis comprised two rounds of testing ChatGPT on 271 nephrology-related questions. In the first round, ChatGPT's responses agreed with poll results for 163 of the 271 questions (60.2%; κ = 0.42, 95% CI: 0.38-0.46). In the second round, conducted to assess reproducibility, agreement improved slightly to 171 out of 271 questions (63.1%; κ = 0.46, 95% CI: 0.42-0.50). Comparison of ChatGPT's responses between the two rounds demonstrated high internal consistency, with agreement in 245 out of 271 responses (90.4%; κ = 0.86, 95% CI: 0.82-0.90). Subgroup analysis revealed stronger performance in the combined areas of homeostasis, nephrolithiasis, and pharmacology (κ = 0.53, 95% CI: 0.47-0.59 in both rounds), compared to other nephrology subfields.</p><p><strong>Conclusion: </strong>ChatGPT-4 demonstrates modest capability in replicating prevailing professional opinion in nephrology polls overall, with varying performance levels between question topics and excellent internal consistency. This study provides insights into the potential and limitations of using ChatGPT in medical decision making.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11363238/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142114606","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-28eCollection Date: 2024-01-01DOI: 10.1177/20552076241277039
Connie Henson, Ben Freedman, Boe Rambaldini, Bronwyn Carlson, Carmen Parter, Chrishan J Nalliah, Felicity Chapman, Gina Shepherd, Jessica Orchard, John Skinner, Josephine Gwynn, Rona Macniven, Robyn Ramsden, Sophia Nala 'Ḵixsisa 'las Speier, Suud Mohamed Nahdi, Vita Christie, Yansong Harry Huang, Katrina D Ward, Kylie Gwynne
Objective: Health programs for Indigenous people are most effective, acceptable, and sustainable when Indigenous perspectives are prioritized. Codesign builds on Indigenous people's creativity and propensity to experiment with new technologies and ensures research is designed and implemented in a culturally safe and respectful manner. Limited research has focused on older Indigenous people as partners in digital health. No research has focused on the acceptability and feasibility of older Indigenous people using wearables for heart health monitoring. This study provides insights into the acceptability and feasibility for ≥55-year-old Indigenous people living in remote locations to use wearables (watches and patches) to detect atrial fibrillation (AF) and high blood pressure.
Methods: This mixed methods study was codesigned and coimplemented with the local Aboriginal Controlled Health Service in a remote area of New South Wales, Australia. It included active involvement and codesign with the participants. The devices used in this study included a Withings Scan watch and a Biobeat patch.
Results: Despite challenging conditions (>36°C) and variable internet connectivity, 11 Indigenous older adults participated in a five-day wearables program in a remote location. Participants indicated that using digital health devices was acceptable and feasible for older Indigenous users. They described high levels of comfort, safety and convenience when using wearables (patches and watches) to detect AF. They were active participants in codesigning the program.
Conclusion: Older Indigenous Australians are motivated to use wearable health devices. They are keen to participate in codesign innovative health tech programs to ensure new health technologies are acceptable to Indigenous people and feasible for remote locations.
{"title":"Wearables are a viable digital health tool for older Indigenous adults living remotely in Australia (research).","authors":"Connie Henson, Ben Freedman, Boe Rambaldini, Bronwyn Carlson, Carmen Parter, Chrishan J Nalliah, Felicity Chapman, Gina Shepherd, Jessica Orchard, John Skinner, Josephine Gwynn, Rona Macniven, Robyn Ramsden, Sophia Nala 'Ḵixsisa 'las Speier, Suud Mohamed Nahdi, Vita Christie, Yansong Harry Huang, Katrina D Ward, Kylie Gwynne","doi":"10.1177/20552076241277039","DOIUrl":"10.1177/20552076241277039","url":null,"abstract":"<p><strong>Objective: </strong>Health programs for Indigenous people are most effective, acceptable, and sustainable when Indigenous perspectives are prioritized. Codesign builds on Indigenous people's creativity and propensity to experiment with new technologies and ensures research is designed and implemented in a culturally safe and respectful manner. Limited research has focused on older Indigenous people as partners in digital health. No research has focused on the acceptability and feasibility of older Indigenous people using wearables for heart health monitoring. This study provides insights into the acceptability and feasibility for ≥55-year-old Indigenous people living in remote locations to use wearables (watches and patches) to detect atrial fibrillation (AF) and high blood pressure.</p><p><strong>Methods: </strong>This mixed methods study was codesigned and coimplemented with the local Aboriginal Controlled Health Service in a remote area of New South Wales, Australia. It included active involvement and codesign with the participants. The devices used in this study included a Withings Scan watch and a Biobeat patch.</p><p><strong>Results: </strong>Despite challenging conditions (>36°C) and variable internet connectivity, 11 Indigenous older adults participated in a five-day wearables program in a remote location. Participants indicated that using digital health devices was acceptable and feasible for older Indigenous users. They described high levels of comfort, safety and convenience when using wearables (patches and watches) to detect AF. They were active participants in codesigning the program.</p><p><strong>Conclusion: </strong>Older Indigenous Australians are motivated to use wearable health devices. They are keen to participate in codesign innovative health tech programs to ensure new health technologies are acceptable to Indigenous people and feasible for remote locations.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11363237/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142114533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-28eCollection Date: 2024-01-01DOI: 10.1177/20552076241271856
Tamara Mujirishvili, Julio Cabrero-Garćıa, Francisco Fló Rez-Revuelta, Miguel Richart-Mart Inez
Objective: As the world faces an aging population, the complexities of care management become increasingly pronounced. While technological solutions hold promise in addressing the dynamic demands of care, many nuances are to be considered in the design and implementation of active and assisted living technologies (AAL) for older adult care. This qualitative study, set in southern Spain, is positioned at the crossroads of healthcare challenges, as seen by the different actors involved in the care process and the technological solutions developed in response to these challenges. By investigating the complex landscape of caregiving and by examining the experiences and challenges faced by caregivers, healthcare professionals, and older adults, we aim to guide the development of vision-based AAL technologies that are responsive to the genuine needs of older adults and those requiring care.
Methods: A qualitative research methodology was used in the study. In total15 in-depth interviews and five focus groups were conducted with a diverse group of stakeholders involved in the process of care provision and reception.
Results: While the results demonstrate that there is a readiness for technological solutions, concerns over privacy and trust highlight the need for a carefully integrated, human-centric approach to technology in caregiving.
Conclusion: This research serves as a compass, guiding future discussions on the intersection of aging, technology, and care, with the ultimate goal of transforming caregiving into a collaborative and enriching journey for all stakeholders involved.
{"title":"Navigating the crossroads of aging, caregiving and technology: Insights from a southern Spain about video-based technology in the care context.","authors":"Tamara Mujirishvili, Julio Cabrero-Garćıa, Francisco Fló Rez-Revuelta, Miguel Richart-Mart Inez","doi":"10.1177/20552076241271856","DOIUrl":"10.1177/20552076241271856","url":null,"abstract":"<p><strong>Objective: </strong>As the world faces an aging population, the complexities of care management become increasingly pronounced. While technological solutions hold promise in addressing the dynamic demands of care, many nuances are to be considered in the design and implementation of active and assisted living technologies (AAL) for older adult care. This qualitative study, set in southern Spain, is positioned at the crossroads of healthcare challenges, as seen by the different actors involved in the care process and the technological solutions developed in response to these challenges. By investigating the complex landscape of caregiving and by examining the experiences and challenges faced by caregivers, healthcare professionals, and older adults, we aim to guide the development of vision-based AAL technologies that are responsive to the genuine needs of older adults and those requiring care.</p><p><strong>Methods: </strong>A qualitative research methodology was used in the study. In total15 in-depth interviews and five focus groups were conducted with a diverse group of stakeholders involved in the process of care provision and reception.</p><p><strong>Results: </strong>While the results demonstrate that there is a readiness for technological solutions, concerns over privacy and trust highlight the need for a carefully integrated, human-centric approach to technology in caregiving.</p><p><strong>Conclusion: </strong>This research serves as a compass, guiding future discussions on the intersection of aging, technology, and care, with the ultimate goal of transforming caregiving into a collaborative and enriching journey for all stakeholders involved.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11363029/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142114530","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-25eCollection Date: 2024-01-01DOI: 10.1177/20552076241277027
Tao Shi, Jianping Yang, Ningli Zhang, Wei Rong, Lusha Gao, Ping Xia, Jie Zou, Na Zhu, Fazhi Yang, Lixing Chen
Objective: Explainable machine learning (XAI) was introduced in this study to improve the interpretability, explainability and transparency of the modelling results. The survex package in R was used to interpret and compare two survival models - the Cox proportional hazards regression (coxph) model and the random survival forest (rfsrc) model - and to estimate overall survival (OS) and its determinants in heart failure (HF) patients using these models.
Methods: We selected 1159 HF patients hospitalised at the First Affiliated Hospital of Kunming Medical University. First, the performance of the two models was investigated using the C-index, the integrated C/D AUC, and the integrated Brier score. Second, a global explanation of the whole cohort was carried out using the time-dependent variable importance and the partial dependence survival profile. Finally, the SurvSHAP(t) and SurvLIME plots and the ceteris paribus survival profile were used to obtain a local explanation for each patient.
Results: By comparing the C-index, the C/D AUC, and the Brier score, this study showed that the model performance of rfsrc was better than coxph. The global explanation of the whole cohort suggests that the C-reactive protein, lg BNP (brain natriuretic peptide), estimated glomerular filtration rate, albumin, age and blood chloride were significant unfavourable predictors of OS in HF patients in both the cxoph and the rfsrc models. By including individual patients in the model, we can provide a local explanation for each patient, which guides the clinician in individualising the patient's treatment.
Conclusion: By comparison, we conclude that the model performance of rfsrc is better than that of coxph. These two predictive models, which address not only the whole population but also selected patients, can help clinicians personalise the treatment of each HF patient according to his or her specific situation.
目的:本研究引入了可解释机器学习(XAI),以提高建模结果的可解释性、可解释性和透明度。研究使用 R 中的 survex 软件包来解释和比较两种生存模型--Cox 比例危险回归模型(coxph)和随机生存森林模型(rfsrc)--并使用这些模型估计心力衰竭(HF)患者的总生存期(OS)及其决定因素:我们选取了昆明医科大学第一附属医院住院的1159名心衰患者。首先,使用 C 指数、综合 C/D AUC 和综合 Brier 评分对两个模型的性能进行了研究。其次,利用随时间变化的变量重要性和部分依赖生存曲线对整个队列进行了全局解释。最后,利用 SurvSHAP(t) 和 SurvLIME 图以及比差生存曲线对每位患者进行局部解释:通过比较 C 指数、C/D AUC 和 Brier 评分,该研究表明 rfsrc 的模型性能优于 coxph。对整个队列的总体解释表明,在 cxoph 和 rfsrc 模型中,C 反应蛋白、lg BNP(脑钠肽)、估计肾小球滤过率、白蛋白、年龄和血氯化物都是对 HF 患者 OS 明显不利的预测因子。通过将个体患者纳入模型,我们可以为每个患者提供局部解释,从而指导临床医生对患者进行个体化治疗:通过比较,我们得出结论:rfsrc 的模型性能优于 coxph。这两个预测模型不仅针对整个人群,也针对选定的患者,可以帮助临床医生根据每位高频患者的具体情况对其进行个性化治疗。
{"title":"Comparison and use of explainable machine learning-based survival models for heart failure patients.","authors":"Tao Shi, Jianping Yang, Ningli Zhang, Wei Rong, Lusha Gao, Ping Xia, Jie Zou, Na Zhu, Fazhi Yang, Lixing Chen","doi":"10.1177/20552076241277027","DOIUrl":"10.1177/20552076241277027","url":null,"abstract":"<p><strong>Objective: </strong>Explainable machine learning (XAI) was introduced in this study to improve the interpretability, explainability and transparency of the modelling results. The survex package in R was used to interpret and compare two survival models - the Cox proportional hazards regression (coxph) model and the random survival forest (rfsrc) model - and to estimate overall survival (OS) and its determinants in heart failure (HF) patients using these models.</p><p><strong>Methods: </strong>We selected 1159 HF patients hospitalised at the First Affiliated Hospital of Kunming Medical University. First, the performance of the two models was investigated using the C-index, the integrated C/D AUC, and the integrated Brier score. Second, a global explanation of the whole cohort was carried out using the time-dependent variable importance and the partial dependence survival profile. Finally, the SurvSHAP(t) and SurvLIME plots and the ceteris paribus survival profile were used to obtain a local explanation for each patient.</p><p><strong>Results: </strong>By comparing the C-index, the C/D AUC, and the Brier score, this study showed that the model performance of rfsrc was better than coxph. The global explanation of the whole cohort suggests that the C-reactive protein, lg BNP (brain natriuretic peptide), estimated glomerular filtration rate, albumin, age and blood chloride were significant unfavourable predictors of OS in HF patients in both the cxoph and the rfsrc models. By including individual patients in the model, we can provide a local explanation for each patient, which guides the clinician in individualising the patient's treatment.</p><p><strong>Conclusion: </strong>By comparison, we conclude that the model performance of rfsrc is better than that of coxph. These two predictive models, which address not only the whole population but also selected patients, can help clinicians personalise the treatment of each HF patient according to his or her specific situation.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11348487/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142082506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-25eCollection Date: 2024-01-01DOI: 10.1177/20552076241269555
Bada Kang, Jinkyoung Ma, Innhee Jeong, Seolah Yoon, Jennifer Ivy Kim, Seok-Jae Heo, Sarah Soyeon Oh
Objective: This study describes a research protocol for a behavioral marker-based predictive model that examines the functional status of older adults with subjective cognitive decline and mild cognitive impairment.
Methods: A total of 130 older adults aged ≥65 years with subjective cognitive decline or mild cognitive impairment will be recruited from the Dementia Relief Centers or the Community Service Centers. Data on behavioral and psychosocial markers (e.g. physical activity, mobility, sleep/wake patterns, social interaction, and mild behavioral impairment) will be collected using passive wearable actigraphy, in-person questionnaires, and smartphone-based ecological momentary assessments. Two follow-up assessments will be performed at 12 and 24 months after baseline. Mixed-effect machine learning models: MErf, MEgbm, MEmod, and MEctree, and standard machine learning models without random effects [random forest, gradient boosting machine] will be employed in our analyses to predict functional status over time.
Results: The results of this study will be fundamental for developing tailored digital interventions that apply deep learning techniques to behavioral data to predict, identify, and aid in the management of functional decline in older adults with subjective cognitive decline and mild cognitive impairment. These older adults are considered the optimal target population for preventive interventions and will benefit from such tailored strategies.
Conclusions: Our study will contribute to the development of self-care interventions that utilize behavioral data and machine learning techniques to provide automated analyses of the functional decline of older adults who are at risk for dementia.
{"title":"Behavioral marker-based predictive modeling of functional status for older adults with subjective cognitive decline and mild cognitive impairment: Study protocol.","authors":"Bada Kang, Jinkyoung Ma, Innhee Jeong, Seolah Yoon, Jennifer Ivy Kim, Seok-Jae Heo, Sarah Soyeon Oh","doi":"10.1177/20552076241269555","DOIUrl":"10.1177/20552076241269555","url":null,"abstract":"<p><strong>Objective: </strong>This study describes a research protocol for a behavioral marker-based predictive model that examines the functional status of older adults with subjective cognitive decline and mild cognitive impairment.</p><p><strong>Methods: </strong>A total of 130 older adults aged ≥65 years with subjective cognitive decline or mild cognitive impairment will be recruited from the Dementia Relief Centers or the Community Service Centers. Data on behavioral and psychosocial markers (e.g. physical activity, mobility, sleep/wake patterns, social interaction, and mild behavioral impairment) will be collected using passive wearable actigraphy, in-person questionnaires, and smartphone-based ecological momentary assessments. Two follow-up assessments will be performed at 12 and 24 months after baseline. Mixed-effect machine learning models: MErf, MEgbm, MEmod, and MEctree, and standard machine learning models without random effects [random forest, gradient boosting machine] will be employed in our analyses to predict functional status over time.</p><p><strong>Results: </strong>The results of this study will be fundamental for developing tailored digital interventions that apply deep learning techniques to behavioral data to predict, identify, and aid in the management of functional decline in older adults with subjective cognitive decline and mild cognitive impairment. These older adults are considered the optimal target population for preventive interventions and will benefit from such tailored strategies.</p><p><strong>Conclusions: </strong>Our study will contribute to the development of self-care interventions that utilize behavioral data and machine learning techniques to provide automated analyses of the functional decline of older adults who are at risk for dementia.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11348489/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142082505","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-25eCollection Date: 2024-01-01DOI: 10.1177/20552076241264641
Manar K Alomair, Lama S Alabduladheem, Marwah A Almajed, Amjad A Alobaid, Maged E Mohamed, Abdulaziz O Alsultan, Nancy S Younis
Automated dispensing cabinets (ADCs) are decentralized, computer-controlled systems used to store, distribute, and track medications at the point of care in the wards.
Objective: The objective of the current study is to evaluate how healthcare practitioners are satisfied with ADCs and scrutinize some influencing factors that could affect this satisfaction.
Material: A cross-sectional survey study was designed and distributed online to healthcare providers in Al-hasa hospitals.
Results: A total of 166 participants. Regarding the frequency and pattern of ADC use, around 79.5% used ADC and 85.4% were informed about using ADC on a daily basis. As for the level of satisfaction with ADC, an exact 81.9% gave a high rate for overall satisfaction, 81.3% were highly satisfied with the system's accuracy, and 74.7% were highly satisfied with the time it takes to complete the task. Regarding usability of the system, 69.8% thought it was easy whereas 36.8% agreed that the time required for reloading medication is longer than before ADC. Furthermore, 79.5% agreed that ADC allowed them to accomplish their job safely, and 67.4% agreed that it improved their productivity. Regarding challenges, 74.7% agreed that all drawer types assure safe access and removal of medications, and 18.7% agreed that there is a significant potential for loss of data.
Conclusion: This study investigated healthcare staff's perceptions and satisfaction with ADCs in Al-hasa hospitals. The healthcare participants were mostly highly satisfied with the use of the ADCs which translated into better patient care and improved patient safety as well as higher productivity.
{"title":"Evaluation of the automated dispensing cabinets users' level of satisfaction and the influencing factors in Al-Ahsa hospitals.","authors":"Manar K Alomair, Lama S Alabduladheem, Marwah A Almajed, Amjad A Alobaid, Maged E Mohamed, Abdulaziz O Alsultan, Nancy S Younis","doi":"10.1177/20552076241264641","DOIUrl":"10.1177/20552076241264641","url":null,"abstract":"<p><p>Automated dispensing cabinets (ADCs) are decentralized, computer-controlled systems used to store, distribute, and track medications at the point of care in the wards.</p><p><strong>Objective: </strong>The objective of the current study is to evaluate how healthcare practitioners are satisfied with ADCs and scrutinize some influencing factors that could affect this satisfaction.</p><p><strong>Material: </strong>A cross-sectional survey study was designed and distributed online to healthcare providers in Al-hasa hospitals.</p><p><strong>Results: </strong>A total of 166 participants. Regarding the frequency and pattern of ADC use, around 79.5% used ADC and 85.4% were informed about using ADC on a daily basis. As for the level of satisfaction with ADC, an exact 81.9% gave a high rate for overall satisfaction, 81.3% were highly satisfied with the system's accuracy, and 74.7% were highly satisfied with the time it takes to complete the task. Regarding usability of the system, 69.8% thought it was easy whereas 36.8% agreed that the time required for reloading medication is longer than before ADC. Furthermore, 79.5% agreed that ADC allowed them to accomplish their job safely, and 67.4% agreed that it improved their productivity. Regarding challenges, 74.7% agreed that all drawer types assure safe access and removal of medications, and 18.7% agreed that there is a significant potential for loss of data.</p><p><strong>Conclusion: </strong>This study investigated healthcare staff's perceptions and satisfaction with ADCs in Al-hasa hospitals. The healthcare participants were mostly highly satisfied with the use of the ADCs which translated into better patient care and improved patient safety as well as higher productivity.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11348488/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142082507","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-25eCollection Date: 2024-01-01DOI: 10.1177/20552076241277025
Gülsüm Zekiye Tuncer, Metin Tuncer
Purpose: This study aimed to investigate professional nurses' general attitudes toward artificial intelligence, their knowledge and perceptions of ChatGPT usage, and the influencing factors.
Methods: The population of the research consists of nurses who follow a social media platform account in Turkey. The sample of the study consisted of 288 nurses who participated in the study between December 2023 and March 2024. Data were collected through an account on a social media platform via Google Forms using the Information Identification Questionnaire for ChatGPT and Artificial Intelligence Programs and the General Attitudes to Artificial Intelligence Scale (GAAIS).
Results: The mean scores obtained from the overall GAAIS and its Positive Attitudes subscale from the participants in this study were 67.54 ± 13.14 and 41.89 ± 11.24, respectively. Of the participants, 48.3% knew about ChatGPT and artificial intelligence programs. Of the participants, 27.8% used ChatGPT and artificial intelligence programs. Their scores for the Positive Attitude subscale were higher than were the scores of those who did not use such programs. Of the participants, 84.4% thought that nurses should be made aware of ChatGPT and artificial intelligence programs, 67% thought that the use of these programs would contribute to nurses' professional development, 42.4% thought that the use of these programs would not reduce nurses' workload, and 58.3% thought that the use of these programs would positively affect patient care.
Conclusion: In this study, it can be said that nurses in Turkey have positive attitudes toward integrating ChatGPT and AI programs to improve patient outcomes and add them to nursing practices.
Implications for nursing practice: The present study in which nurses' attitudes toward the implementation of ChatGPT and artificial intelligence programs were investigated is expected to provide information for healthcare institutions, policy makers and artificial intelligence developers on the integration of ChatGPT and artificial intelligence into nursing practice. It is necessary to create environments that use AI technologies that reduce the nursing workload of nurses in the clinical area and positively affect the quality of patient care.
{"title":"Investigation of nurses' general attitudes toward artificial intelligence and their perceptions of ChatGPT usage and influencing factors.","authors":"Gülsüm Zekiye Tuncer, Metin Tuncer","doi":"10.1177/20552076241277025","DOIUrl":"10.1177/20552076241277025","url":null,"abstract":"<p><strong>Purpose: </strong>This study aimed to investigate professional nurses' general attitudes toward artificial intelligence, their knowledge and perceptions of ChatGPT usage, and the influencing factors.</p><p><strong>Methods: </strong>The population of the research consists of nurses who follow a social media platform account in Turkey. The sample of the study consisted of 288 nurses who participated in the study between December 2023 and March 2024. Data were collected through an account on a social media platform via Google Forms using the Information Identification Questionnaire for ChatGPT and Artificial Intelligence Programs and the General Attitudes to Artificial Intelligence Scale (GAAIS).</p><p><strong>Results: </strong>The mean scores obtained from the overall GAAIS and its Positive Attitudes subscale from the participants in this study were 67.54 ± 13.14 and 41.89 ± 11.24, respectively. Of the participants, 48.3% knew about ChatGPT and artificial intelligence programs. Of the participants, 27.8% used ChatGPT and artificial intelligence programs. Their scores for the Positive Attitude subscale were higher than were the scores of those who did not use such programs. Of the participants, 84.4% thought that nurses should be made aware of ChatGPT and artificial intelligence programs, 67% thought that the use of these programs would contribute to nurses' professional development, 42.4% thought that the use of these programs would not reduce nurses' workload, and 58.3% thought that the use of these programs would positively affect patient care.</p><p><strong>Conclusion: </strong>In this study, it can be said that nurses in Turkey have positive attitudes toward integrating ChatGPT and AI programs to improve patient outcomes and add them to nursing practices.</p><p><strong>Implications for nursing practice: </strong>The present study in which nurses' attitudes toward the implementation of ChatGPT and artificial intelligence programs were investigated is expected to provide information for healthcare institutions, policy makers and artificial intelligence developers on the integration of ChatGPT and artificial intelligence into nursing practice. It is necessary to create environments that use AI technologies that reduce the nursing workload of nurses in the clinical area and positively affect the quality of patient care.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11348479/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142082508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-23eCollection Date: 2024-01-01DOI: 10.1177/20552076241272618
Luxshmi Nageswaran, Charlie Giurleo, Merna Seliman, Heather K Askes, Zeina Abu-Jurji, B Catherine Craven, Anna Kras-Dupuis, Julie Watson, Dalton L Wolfe
Objective: Parkwood VIP4SCI platform is a virtual e-health solution adapted from a version created for Spinal Cord Injury Ontario (SCIO) that focused on self-management skill development for persons with spinal cord injury (SCI) transitioning between stages of care, in partnership with caregivers and clinicians. This evaluation of the platform informs the usability and feasibility of a model to facilitate service care aims postrehabilitation.
Design: Participants: Inpatients and outpatients admitted to the SCI Rehabilitation Program (n = 31), and a mix of interdisciplinary clinicians on the Rehabilitation Team (n = 20). Caregivers participated at the discretion of the patient.Interventions: Inpatients were randomized into two groups (Platform or Standard Care (i.e., delayed access)). Outpatients were given access at enrollment. Pre-post assessments were completed using surveys, and platform analytics were collected. Weekly check-ins were introduced to increase engagement. Focus groups were held with a subset of participants near study completion.
Results: VIP4SCI was viewed as usable and feasible. Platform satisfaction assessed on a -3 to +3 scale ranged from +0.9 to 2.5, demonstrating positive agreement. Self-efficacy related to self-management ranged from 5.4 to 7.6 out of 10. The educational resource hub was identified as the most beneficial feature. Lack of clinician uptake was a barrier to integration into day-to-day practice.
Conclusions: Platform usage was low among all groups despite the perceived need for facilitating care coordination with consistent and intentional self-management programming. Despite the lack of uptake, partly due to challenges associated with the pandemic, conclusions on platform features and barriers to implementation will help to inform future programming.
{"title":"Parkwood's VIP4SCI platform: A virtual e-health self-management solution for persons with spinal cord injury across the care continuum.","authors":"Luxshmi Nageswaran, Charlie Giurleo, Merna Seliman, Heather K Askes, Zeina Abu-Jurji, B Catherine Craven, Anna Kras-Dupuis, Julie Watson, Dalton L Wolfe","doi":"10.1177/20552076241272618","DOIUrl":"10.1177/20552076241272618","url":null,"abstract":"<p><strong>Objective: </strong>Parkwood VIP4SCI platform is a virtual e-health solution adapted from a version created for Spinal Cord Injury Ontario (SCIO) that focused on self-management skill development for persons with spinal cord injury (SCI) transitioning between stages of care, in partnership with caregivers and clinicians. This evaluation of the platform informs the usability and feasibility of a model to facilitate service care aims postrehabilitation.</p><p><strong>Design: </strong><b>Participants:</b> Inpatients and outpatients admitted to the SCI Rehabilitation Program (n = 31), and a mix of interdisciplinary clinicians on the Rehabilitation Team (n = 20). Caregivers participated at the discretion of the patient.<b>Interventions:</b> Inpatients were randomized into two groups (Platform or Standard Care (i.e., delayed access)). Outpatients were given access at enrollment. Pre-post assessments were completed using surveys, and platform analytics were collected. Weekly check-ins were introduced to increase engagement. Focus groups were held with a subset of participants near study completion.</p><p><strong>Results: </strong>VIP4SCI was viewed as usable and feasible. Platform satisfaction assessed on a -3 to +3 scale ranged from +0.9 to 2.5, demonstrating positive agreement. Self-efficacy related to self-management ranged from 5.4 to 7.6 out of 10. The educational resource hub was identified as the most beneficial feature. Lack of clinician uptake was a barrier to integration into day-to-day practice.</p><p><strong>Conclusions: </strong>Platform usage was low among all groups despite the perceived need for facilitating care coordination with consistent and intentional self-management programming. Despite the lack of uptake, partly due to challenges associated with the pandemic, conclusions on platform features and barriers to implementation will help to inform future programming.</p>","PeriodicalId":51333,"journal":{"name":"DIGITAL HEALTH","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11342431/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142057298","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}