Pub Date : 2023-07-13eCollection Date: 2023-09-01DOI: 10.1007/s41666-023-00135-4
Omar El-Gayar, Ahmed Elnoshokaty
The initial healthy uptake of wearable devices is not necessarily accompanied by sustained or continued use. Accordingly, this study investigates the factors influencing the continuous use of wearable devices with a particular emphasis on design features. We complemented the expectation-confirmation model (ECM) theoretical foundation with various design features such as trust, readability, dialogue support, personalization, device battery, appeal, and social support. The study employs a simultaneous mixed method research design denoted as QUANT + qual. The quantitative analysis leverages partial least squares structural equation modeling (PLS-SEM) using survey data collected from wearable device users. The qualitative analysis complements the quantitative focus of the research by providing insights into the results obtained from the quantitative analysis. We found that subjects tend to use wearables daily (60%) or several times a week (33%), and 91% plan to use them even more. Subjects indicated multiple usages for wearables. Most subjects were using wearables for healthcare and wellness (61%) or sports and fitness (54%) and had smartwatches wearable type (74%). The model explains 24.1% (p < 0.01) of the variance of continued intention to use. As a theoretical contribution, the findings support using the ECM as a theoretical foundation for explaining the continued use of wearables. Partial least squares (PLS) and qualitative data analysis highlight the relative importance that wearable users place on perceived usefulness. Most notable are tracking functions and design features such as device battery, integration with other apps/devices, dialogue support, and appeal.
{"title":"Factors and Design Features Influencing the Continued Use of Wearable Devices.","authors":"Omar El-Gayar, Ahmed Elnoshokaty","doi":"10.1007/s41666-023-00135-4","DOIUrl":"10.1007/s41666-023-00135-4","url":null,"abstract":"<p><p>The initial healthy uptake of wearable devices is not necessarily accompanied by sustained or continued use. Accordingly, this study investigates the factors influencing the continuous use of wearable devices with a particular emphasis on design features. We complemented the expectation-confirmation model (ECM) theoretical foundation with various design features such as trust, readability, dialogue support, personalization, device battery, appeal, and social support. The study employs a simultaneous mixed method research design denoted as QUANT + qual. The quantitative analysis leverages partial least squares structural equation modeling (PLS-SEM) using survey data collected from wearable device users. The qualitative analysis complements the quantitative focus of the research by providing insights into the results obtained from the quantitative analysis. We found that subjects tend to use wearables daily (60%) or several times a week (33%), and 91% plan to use them even more. Subjects indicated multiple usages for wearables. Most subjects were using wearables for healthcare and wellness (61%) or sports and fitness (54%) and had smartwatches wearable type (74%). The model explains 24.1% (<i>p</i> < 0.01) of the variance of continued intention to use. As a theoretical contribution, the findings support using the ECM as a theoretical foundation for explaining the continued use of wearables. Partial least squares (PLS) and qualitative data analysis highlight the relative importance that wearable users place on perceived usefulness. Most notable are tracking functions and design features such as device battery, integration with other apps/devices, dialogue support, and appeal.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10449731/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10109770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
One of the hindrances in the widespread acceptance of deep learning-based decision support systems in healthcare is bias. Bias in its many forms occurs in the datasets used to train and test deep learning models and is amplified when deployed in the real world, leading to challenges such as model drift. Recent advancements in the field of deep learning have led to the deployment of deployable automated healthcare diagnosis decision support systems at hospitals as well as tele-medicine through IoT devices. Research has been focused primarily on the development and improvement of these systems leaving a gap in the analysis of the fairness. The domain of FAccT ML (fairness, accountability, and transparency) accounts for the analysis of these deployable machine learning systems. In this work, we present a framework for bias analysis in healthcare time series (BAHT) signals such as electrocardiogram (ECG) and electroencephalogram (EEG). BAHT provides a graphical interpretive analysis of bias in the training, testing datasets in terms of protected variables, and analysis of bias amplification by the trained supervised learning model for time series healthcare decision support systems. We thoroughly investigate three prominent time series ECG and EEG healthcare datasets used for model training and research. We show the extensive presence of bias in the datasets leads to potentially biased or unfair machine-learning models. Our experiments also demonstrate the amplification of identified bias with an observed maximum of 66.66%. We investigate the effect of model drift due to unanalyzed bias in datasets and algorithms. Bias mitigation though prudent is a nascent area of research. We present experiments and analyze the most prevalently accepted bias mitigation strategies of under-sampling, oversampling, and the use of synthetic data for balancing the dataset through augmentation. It is important that healthcare models, datasets, and bias mitigation strategies should be properly analyzed for a fair unbiased delivery of service.
{"title":"Bias Analysis in Healthcare Time Series (BAHT) Decision Support Systems from Meta Data.","authors":"Sagnik Dakshit, Sristi Dakshit, Ninad Khargonkar, Balakrishnan Prabhakaran","doi":"10.1007/s41666-023-00133-6","DOIUrl":"10.1007/s41666-023-00133-6","url":null,"abstract":"<p><p>One of the hindrances in the widespread acceptance of deep learning-based decision support systems in healthcare is bias. Bias in its many forms occurs in the datasets used to train and test deep learning models and is amplified when deployed in the real world, leading to challenges such as model drift. Recent advancements in the field of deep learning have led to the deployment of deployable automated healthcare diagnosis decision support systems at hospitals as well as tele-medicine through IoT devices. Research has been focused primarily on the development and improvement of these systems leaving a gap in the analysis of the fairness. The domain of FAccT ML (fairness, accountability, and transparency) accounts for the analysis of these deployable machine learning systems. In this work, we present a framework for bias analysis in healthcare time series (BAHT) signals such as electrocardiogram (ECG) and electroencephalogram (EEG). BAHT provides a graphical interpretive analysis of bias in the training, testing datasets in terms of protected variables, and analysis of bias amplification by the trained supervised learning model for time series healthcare decision support systems. We thoroughly investigate three prominent time series ECG and EEG healthcare datasets used for model training and research. We show the extensive presence of bias in the datasets leads to potentially biased or unfair machine-learning models. Our experiments also demonstrate the amplification of identified bias with an observed maximum of 66.66%. We investigate the effect of model drift due to unanalyzed bias in datasets and algorithms. Bias mitigation though prudent is a nascent area of research. We present experiments and analyze the most prevalently accepted bias mitigation strategies of under-sampling, oversampling, and the use of synthetic data for balancing the dataset through augmentation. It is important that healthcare models, datasets, and bias mitigation strategies should be properly analyzed for a fair unbiased delivery of service.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10290973/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9781798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-06-14eCollection Date: 2023-06-01DOI: 10.1007/s41666-023-00132-7
Pascal Riedel, Reinhold von Schwerin, Daniel Schaudt, Alexander Hafner, Christian Späte
Personal health data is subject to privacy regulations, making it challenging to apply centralized data-driven methods in healthcare, where personalized training data is frequently used. Federated Learning (FL) promises to provide a decentralized solution to this problem. In FL, siloed data is used for the model training to ensure data privacy. In this paper, we investigate the viability of the federated approach using the detection of COVID-19 pneumonia as a use case. 1411 individual chest radiographs, sourced from the public data repository COVIDx8 are used. The dataset contains radiographs of 753 normal lung findings and 658 COVID-19 related pneumonias. We partition the data unevenly across five separate data silos in order to reflect a typical FL scenario. For the binary image classification analysis of these radiographs, we propose ResNetFed, a pre-trained ResNet50 model modified for federation so that it supports Differential Privacy. In addition, we provide a customized FL strategy for the model training with COVID-19 radiographs. The experimental results show that ResNetFed clearly outperforms locally trained ResNet50 models. Due to the uneven distribution of the data in the silos, we observe that the locally trained ResNet50 models perform significantly worse than ResNetFed models (mean accuracies of 63% and 82.82%, respectively). In particular, ResNetFed shows excellent model performance in underpopulated data silos, achieving up to +34.9 percentage points higher accuracy compared to local ResNet50 models. Thus, with ResNetFed, we provide a federated solution that can assist the initial COVID-19 screening in medical centers in a privacy-preserving manner.
{"title":"ResNetFed: Federated Deep Learning Architecture for Privacy-Preserving Pneumonia Detection from COVID-19 Chest Radiographs.","authors":"Pascal Riedel, Reinhold von Schwerin, Daniel Schaudt, Alexander Hafner, Christian Späte","doi":"10.1007/s41666-023-00132-7","DOIUrl":"10.1007/s41666-023-00132-7","url":null,"abstract":"<p><p>Personal health data is subject to privacy regulations, making it challenging to apply centralized data-driven methods in healthcare, where personalized training data is frequently used. Federated Learning (FL) promises to provide a decentralized solution to this problem. In FL, siloed data is used for the model training to ensure data privacy. In this paper, we investigate the viability of the federated approach using the detection of COVID-19 pneumonia as a use case. 1411 individual chest radiographs, sourced from the public data repository COVIDx8 are used. The dataset contains radiographs of 753 normal lung findings and 658 COVID-19 related pneumonias. We partition the data unevenly across five separate data silos in order to reflect a typical FL scenario. For the binary image classification analysis of these radiographs, we propose <i>ResNetFed</i>, a pre-trained ResNet50 model modified for federation so that it supports <i>Differential Privacy</i>. In addition, we provide a customized FL strategy for the model training with COVID-19 radiographs. The experimental results show that ResNetFed clearly outperforms locally trained ResNet50 models. Due to the uneven distribution of the data in the silos, we observe that the locally trained ResNet50 models perform significantly worse than ResNetFed models (mean accuracies of 63% and 82.82%, respectively). In particular, ResNetFed shows excellent model performance in underpopulated data silos, achieving up to +34.9 percentage points higher accuracy compared to local ResNet50 models. Thus, with ResNetFed, we provide a federated solution that can assist the initial COVID-19 screening in medical centers in a privacy-preserving manner.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10265567/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10090807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-06-06eCollection Date: 2023-06-01DOI: 10.1007/s41666-023-00134-5
Saeedeh Heydarian, Alia Shakiba, Sharareh Rostam Niakan Kalhori
Research conducted on mobile apps providing mental health services has concluded that patients with mental disorders tend to use such apps to maintain mental health balance technology may help manage and monitor issues like bipolar disorder (BP). This study was conducted in four steps to identify the features of designing a mobile application for BP-affected patients including (1) a literature search, (2) analyzing existing mobile apps to examine their efficiency, (3) interviewing patients affected with BP to discover their needs, and 4) exploring the points of view of experts using a dynamic narrative survey. Literature search and mobile app analysis resulted in 45 features, which were later reduced to 30 after the experts were surveyed about the project. The features included the following: mood monitoring, sleep schedule, energy level evaluation, irritability, speech level, communication, sexual activity, self-confidence level, suicidal thoughts, guilt, concentration level, aggressiveness, anxiety, appetite, smoking or drug abuse, blood pressure, the patient's weight and the side effects of medication, reminders, mood data scales, diagrams or charts of the collected data, referring the collected data to a psychologist, educational information, sending feedbacks to patients using the application, and standard tests for mood assessment. The first phase of analysis should consider an expert and patient view survey, mood and medication tracking, as well as communication with other people in the same situation are the most features to be considered. The present study has identified the necessity of apps intended to manage and monitor bipolar patients to maximize efficiency and minimize relapse and side effects.
{"title":"The Minimum Feature Set for Designing Mobile Apps to Support Bipolar Disorder-Affected Patients: Proposal of Essential Functions and Requirements.","authors":"Saeedeh Heydarian, Alia Shakiba, Sharareh Rostam Niakan Kalhori","doi":"10.1007/s41666-023-00134-5","DOIUrl":"10.1007/s41666-023-00134-5","url":null,"abstract":"<p><p>Research conducted on mobile apps providing mental health services has concluded that patients with mental disorders tend to use such apps to maintain mental health balance technology may help manage and monitor issues like bipolar disorder (BP). This study was conducted in four steps to identify the features of designing a mobile application for BP-affected patients including (1) a literature search, (2) analyzing existing mobile apps to examine their efficiency, (3) interviewing patients affected with BP to discover their needs, and 4) exploring the points of view of experts using a dynamic narrative survey. Literature search and mobile app analysis resulted in 45 features, which were later reduced to 30 after the experts were surveyed about the project. The features included the following: mood monitoring, sleep schedule, energy level evaluation, irritability, speech level, communication, sexual activity, self-confidence level, suicidal thoughts, guilt, concentration level, aggressiveness, anxiety, appetite, smoking or drug abuse, blood pressure, the patient's weight and the side effects of medication, reminders, mood data scales, diagrams or charts of the collected data, referring the collected data to a psychologist, educational information, sending feedbacks to patients using the application, and standard tests for mood assessment. The first phase of analysis should consider an expert and patient view survey, mood and medication tracking, as well as communication with other people in the same situation are the most features to be considered. The present study has identified the necessity of apps intended to manage and monitor bipolar patients to maximize efficiency and minimize relapse and side effects.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10290972/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9781797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-05-01eCollection Date: 2023-06-01DOI: 10.1007/s41666-023-00126-5
Carlo Combi, Julio C Facelli, Peter Haddawy, John H Holmes, Sabine Koch, Hongfang Liu, Jochen Meyer, Mor Peleg, Giuseppe Pozzi, Gregor Stiglic, Pierangelo Veltri, Christopher C Yang
In 2020, the CoViD-19 pandemic spread worldwide in an unexpected way and suddenly modified many life issues, including social habits, social relationships, teaching modalities, and more. Such changes were also observable in many different healthcare and medical contexts. Moreover, the CoViD-19 pandemic acted as a stress test for many research endeavors, and revealed some limitations, especially in contexts where research results had an immediate impact on the social and healthcare habits of millions of people. As a result, the research community is called to perform a deep analysis of the steps already taken, and to re-think steps for the near and far future to capitalize on the lessons learned due to the pandemic. In this direction, on June 09th-11th, 2022, a group of twelve healthcare informatics researchers met in Rochester, MN, USA. This meeting was initiated by the Institute for Healthcare Informatics-IHI, and hosted by the Mayo Clinic. The goal of the meeting was to discuss and propose a research agenda for biomedical and health informatics for the next decade, in light of the changes and the lessons learned from the CoViD-19 pandemic. This article reports the main topics discussed and the conclusions reached. The intended readers of this paper, besides the biomedical and health informatics research community, are all those stakeholders in academia, industry, and government, who could benefit from the new research findings in biomedical and health informatics research. Indeed, research directions and social and policy implications are the main focus of the research agenda we propose, according to three levels: the care of individuals, the healthcare system view, and the population view.
{"title":"The IHI Rochester Report 2022 on Healthcare Informatics Research: Resuming After the CoViD-19.","authors":"Carlo Combi, Julio C Facelli, Peter Haddawy, John H Holmes, Sabine Koch, Hongfang Liu, Jochen Meyer, Mor Peleg, Giuseppe Pozzi, Gregor Stiglic, Pierangelo Veltri, Christopher C Yang","doi":"10.1007/s41666-023-00126-5","DOIUrl":"10.1007/s41666-023-00126-5","url":null,"abstract":"<p><p>In 2020, the CoViD-19 pandemic spread worldwide in an unexpected way and suddenly modified many life issues, including social habits, social relationships, teaching modalities, and more. Such changes were also observable in many different healthcare and medical contexts. Moreover, the CoViD-19 pandemic acted as a stress test for many research endeavors, and revealed some limitations, especially in contexts where research results had an immediate impact on the social and healthcare habits of millions of people. As a result, the research community is called to perform a deep analysis of the steps already taken, and to re-think steps for the near and far future to capitalize on the lessons learned due to the pandemic. In this direction, on June 09th-11th, 2022, a group of twelve healthcare informatics researchers met in Rochester, MN, USA. This meeting was initiated by the Institute for Healthcare Informatics-IHI, and hosted by the Mayo Clinic. The goal of the meeting was to discuss and propose a research agenda for biomedical and health informatics for the next decade, in light of the changes and the lessons learned from the CoViD-19 pandemic. This article reports the main topics discussed and the conclusions reached. The intended readers of this paper, besides the biomedical and health informatics research community, are all those stakeholders in academia, industry, and government, who could benefit from the new research findings in biomedical and health informatics research. Indeed, research directions and social and policy implications are the main focus of the research agenda we propose, according to three levels: the care of individuals, the healthcare system view, and the population view.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10150351/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10012892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-03-13eCollection Date: 2023-06-01DOI: 10.1007/s41666-022-00124-z
L M van der Lubbe, C Gerritsen, M C A Klein, R F Rodgers, K V Hindriks
Young adulthood is a period of high risk for the development of mental health concerns. Increasing well-being among young adults is important to prevent mental health concerns and their consequences. Self-compassion has been identified as a modifiable trait with the potential to protect against mental health concerns. An online self-guided mental health training program using gamification was developed and the user experience was evaluated in a 6-week experimental design. During this period, 294 participants were allocated to use the online training program via a website. User experience was assessed via self-report questionnaires, and interaction data for the training program were also collected. Results showed that those who completed the intervention (n= 47) visited the website on average 3.2 days a week, with a mean of 45.8 interactions during the 6 weeks. Participants report positive user experiences of the online training, on average a System Usability Scale Brooke (1) score of 79.1 (out of 100) at the end-point. Participants showed positive engagement with story elements of the training, based on an average score of 4.1 (out of 5) in the evaluation of the story at the end-point. This study found the online self-compassion intervention for youth to be acceptable, although some features seem preferred by users as compared to others. Gamification in the form of a guiding story and a reward structure seemed to be a promising element for successfully motivating participants and serving as a guiding metaphor for self-compassion.
{"title":"Experiences of Users with an Online Self-Guided Mental Health Training Program Using Gamification.","authors":"L M van der Lubbe, C Gerritsen, M C A Klein, R F Rodgers, K V Hindriks","doi":"10.1007/s41666-022-00124-z","DOIUrl":"10.1007/s41666-022-00124-z","url":null,"abstract":"<p><p>Young adulthood is a period of high risk for the development of mental health concerns. Increasing well-being among young adults is important to prevent mental health concerns and their consequences. Self-compassion has been identified as a modifiable trait with the potential to protect against mental health concerns. An online self-guided mental health training program using gamification was developed and the user experience was evaluated in a 6-week experimental design. During this period, 294 participants were allocated to use the online training program via a website. User experience was assessed via self-report questionnaires, and interaction data for the training program were also collected. Results showed that those who completed the intervention (<i>n</i>= 47) visited the website on average 3.2 days a week, with a mean of 45.8 interactions during the 6 weeks. Participants report positive user experiences of the online training, on average a System Usability Scale Brooke (1) score of 79.1 (out of 100) at the end-point. Participants showed positive engagement with story elements of the training, based on an average score of 4.1 (out of 5) in the evaluation of the story at the end-point. This study found the online self-compassion intervention for youth to be acceptable, although some features seem preferred by users as compared to others. Gamification in the form of a guiding story and a reward structure seemed to be a promising element for successfully motivating participants and serving as a guiding metaphor for self-compassion.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10010230/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9713407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-03-01DOI: 10.1007/s41666-023-00131-8
Marian Z M Hurmuz, Stephanie M Jansen-Kosterink, Lex van Velsen
The aim of this study was to investigate why adults participate in summative eHealth evaluations, and whether their reasons for participating affect their (non-)use of eHealth. A questionnaire was distributed among adults (aged ≥ 18 years) who participated in a summative eHealth evaluation. This questionnaire focused on participants' reason to enroll, their expectations, and on whether the study met their expectations. Answers to open-ended questions were coded by two researchers independently. With the generalized estimating equations method we tested whether there is a difference between the type of reasons in use of the eHealth service. One hundred and thirty-one adults participated (64.9% female; mean age 62.5 years (SD = 10.5)). Their reasons for participating were mainly health-related (e.g., being more active). Between two types of motivations there was a difference in the use of the eHealth service: Participants with an intellectual motivation were more likely to drop out, compared to participants with an altruistic motivation. The most prevalent expectations when joining a summative eHealth evaluation were health-related (like expecting to improve one's health). 38.6% of the participants said their expectation was fulfilled by the study. In conclusion, We encourage eHealth evaluators to learn about adults' motivation to participate in their summative evaluation, as this motivation is very likely to affect their results. Including altruistically motivated participants biases the results by their tendency to continue participating in a study.
{"title":"How to Prevent the Drop-Out: Understanding Why Adults Participate in Summative eHealth Evaluations.","authors":"Marian Z M Hurmuz, Stephanie M Jansen-Kosterink, Lex van Velsen","doi":"10.1007/s41666-023-00131-8","DOIUrl":"https://doi.org/10.1007/s41666-023-00131-8","url":null,"abstract":"<p><p>The aim of this study was to investigate why adults participate in summative eHealth evaluations, and whether their reasons for participating affect their (non-)use of eHealth. A questionnaire was distributed among adults (aged ≥ 18 years) who participated in a summative eHealth evaluation. This questionnaire focused on participants' reason to enroll, their expectations, and on whether the study met their expectations. Answers to open-ended questions were coded by two researchers independently. With the generalized estimating equations method we tested whether there is a difference between the type of reasons in use of the eHealth service. One hundred and thirty-one adults participated (64.9% female; mean age 62.5 years (SD = 10.5)). Their reasons for participating were mainly health-related (e.g., being more active). Between two types of motivations there was a difference in the use of the eHealth service: Participants with an intellectual motivation were more likely to drop out, compared to participants with an altruistic motivation. The most prevalent expectations when joining a summative eHealth evaluation were health-related (like expecting to improve one's health). 38.6% of the participants said their expectation was fulfilled by the study. In conclusion, We encourage eHealth evaluators to learn about adults' motivation to participate in their summative evaluation, as this motivation is very likely to affect their results. Including altruistically motivated participants biases the results by their tendency to continue participating in a study.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9995638/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9471114","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wrong dose, a common prescription error, can cause serious patient harm, especially in the case of high-risk drugs like oral corticosteroids. This study aims to build a machine learning model to predict dose-related prescription modifications for oral prednisolone tablets (i.e., highly imbalanced data with very few positive cases). Prescription data were obtained from the electronic medical records at a single institute. Cluster analysis classified the clinical departments into six clusters with similar patterns of prednisolone prescription. Two patterns of training datasets were created with/without preprocessing by the SMOTE method. Five ML models (SVM, KNN, GB, RF, and BRF) and logistic regression (LR) models were constructed by Python. The model was internally validated by five-fold stratified cross-validation and was validated with a 30% holdout test dataset. Eighty-two thousand five hundred fifty-three prescribing data for prednisolone tablets containing 135 dose-corrected positive cases were obtained. In the original dataset (without SMOTE), only the BRF model showed a good performance (in test dataset, ROC-AUC:0.917, recall: 0.951). In the training dataset preprocessed by SMOTE, performance was improved on all models. The highest performance models with SMOTE were SVM (in test dataset, ROC-AUC: 0.820, recall: 0.659) and BRF (ROC-AUC: 0.814, recall: 0.634). Although the prescribing data for dose-related collection are highly imbalanced, various techniques such as the following have allowed us to build high-performance prediction models: data preprocessing by SMOTE, stratified cross-validation, and BRF classifier corresponding to imbalanced data. ML is useful in complicated dose audits such as oral prednisolone.
Supplementary information: The online version contains supplementary material available at 10.1007/s41666-023-00128-3.
{"title":"Prediction of Prednisolone Dose Correction Using Machine Learning.","authors":"Hiroyasu Sato, Yoshinobu Kimura, Masahiro Ohba, Yoshiaki Ara, Susumu Wakabayashi, Hiroaki Watanabe","doi":"10.1007/s41666-023-00128-3","DOIUrl":"https://doi.org/10.1007/s41666-023-00128-3","url":null,"abstract":"<p><p>Wrong dose, a common prescription error, can cause serious patient harm, especially in the case of high-risk drugs like oral corticosteroids. This study aims to build a machine learning model to predict dose-related prescription modifications for oral prednisolone tablets (i.e., highly imbalanced data with very few positive cases). Prescription data were obtained from the electronic medical records at a single institute. Cluster analysis classified the clinical departments into six clusters with similar patterns of prednisolone prescription. Two patterns of training datasets were created with/without preprocessing by the SMOTE method. Five ML models (SVM, KNN, GB, RF, and BRF) and logistic regression (LR) models were constructed by Python. The model was internally validated by five-fold stratified cross-validation and was validated with a 30% holdout test dataset. Eighty-two thousand five hundred fifty-three prescribing data for prednisolone tablets containing 135 dose-corrected positive cases were obtained. In the original dataset (without SMOTE), only the BRF model showed a good performance (in test dataset, ROC-AUC:0.917, recall: 0.951). In the training dataset preprocessed by SMOTE, performance was improved on all models. The highest performance models with SMOTE were SVM (in test dataset, ROC-AUC: 0.820, recall: 0.659) and BRF (ROC-AUC: 0.814, recall: 0.634). Although the prescribing data for dose-related collection are highly imbalanced, various techniques such as the following have allowed us to build high-performance prediction models: data preprocessing by SMOTE, stratified cross-validation, and BRF classifier corresponding to imbalanced data. ML is useful in complicated dose audits such as oral prednisolone.</p><p><strong>Supplementary information: </strong>The online version contains supplementary material available at 10.1007/s41666-023-00128-3.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9995628/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9455324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-03-01DOI: 10.1007/s41666-023-00129-2
Luís Irgang, Henrik Barth, Magnus Holmén
Despite the advances in modern medicine, the use of data-driven technologies (DDTs) to prevent surgical site infections (SSIs) remains a major challenge. Scholars recognise that data management is the next frontier in infection prevention, but many aspects related to the benefits and advantages of using DDTs to mitigate SSI risk factors remain unclear and underexplored in the literature. This study explores how DDTs enable value creation in the prevention of SSIs. This study follows a systematic literature review approach and the PRISMA statement to analyse peer-reviewed articles from seven databases. Fifty-nine articles were included in the review and were analysed through a descriptive and a thematic analysis. The findings suggest a growing interest in DDTs in SSI prevention in the last 5 years, and that machine learning and smartphone applications are widely used in SSI prevention. DDTs are mainly applied to prevent SSIs in clean and clean-contaminated surgeries and often used to manage patient-related data in the postoperative stage. DDTs enable the creation of nine categories of value that are classified in four dimensions: cost/sacrifice, functional/instrumental, experiential/hedonic, and symbolic/expressive. This study offers a unique and systematic overview of the value creation aspects enabled by DDT applications in SSI prevention and suggests that additional research is needed in four areas: value co-creation and product-service systems, DDTs in contaminated and dirty surgeries, data legitimation and explainability, and data-driven interventions.
Supplementary information: The online version contains supplementary material available at 10.1007/s41666-023-00129-2.
{"title":"Data-Driven Technologies as Enablers for Value Creation in the Prevention of Surgical Site Infections: a Systematic Review.","authors":"Luís Irgang, Henrik Barth, Magnus Holmén","doi":"10.1007/s41666-023-00129-2","DOIUrl":"https://doi.org/10.1007/s41666-023-00129-2","url":null,"abstract":"<p><p>Despite the advances in modern medicine, the use of data-driven technologies (DDTs) to prevent surgical site infections (SSIs) remains a major challenge. Scholars recognise that data management is the next frontier in infection prevention, but many aspects related to the benefits and advantages of using DDTs to mitigate SSI risk factors remain unclear and underexplored in the literature. This study explores how DDTs enable value creation in the prevention of SSIs. This study follows a systematic literature review approach and the PRISMA statement to analyse peer-reviewed articles from seven databases. Fifty-nine articles were included in the review and were analysed through a descriptive and a thematic analysis. The findings suggest a growing interest in DDTs in SSI prevention in the last 5 years, and that machine learning and smartphone applications are widely used in SSI prevention. DDTs are mainly applied to prevent SSIs in clean and clean-contaminated surgeries and often used to manage patient-related data in the postoperative stage. DDTs enable the creation of nine categories of value that are classified in four dimensions: cost/sacrifice, functional/instrumental, experiential/hedonic, and symbolic/expressive. This study offers a unique and systematic overview of the value creation aspects enabled by DDT applications in SSI prevention and suggests that additional research is needed in four areas: value co-creation and product-service systems, DDTs in contaminated and dirty surgeries, data legitimation and explainability, and data-driven interventions.</p><p><strong>Supplementary information: </strong>The online version contains supplementary material available at 10.1007/s41666-023-00129-2.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9995622/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9100968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-02-15eCollection Date: 2023-03-01DOI: 10.1007/s41666-023-00127-4
Eman Rezk, Mohamed Eltorki, Wael El-Dakhakhni
The recent advances in artificial intelligence have led to the rapid development of computer-aided skin cancer diagnosis applications that perform on par with dermatologists. However, the black-box nature of such applications makes it difficult for physicians to trust the predicted decisions, subsequently preventing the proliferation of such applications in the clinical workflow. In this work, we aim to address this challenge by developing an interpretable skin cancer diagnosis approach using clinical images. Accordingly, a skin cancer diagnosis model consolidated with two interpretability methods is developed. The first interpretability method integrates skin cancer diagnosis domain knowledge, characterized by a skin lesion taxonomy, into model development, whereas the other method focuses on visualizing the decision-making process by highlighting the dominant of interest regions of skin lesion images. The proposed model is trained and validated on clinical images since the latter are easily obtainable by non-specialist healthcare providers. The results demonstrate the effectiveness of incorporating lesion taxonomy in improving model classification accuracy, where our model can predict the skin lesion origin as melanocytic or non-melanocytic with an accuracy of 87%, predict lesion malignancy with 77% accuracy, and provide disease diagnosis with an accuracy of 71%. In addition, the implemented interpretability methods assist understand the model's decision-making process and detecting misdiagnoses. This work is a step toward achieving interpretability in skin cancer diagnosis using clinical images. The developed approach can assist general practitioners to make an early diagnosis, thus reducing the redundant referrals that expert dermatologists receive for further investigations.
{"title":"Interpretable Skin Cancer Classification based on Incremental Domain Knowledge Learning.","authors":"Eman Rezk, Mohamed Eltorki, Wael El-Dakhakhni","doi":"10.1007/s41666-023-00127-4","DOIUrl":"10.1007/s41666-023-00127-4","url":null,"abstract":"<p><p>The recent advances in artificial intelligence have led to the rapid development of computer-aided skin cancer diagnosis applications that perform on par with dermatologists. However, the black-box nature of such applications makes it difficult for physicians to trust the predicted decisions, subsequently preventing the proliferation of such applications in the clinical workflow. In this work, we aim to address this challenge by developing an interpretable skin cancer diagnosis approach using clinical images. Accordingly, a skin cancer diagnosis model consolidated with two interpretability methods is developed. The first interpretability method integrates skin cancer diagnosis domain knowledge, characterized by a skin lesion taxonomy, into model development, whereas the other method focuses on visualizing the decision-making process by highlighting the dominant of interest regions of skin lesion images. The proposed model is trained and validated on clinical images since the latter are easily obtainable by non-specialist healthcare providers. The results demonstrate the effectiveness of incorporating lesion taxonomy in improving model classification accuracy, where our model can predict the skin lesion origin as melanocytic or non-melanocytic with an accuracy of 87%, predict lesion malignancy with 77% accuracy, and provide disease diagnosis with an accuracy of 71%. In addition, the implemented interpretability methods assist understand the model's decision-making process and detecting misdiagnoses. This work is a step toward achieving interpretability in skin cancer diagnosis using clinical images. The developed approach can assist general practitioners to make an early diagnosis, thus reducing the redundant referrals that expert dermatologists receive for further investigations.</p>","PeriodicalId":36444,"journal":{"name":"Journal of Healthcare Informatics Research","volume":null,"pages":null},"PeriodicalIF":5.9,"publicationDate":"2023-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9995827/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9455325","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}