Pub Date : 2024-09-27DOI: 10.1186/s12911-024-02679-w
Laura Martínez-García, Alba Fadrique-Jiménez, Vanesa-Ferreres -Galán, Cristina Robert Flors, Jorge Osma
Background: Interest in mental health smartphone applications has grown in recent years. Despite their effectiveness and advantages, special attention needs to be paid to two aspects to ensure app engagement: to include patients and professionals in their design and to guarantee their usability. The aim of this study was to analyse the perceived usability and quality of the preliminary version of RegulEm, an app based in the Unified Protocol, as part of the second stage of the app development.
Methods: A parallel mixed methods study was used with 7 professionals and 4 users who were previously involved in the first stage of the development of the app. MARS, uMARS and SUS scales were used, and two focus groups were conducted. Descriptive statistical analysis and a thematic content analysis were performed in order to gather as much information as possible on RegulEm's usability and quality as well as suggestions for improvement.
Results: RegulEm's usability was perceived through the SUS scale scores as good by users (75 points) and excellent by professionals (84.64 points), while its quality was perceived through the uMARS and MARS scales as good by both groups, with 4 and 4.14 points out of 5. Different areas regarding RegulEm's usability and suggestions for improvement were identified in both focus groups and 20% of the suggestions proposed were implemented in the refined version of RegulEm.
Conclusion: RegulEm's usability and quality were perceived as good by users and professionals and different identified areas have contributed to its refinement. This study provides a more complete picture of RegulEm's usability and quality prior analysing its effectiveness, implementation and cost-effectiveness in Spanish public mental health units.
{"title":"RegulEm, an unified protocol based-app for the treatment of emotional disorders: a parallel mixed methods usability and quality study.","authors":"Laura Martínez-García, Alba Fadrique-Jiménez, Vanesa-Ferreres -Galán, Cristina Robert Flors, Jorge Osma","doi":"10.1186/s12911-024-02679-w","DOIUrl":"https://doi.org/10.1186/s12911-024-02679-w","url":null,"abstract":"<p><strong>Background: </strong>Interest in mental health smartphone applications has grown in recent years. Despite their effectiveness and advantages, special attention needs to be paid to two aspects to ensure app engagement: to include patients and professionals in their design and to guarantee their usability. The aim of this study was to analyse the perceived usability and quality of the preliminary version of RegulEm, an app based in the Unified Protocol, as part of the second stage of the app development.</p><p><strong>Methods: </strong>A parallel mixed methods study was used with 7 professionals and 4 users who were previously involved in the first stage of the development of the app. MARS, uMARS and SUS scales were used, and two focus groups were conducted. Descriptive statistical analysis and a thematic content analysis were performed in order to gather as much information as possible on RegulEm's usability and quality as well as suggestions for improvement.</p><p><strong>Results: </strong>RegulEm's usability was perceived through the SUS scale scores as good by users (75 points) and excellent by professionals (84.64 points), while its quality was perceived through the uMARS and MARS scales as good by both groups, with 4 and 4.14 points out of 5. Different areas regarding RegulEm's usability and suggestions for improvement were identified in both focus groups and 20% of the suggestions proposed were implemented in the refined version of RegulEm.</p><p><strong>Conclusion: </strong>RegulEm's usability and quality were perceived as good by users and professionals and different identified areas have contributed to its refinement. This study provides a more complete picture of RegulEm's usability and quality prior analysing its effectiveness, implementation and cost-effectiveness in Spanish public mental health units.</p>","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"24 1","pages":"267"},"PeriodicalIF":3.3,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11430202/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142342115","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Background: Invasive micropapillary carcinoma (IMPC) is a rare subtype of breast cancer. Its epidemiological features, treatment principles, and prognostic factors remain controversial.
Objective: This study aimed to develop an improved machine learning-based model to predict the prognosis of patients with invasive micropapillary carcinoma.
Methods: A total of 1123 patients diagnosed with IMPC after surgery between 1998 and 2019 were identified from the Surveillance, Epidemiology, and End Results (SEER) database for survival analysis. Univariate and multivariate analyses were performed to explore independent prognostic factors for the overall and disease-specific survival of patients with IMPC. Five machine learning algorithms were developed to predict the 5-year survival of these patients.
Results: Cox regression analysis indicated that patients aged > 65 years had a significantly worse prognosis than those younger in age, while unmarried patients had a better prognosis than married patients. Patients diagnosed between 2001 and 2005 had a significant risk reduction of mortality compared with other periods. The XGBoost model outperformed the other models with a precision of 0.818 and an area under the curve of 0.863.
Conclusions: A machine learning model for IMPC in patients with breast cancer was developed to estimate the 5-year OS. The XGBoost model had a promising performance and can help clinicians determine the early prognosis of patients with IMPC; therefore, the model can improve clinical outcomes by influencing management strategies and patient health care decisions.
{"title":"Predictive model of prognosis index for invasive micropapillary carcinoma of the breast based on machine learning: a SEER population-based study.","authors":"Zirong Jiang, Yushuai Yu, Xin Yu, Mingyao Huang, Qing Wang, Kaiyan Huang, Chuangui Song","doi":"10.1186/s12911-024-02669-y","DOIUrl":"https://doi.org/10.1186/s12911-024-02669-y","url":null,"abstract":"<p><strong>Background: </strong>Invasive micropapillary carcinoma (IMPC) is a rare subtype of breast cancer. Its epidemiological features, treatment principles, and prognostic factors remain controversial.</p><p><strong>Objective: </strong>This study aimed to develop an improved machine learning-based model to predict the prognosis of patients with invasive micropapillary carcinoma.</p><p><strong>Methods: </strong>A total of 1123 patients diagnosed with IMPC after surgery between 1998 and 2019 were identified from the Surveillance, Epidemiology, and End Results (SEER) database for survival analysis. Univariate and multivariate analyses were performed to explore independent prognostic factors for the overall and disease-specific survival of patients with IMPC. Five machine learning algorithms were developed to predict the 5-year survival of these patients.</p><p><strong>Results: </strong>Cox regression analysis indicated that patients aged > 65 years had a significantly worse prognosis than those younger in age, while unmarried patients had a better prognosis than married patients. Patients diagnosed between 2001 and 2005 had a significant risk reduction of mortality compared with other periods. The XGBoost model outperformed the other models with a precision of 0.818 and an area under the curve of 0.863.</p><p><strong>Conclusions: </strong>A machine learning model for IMPC in patients with breast cancer was developed to estimate the 5-year OS. The XGBoost model had a promising performance and can help clinicians determine the early prognosis of patients with IMPC; therefore, the model can improve clinical outcomes by influencing management strategies and patient health care decisions.</p>","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"24 1","pages":"268"},"PeriodicalIF":3.3,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11428430/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142342114","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-27DOI: 10.1186/s12911-024-02691-0
Alissa M Michel, Haeseung Yi, Jacquelyn Amenta, Nicole Collins, Anna Vaynrub, Subiksha Umakanth, Garnet Anderson, Katie Arnold, Cynthia Law, Sandhya Pruthi, Ana Sandoval-Leon, Rachel Shirley, Maria Grosse Perdekamp, Sarah Colonna, Stacy Krisher, Tari King, Lisa D Yee, Tarah J Ballinger, Christa Braun-Inglis, Debra A Mangino, Kari Wisinski, Claudia A DeYoung, Masey Ross, Justin Floyd, Andrea Kaster, Lindi VanderWalde, Thomas J Saphner, Corrine Zarwan, Shelly Lo, Cathy Graham, Alison Conlin, Kathleen Yost, Doreen Agnese, Cheryl Jernigan, Dawn L Hershman, Marian L Neuhouser, Banu Arun, Katherine D Crew, Rita Kukafka
Background: Women with high-risk breast lesions, such as atypical hyperplasia (AH) or lobular carcinoma in situ (LCIS), have a 4- to tenfold increased risk of breast cancer compared to women with non-proliferative breast disease. Despite high-quality data supporting chemoprevention, uptake remains low. Interventions are needed to break down barriers.
Methods: The parent trial, MiCHOICE, is a cluster randomized controlled trial evaluating the effectiveness and implementation of patient and provider decision support tools to improve informed choice about chemoprevention among women with AH or LCIS. For this pre-implementation analysis, 25 providers participated in semi-structured interviews prior to accessing decision support tools. Interviews sought to understand attitudes/beliefs and barriers/facilitators to chemoprevention.
Results: Interviews with 25 providers (18 physicians and 7 advanced practice providers) were included. Providers were predominantly female (84%), white (72%), and non-Hispanic (88%). Nearly all providers (96%) had prescribed chemoprevention for eligible patients. Three themes emerged in qualitative analysis. The first theme describes providers' confidence in chemoprevention and the utility of decision support tools. The second theme elucidates barriers to chemoprevention, including time constraints, risk communication and perceptions of patients' fear of side effects and anxiety. The third theme is the need for early implementation of decision support tools.
Conclusions: This qualitative study suggests that providers were interested in the early inclusion of decision aids (DA) in their chemoprevention discussion workflow. The DAs may help overcome certain barriers which were elucidated in these interviews, including patient level concerns about side effects, clinic time constraints and difficulty communicating risk. A multi-faceted intervention with a DA as one active component may be needed.
Trial registration: This trial was registered with the NIH clinical trial registry, clinicaltrials.gov, NCT04496739.
{"title":"Use of web-based decision support to improve informed choice for chemoprevention: a qualitative analysis of pre-implementation interviews (SWOG S1904).","authors":"Alissa M Michel, Haeseung Yi, Jacquelyn Amenta, Nicole Collins, Anna Vaynrub, Subiksha Umakanth, Garnet Anderson, Katie Arnold, Cynthia Law, Sandhya Pruthi, Ana Sandoval-Leon, Rachel Shirley, Maria Grosse Perdekamp, Sarah Colonna, Stacy Krisher, Tari King, Lisa D Yee, Tarah J Ballinger, Christa Braun-Inglis, Debra A Mangino, Kari Wisinski, Claudia A DeYoung, Masey Ross, Justin Floyd, Andrea Kaster, Lindi VanderWalde, Thomas J Saphner, Corrine Zarwan, Shelly Lo, Cathy Graham, Alison Conlin, Kathleen Yost, Doreen Agnese, Cheryl Jernigan, Dawn L Hershman, Marian L Neuhouser, Banu Arun, Katherine D Crew, Rita Kukafka","doi":"10.1186/s12911-024-02691-0","DOIUrl":"10.1186/s12911-024-02691-0","url":null,"abstract":"<p><strong>Background: </strong>Women with high-risk breast lesions, such as atypical hyperplasia (AH) or lobular carcinoma in situ (LCIS), have a 4- to tenfold increased risk of breast cancer compared to women with non-proliferative breast disease. Despite high-quality data supporting chemoprevention, uptake remains low. Interventions are needed to break down barriers.</p><p><strong>Methods: </strong>The parent trial, MiCHOICE, is a cluster randomized controlled trial evaluating the effectiveness and implementation of patient and provider decision support tools to improve informed choice about chemoprevention among women with AH or LCIS. For this pre-implementation analysis, 25 providers participated in semi-structured interviews prior to accessing decision support tools. Interviews sought to understand attitudes/beliefs and barriers/facilitators to chemoprevention.</p><p><strong>Results: </strong>Interviews with 25 providers (18 physicians and 7 advanced practice providers) were included. Providers were predominantly female (84%), white (72%), and non-Hispanic (88%). Nearly all providers (96%) had prescribed chemoprevention for eligible patients. Three themes emerged in qualitative analysis. The first theme describes providers' confidence in chemoprevention and the utility of decision support tools. The second theme elucidates barriers to chemoprevention, including time constraints, risk communication and perceptions of patients' fear of side effects and anxiety. The third theme is the need for early implementation of decision support tools.</p><p><strong>Conclusions: </strong>This qualitative study suggests that providers were interested in the early inclusion of decision aids (DA) in their chemoprevention discussion workflow. The DAs may help overcome certain barriers which were elucidated in these interviews, including patient level concerns about side effects, clinic time constraints and difficulty communicating risk. A multi-faceted intervention with a DA as one active component may be needed.</p><p><strong>Trial registration: </strong>This trial was registered with the NIH clinical trial registry, clinicaltrials.gov, NCT04496739.</p>","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"24 1","pages":"272"},"PeriodicalIF":3.3,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11430334/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142342121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-27DOI: 10.1186/s12911-024-02685-y
Md Sohanur Rahman, Khandaker Reajul Islam, Johayra Prithula, Jaya Kumar, Mufti Mahmud, Mohammed Fasihul Alam, Mamun Bin Ibne Reaz, Abdulrahman Alqahtani, Muhammad E H Chowdhury
{"title":"Correction: Machine learning-based prognostic model for 30-day mortality prediction in Sepsis-3.","authors":"Md Sohanur Rahman, Khandaker Reajul Islam, Johayra Prithula, Jaya Kumar, Mufti Mahmud, Mohammed Fasihul Alam, Mamun Bin Ibne Reaz, Abdulrahman Alqahtani, Muhammad E H Chowdhury","doi":"10.1186/s12911-024-02685-y","DOIUrl":"https://doi.org/10.1186/s12911-024-02685-y","url":null,"abstract":"","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"24 1","pages":"264"},"PeriodicalIF":3.3,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11429882/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142342108","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-19DOI: 10.1186/s12911-024-02659-0
Amelia Hochreiter-Hufford, Jennifer Gatz, Amy M Griggs, Ryan D Schoch, Kimberly M Birmingham, Christopher Frederick, John Price, Scott Snyder
Background: Recognizing the limitations of pre-market clinical data, regulatory authorities have embraced total product lifecycle management with post-market surveillance (PMS) data to assess medical device safety and performance. One method of proactive PMS involves the analysis of real-world data (RWD) through retrospective review of electronic health records (EHR). Because EHRs are patient-centered and focused on providing tools that clinicians use to determine care rather than collecting information on individual medical products, the process of transforming RWD into real-world evidence (RWE) can be laborious, particularly for medical devices with broad clinical use and extended clinical follow-up. This study describes a method to extract RWD from EHR to generate RWE on the safety and performance of embolization coils.
Methods: Through a partnership between a non-profit data institute and a medical device manufacturer, information on implantable embolization coils' use was extracted, linked, and analyzed from clinical data housed in an electronic data warehouse from the state of Indiana's largest health system. To evaluate the performance and safety of the embolization coils, technical success and safety were defined as per the Society of Interventional Radiology guidelines. A multi-prong strategy including electronic and manual review of unstructured (clinical chart notes) and structured data (International Classification of Disease codes), was developed to identify patients with relevant devices and extract data related to the endpoints.
Results: A total of 323 patients were identified as treated using Cook Medical Tornado, Nester, or MReye embolization coils between 1 January 2014 and 31 December 2018. Available clinical follow-up for these patients was 1127 ± 719 days. Indications for use, adverse events, and procedural success rates were identified via automated extraction of structured data along with review of available unstructured data. The overall technical success rate was 96.7%, and the safety events rate was 5.3% with 18 major adverse events in 17 patients. The calculated technical success and safety rates met pre-established performance goals (≥ 85% for technical success and ≤ 12% for safety), highlighting the relevance of this surveillance method.
Conclusions: Generating RWE from RWD requires careful planning and execution. The process described herein provided valuable longitudinal data for PMS of real-world device safety and performance. This cost-effective approach can be translated to other medical devices and similar RWD database systems.
{"title":"Real-world data to support post-market safety and performance of embolization coils: evidence generation from a medical device manufacturer and data institute partnership.","authors":"Amelia Hochreiter-Hufford, Jennifer Gatz, Amy M Griggs, Ryan D Schoch, Kimberly M Birmingham, Christopher Frederick, John Price, Scott Snyder","doi":"10.1186/s12911-024-02659-0","DOIUrl":"https://doi.org/10.1186/s12911-024-02659-0","url":null,"abstract":"<p><strong>Background: </strong>Recognizing the limitations of pre-market clinical data, regulatory authorities have embraced total product lifecycle management with post-market surveillance (PMS) data to assess medical device safety and performance. One method of proactive PMS involves the analysis of real-world data (RWD) through retrospective review of electronic health records (EHR). Because EHRs are patient-centered and focused on providing tools that clinicians use to determine care rather than collecting information on individual medical products, the process of transforming RWD into real-world evidence (RWE) can be laborious, particularly for medical devices with broad clinical use and extended clinical follow-up. This study describes a method to extract RWD from EHR to generate RWE on the safety and performance of embolization coils.</p><p><strong>Methods: </strong>Through a partnership between a non-profit data institute and a medical device manufacturer, information on implantable embolization coils' use was extracted, linked, and analyzed from clinical data housed in an electronic data warehouse from the state of Indiana's largest health system. To evaluate the performance and safety of the embolization coils, technical success and safety were defined as per the Society of Interventional Radiology guidelines. A multi-prong strategy including electronic and manual review of unstructured (clinical chart notes) and structured data (International Classification of Disease codes), was developed to identify patients with relevant devices and extract data related to the endpoints.</p><p><strong>Results: </strong>A total of 323 patients were identified as treated using Cook Medical Tornado, Nester, or MReye embolization coils between 1 January 2014 and 31 December 2018. Available clinical follow-up for these patients was 1127 ± 719 days. Indications for use, adverse events, and procedural success rates were identified via automated extraction of structured data along with review of available unstructured data. The overall technical success rate was 96.7%, and the safety events rate was 5.3% with 18 major adverse events in 17 patients. The calculated technical success and safety rates met pre-established performance goals (≥ 85% for technical success and ≤ 12% for safety), highlighting the relevance of this surveillance method.</p><p><strong>Conclusions: </strong>Generating RWE from RWD requires careful planning and execution. The process described herein provided valuable longitudinal data for PMS of real-world device safety and performance. This cost-effective approach can be translated to other medical devices and similar RWD database systems.</p>","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"24 1","pages":"263"},"PeriodicalIF":3.3,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11414114/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142280559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-17DOI: 10.1186/s12911-024-02662-5
Hong-Jun Yoon, Hilda B. Klasky, Andrew E. Blanchard, J. Blair Christian, Eric B. Durbin, Xiao-Cheng Wu, Antoinette Stroup, Jennifer Doherty, Linda Coyle, Lynne Penberthy, Georgia D. Tourassi
Applying graph convolutional networks (GCN) to the classification of free-form natural language texts leveraged by graph-of-words features (TextGCN) was studied and confirmed to be an effective means of describing complex natural language texts. However, the text classification models based on the TextGCN possess weaknesses in terms of memory consumption and model dissemination and distribution. In this paper, we present a fast message passing network (FastMPN), implementing a GCN with message passing architecture that provides versatility and flexibility by allowing trainable node embedding and edge weights, helping the GCN model find the better solution. We applied the FastMPN model to the task of clinical information extraction from cancer pathology reports, extracting the following six properties: main site, subsite, laterality, histology, behavior, and grade. We evaluated the clinical task performance of the FastMPN models in terms of micro- and macro-averaged F1 scores. A comparison was performed with the multi-task convolutional neural network (MT-CNN) model. Results show that the FastMPN model is equivalent to or better than the MT-CNN. Our implementation revealed that our FastMPN model, which is based on the PyTorch platform, can train a large corpus (667,290 training samples) with 202,373 unique words in less than 3 minutes per epoch using one NVIDIA V100 hardware accelerator. Our experiments demonstrated that using this implementation, the clinical task performance scores of information extraction related to tumors from cancer pathology reports were highly competitive.
{"title":"Development of message passing-based graph convolutional networks for classifying cancer pathology reports","authors":"Hong-Jun Yoon, Hilda B. Klasky, Andrew E. Blanchard, J. Blair Christian, Eric B. Durbin, Xiao-Cheng Wu, Antoinette Stroup, Jennifer Doherty, Linda Coyle, Lynne Penberthy, Georgia D. Tourassi","doi":"10.1186/s12911-024-02662-5","DOIUrl":"https://doi.org/10.1186/s12911-024-02662-5","url":null,"abstract":"Applying graph convolutional networks (GCN) to the classification of free-form natural language texts leveraged by graph-of-words features (TextGCN) was studied and confirmed to be an effective means of describing complex natural language texts. However, the text classification models based on the TextGCN possess weaknesses in terms of memory consumption and model dissemination and distribution. In this paper, we present a fast message passing network (FastMPN), implementing a GCN with message passing architecture that provides versatility and flexibility by allowing trainable node embedding and edge weights, helping the GCN model find the better solution. We applied the FastMPN model to the task of clinical information extraction from cancer pathology reports, extracting the following six properties: main site, subsite, laterality, histology, behavior, and grade. We evaluated the clinical task performance of the FastMPN models in terms of micro- and macro-averaged F1 scores. A comparison was performed with the multi-task convolutional neural network (MT-CNN) model. Results show that the FastMPN model is equivalent to or better than the MT-CNN. Our implementation revealed that our FastMPN model, which is based on the PyTorch platform, can train a large corpus (667,290 training samples) with 202,373 unique words in less than 3 minutes per epoch using one NVIDIA V100 hardware accelerator. Our experiments demonstrated that using this implementation, the clinical task performance scores of information extraction related to tumors from cancer pathology reports were highly competitive.","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"45 1","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142265770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Predicting mortality and relapse in children with acute lymphoblastic leukemia (ALL) is crucial for effective treatment and follow-up management. ALL is a common and deadly childhood cancer that often relapses after remission. In this study, we aimed to apply and evaluate machine learning-based models for predicting mortality and relapse in pediatric ALL patients. This retrospective cohort study was conducted on 161 children aged less than 16 years with ALL. Survival status (dead/alive) and patient experience of relapse (yes/no) were considered as the outcome variables. Ten machine learning (ML) algorithms were used to predict mortality and relapse. The performance of the algorithms was evaluated by cross-validation and reported as mean sensitivity, specificity, accuracy and area under the curve (AUC). Finally, prognostic factors were identified based on the best algorithms. The mean accuracy of the ML algorithms for prediction of patient mortality ranged from 64 to 74% and for prediction of relapse, it varied from 64 to 84% on test data sets. The mean AUC of the ML algorithms for mortality and relapse was above 64%. The most important prognostic factors for predicting both mortality and relapse were identified as age at diagnosis, hemoglobin and platelets. In addition, significant prognostic factors for predicting mortality included clinical side effects such as splenomegaly, hepatomegaly and lymphadenopathy. Our results showed that artificial neural networks and bagging algorithms outperformed other algorithms in predicting mortality, while boosting and random forest algorithms excelled in predicting relapse in ALL patients across all criteria. These results offer significant clinical insights into the prognostic factors for children with ALL, which can inform treatment decisions and improve patient outcomes.
{"title":"Machine learning-based evaluation of prognostic factors for mortality and relapse in patients with acute lymphoblastic leukemia: a comparative simulation study","authors":"Zahra Mehrbakhsh, Roghayyeh Hassanzadeh, Nasser Behnampour, Leili Tapak, Ziba Zarrin, Salman Khazaei, Irina Dinu","doi":"10.1186/s12911-024-02645-6","DOIUrl":"https://doi.org/10.1186/s12911-024-02645-6","url":null,"abstract":"Predicting mortality and relapse in children with acute lymphoblastic leukemia (ALL) is crucial for effective treatment and follow-up management. ALL is a common and deadly childhood cancer that often relapses after remission. In this study, we aimed to apply and evaluate machine learning-based models for predicting mortality and relapse in pediatric ALL patients. This retrospective cohort study was conducted on 161 children aged less than 16 years with ALL. Survival status (dead/alive) and patient experience of relapse (yes/no) were considered as the outcome variables. Ten machine learning (ML) algorithms were used to predict mortality and relapse. The performance of the algorithms was evaluated by cross-validation and reported as mean sensitivity, specificity, accuracy and area under the curve (AUC). Finally, prognostic factors were identified based on the best algorithms. The mean accuracy of the ML algorithms for prediction of patient mortality ranged from 64 to 74% and for prediction of relapse, it varied from 64 to 84% on test data sets. The mean AUC of the ML algorithms for mortality and relapse was above 64%. The most important prognostic factors for predicting both mortality and relapse were identified as age at diagnosis, hemoglobin and platelets. In addition, significant prognostic factors for predicting mortality included clinical side effects such as splenomegaly, hepatomegaly and lymphadenopathy. Our results showed that artificial neural networks and bagging algorithms outperformed other algorithms in predicting mortality, while boosting and random forest algorithms excelled in predicting relapse in ALL patients across all criteria. These results offer significant clinical insights into the prognostic factors for children with ALL, which can inform treatment decisions and improve patient outcomes.","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"3 1","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142265771","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-16DOI: 10.1186/s12911-024-02638-5
Chuanjia Yao, Rong Jiang, Bin Wu, Pinghui Li, Chenguang Wang
Graded diagnosis and treatment, referral, and expert consultations between medical institutions all require cross domain access to patient medical information to support doctors’ treatment decisions, leading to an increase in cross domain access among various medical institutions within the medical consortium. However, patient medical information is sensitive and private, and it is essential to control doctors’ cross domain access to reduce the risk of leakage. Access control is a continuous and long-term process, and it first requires verification of the legitimacy of user identities, while utilizing control policies for selection and management. After verifying user identity and access permissions, it is also necessary to monitor unauthorized operations. Therefore, the content of access control includes authentication, implementation of control policies, and security auditing. Unlike the existing focus on authentication and control strategy implementation in access control, this article focuses on the control based on access log security auditing for doctors who have obtained authorization to access medical resources. This paper designs a blockchain based doctor intelligent cross domain access log recording system, which is used to record, query and analyze the cross domain access behavior of doctors after authorization. Through DBSCAN clustering analysis of doctors’ cross domain access logs, we find the abnormal phenomenon of cross domain access, and build a penalty function to dynamically control doctors’ cross domain access process, so as to reduce the risk of Data breach. Finally, through comparative analysis and experiments, it is shown that the proposed cross domain access control model for medical consortia based on DBSCAN and penalty function has good control effect on the cross domain access behavior of doctors in various medical institutions of the medical consortia, and has certain feasibility for the cross domain access control of doctors.
{"title":"A cross domain access control model for medical consortium based on DBSCAN and penalty function","authors":"Chuanjia Yao, Rong Jiang, Bin Wu, Pinghui Li, Chenguang Wang","doi":"10.1186/s12911-024-02638-5","DOIUrl":"https://doi.org/10.1186/s12911-024-02638-5","url":null,"abstract":"Graded diagnosis and treatment, referral, and expert consultations between medical institutions all require cross domain access to patient medical information to support doctors’ treatment decisions, leading to an increase in cross domain access among various medical institutions within the medical consortium. However, patient medical information is sensitive and private, and it is essential to control doctors’ cross domain access to reduce the risk of leakage. Access control is a continuous and long-term process, and it first requires verification of the legitimacy of user identities, while utilizing control policies for selection and management. After verifying user identity and access permissions, it is also necessary to monitor unauthorized operations. Therefore, the content of access control includes authentication, implementation of control policies, and security auditing. Unlike the existing focus on authentication and control strategy implementation in access control, this article focuses on the control based on access log security auditing for doctors who have obtained authorization to access medical resources. This paper designs a blockchain based doctor intelligent cross domain access log recording system, which is used to record, query and analyze the cross domain access behavior of doctors after authorization. Through DBSCAN clustering analysis of doctors’ cross domain access logs, we find the abnormal phenomenon of cross domain access, and build a penalty function to dynamically control doctors’ cross domain access process, so as to reduce the risk of Data breach. Finally, through comparative analysis and experiments, it is shown that the proposed cross domain access control model for medical consortia based on DBSCAN and penalty function has good control effect on the cross domain access behavior of doctors in various medical institutions of the medical consortia, and has certain feasibility for the cross domain access control of doctors.","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"32 1","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142265772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-16DOI: 10.1186/s12911-024-02671-4
Jingying Huang, Jin Yang, Haiou Qi, Xin Xu, Yiting Zhu, Miaomiao Xu, Yuting Wang
Elderly patients undergoing recovery from general anesthesia face a heightened risk of critical respiratory events (CREs). Despite this, there is a notable absence of effective predictive tools tailored to this specific demographic. This study aims to develop and validate a predictive model (nomogram) to address this gap. CREs pose significant risks to elderly patients during the recovery phase from general anesthesia, making it an important issue in perioperative care. With the increasing aging population and the complexity of surgical procedures, it is crucial to develop effective predictive tools to improve patient outcomes and ensure patient safety during post-anesthesia care unit (PACU) recovery. A total of 324 elderly patients who underwent elective general anesthesia in a grade A tertiary hospital from January 2023 to June 2023 were enrolled. Risk factors were identified using least absolute shrinkage and selection operator (LASSO) regression. A multivariate logistic regression model was constructed and represented as a nomogram. Internal validation of the model was performed using Bootstrapping. This study followed the TRIPOD checklist for reporting. The indicators included in the nomogram were frailty, snoring, patient-controlled intravenous analgesia (PCIA), emergency delirium and cough intensity at extubation. The diagnostic performance of the nomogram model was satisfactory, with AUC values of 0.990 and 0.981 for the training set and internal validation set, respectively. The optimal cutoff value was determined to be 0.22, based on a Youden index of 0.911. The F1-score was 0.927, and the MCC was 0.896. The calibration curve, Brier score (0.046), and HL test demonstrated acceptable consistency between the predicted and actual results. DCA revealed high net benefits of the nomogram prediction across all threshold probabilities. This study developed and validated a nomogram to identify elderly patients in the PACU who are at higher risk of CREs. The identified predictive factors included frailty condition, snoring syndrome, PCIA, emergency delirium, and cough intensity at extubation. By identifying patients at higher risk of CREs early on, medical professionals can implement targeted strategies to mitigate the occurrence of complications and provide better postoperative care for elderly patients recovering from general anesthesia.
{"title":"Development and validation of a nomogram for predicting critical respiratory events during early anesthesia recovery in elderly patients","authors":"Jingying Huang, Jin Yang, Haiou Qi, Xin Xu, Yiting Zhu, Miaomiao Xu, Yuting Wang","doi":"10.1186/s12911-024-02671-4","DOIUrl":"https://doi.org/10.1186/s12911-024-02671-4","url":null,"abstract":"Elderly patients undergoing recovery from general anesthesia face a heightened risk of critical respiratory events (CREs). Despite this, there is a notable absence of effective predictive tools tailored to this specific demographic. This study aims to develop and validate a predictive model (nomogram) to address this gap. CREs pose significant risks to elderly patients during the recovery phase from general anesthesia, making it an important issue in perioperative care. With the increasing aging population and the complexity of surgical procedures, it is crucial to develop effective predictive tools to improve patient outcomes and ensure patient safety during post-anesthesia care unit (PACU) recovery. A total of 324 elderly patients who underwent elective general anesthesia in a grade A tertiary hospital from January 2023 to June 2023 were enrolled. Risk factors were identified using least absolute shrinkage and selection operator (LASSO) regression. A multivariate logistic regression model was constructed and represented as a nomogram. Internal validation of the model was performed using Bootstrapping. This study followed the TRIPOD checklist for reporting. The indicators included in the nomogram were frailty, snoring, patient-controlled intravenous analgesia (PCIA), emergency delirium and cough intensity at extubation. The diagnostic performance of the nomogram model was satisfactory, with AUC values of 0.990 and 0.981 for the training set and internal validation set, respectively. The optimal cutoff value was determined to be 0.22, based on a Youden index of 0.911. The F1-score was 0.927, and the MCC was 0.896. The calibration curve, Brier score (0.046), and HL test demonstrated acceptable consistency between the predicted and actual results. DCA revealed high net benefits of the nomogram prediction across all threshold probabilities. This study developed and validated a nomogram to identify elderly patients in the PACU who are at higher risk of CREs. The identified predictive factors included frailty condition, snoring syndrome, PCIA, emergency delirium, and cough intensity at extubation. By identifying patients at higher risk of CREs early on, medical professionals can implement targeted strategies to mitigate the occurrence of complications and provide better postoperative care for elderly patients recovering from general anesthesia.","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"19 1","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142265932","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The European health data space promises an efficient environment for research and policy-making. However, this data space is dependent on high data quality. The implementation of electronic medical record systems has a positive impact on data quality, but improvements are not consistent across empirical studies. This study aims to analyze differences in the changes of data quality and to discuss these against distinct stages of the electronic medical record’s adoption process. Paper-based and electronic medical records from three surgical departments were compared, assessing changes in data quality after the implementation of an electronic medical record system. Data quality was operationalized as completeness of documentation. Ten information that must be documented in both record types (e.g. vital signs) were coded as 1 if they were documented, otherwise as 0. Chi-Square-Tests were used to compare percentage completeness of these ten information and t-tests to compare mean completeness per record type. A total of N = 659 records were analyzed. Overall, the average completeness improved in the electronic medical record, with a change from 6.02 (SD = 1.88) to 7.2 (SD = 1.77). At the information level, eight information improved, one deteriorated and one remained unchanged. At the level of departments, changes in data quality show expected differences. The study provides evidence that improvements in data quality could depend on the process how the electronic medical record is adopted in the affected department. Research is needed to further improve data quality through implementing new electronical medical record systems or updating existing ones.
欧洲卫生数据空间为研究和决策提供了一个高效的环境。然而,这一数据空间依赖于较高的数据质量。电子病历系统的实施对数据质量产生了积极影响,但各实证研究的改进并不一致。本研究旨在分析数据质量变化的差异,并根据电子病历采用过程的不同阶段进行讨论。研究比较了三个外科部门的纸质病历和电子病历,评估了实施电子病历系统后数据质量的变化。数据质量的可操作性是文档的完整性。两种记录类型都必须记录的十项信息(如生命体征),如果记录了,则编码为 1,否则编码为 0。我们使用 Chi-Square 检验比较这十项信息的完整性百分比,使用 t 检验比较每种记录类型的平均完整性。共分析了 N = 659 条记录。总体而言,电子病历的平均完整性有所提高,从 6.02(标度 = 1.88)提高到 7.2(标度 = 1.77)。在信息层面,8 项信息有所改善,1 项恶化,1 项保持不变。在部门层面,数据质量的变化显示出预期的差异。这项研究提供的证据表明,数据质量的改善可能取决于受影响科室采用电子病历的过程。需要开展研究,通过实施新的电子病历系统或更新现有系统来进一步提高数据质量。
{"title":"Differences in changes of data completeness after the implementation of an electronic medical record in three surgical departments of a German hospital–a longitudinal comparative document analysis","authors":"Florian Wurster, Christin Herrmann, Marina Beckmann, Natalia Cecon-Stabel, Kerstin Dittmer, Till Hansen, Julia Jaschke, Juliane Köberlein-Neu, Mi-Ran Okumu, Holger Pfaff, Carsten Rusniok, Ute Karbach","doi":"10.1186/s12911-024-02667-0","DOIUrl":"https://doi.org/10.1186/s12911-024-02667-0","url":null,"abstract":"The European health data space promises an efficient environment for research and policy-making. However, this data space is dependent on high data quality. The implementation of electronic medical record systems has a positive impact on data quality, but improvements are not consistent across empirical studies. This study aims to analyze differences in the changes of data quality and to discuss these against distinct stages of the electronic medical record’s adoption process. Paper-based and electronic medical records from three surgical departments were compared, assessing changes in data quality after the implementation of an electronic medical record system. Data quality was operationalized as completeness of documentation. Ten information that must be documented in both record types (e.g. vital signs) were coded as 1 if they were documented, otherwise as 0. Chi-Square-Tests were used to compare percentage completeness of these ten information and t-tests to compare mean completeness per record type. A total of N = 659 records were analyzed. Overall, the average completeness improved in the electronic medical record, with a change from 6.02 (SD = 1.88) to 7.2 (SD = 1.77). At the information level, eight information improved, one deteriorated and one remained unchanged. At the level of departments, changes in data quality show expected differences. The study provides evidence that improvements in data quality could depend on the process how the electronic medical record is adopted in the affected department. Research is needed to further improve data quality through implementing new electronical medical record systems or updating existing ones.","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"50 1","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142265931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}