Despite the outstanding performance of deep learning models in clinical prediction tasks, explainability remains a significant challenge. Inspired by transformer architectures, we introduce the Temporal-Feature Cross Attention Mechanism (TFCAM), a novel deep learning framework designed to capture dynamic interactions among clinical features across time, enhancing both predictive accuracy and interpretability. In an experiment with 1,422 patients with Chronic Kidney Disease, predicting progression to End-Stage Renal Disease, TFCAM outperformed LSTM and RE-TAIN baselines, achieving an AUROC of 0.95 and an F1-score of 0.69. Beyond performance gains, TFCAM provides multi-level explainability by identifying critical temporal periods, ranking feature importance, and quantifying how features influence each other across time before affecting predictions. Our approach addresses the "black box" limitations of deep learning in healthcare, offering clinicians transparent insights into disease progression mechanisms while maintaining state-of-the-art predictive performance.
{"title":"No Black Box Anymore: Demystifying Clinical Predictive Modeling with Temporal-Feature Cross Attention Mechanism.","authors":"Yubo Li, Xinyu Yao, Rema Padman","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Despite the outstanding performance of deep learning models in clinical prediction tasks, explainability remains a significant challenge. Inspired by transformer architectures, we introduce the Temporal-Feature Cross Attention Mechanism (TFCAM), a novel deep learning framework designed to capture dynamic interactions among clinical features across time, enhancing both predictive accuracy and interpretability. In an experiment with 1,422 patients with Chronic Kidney Disease, predicting progression to End-Stage Renal Disease, TFCAM outperformed LSTM and RE-TAIN baselines, achieving an AUROC of 0.95 and an F1-score of 0.69. Beyond performance gains, TFCAM provides multi-level explainability by identifying critical temporal periods, ranking feature importance, and quantifying how features influence each other across time before affecting predictions. Our approach addresses the \"black box\" limitations of deep learning in healthcare, offering clinicians transparent insights into disease progression mechanisms while maintaining state-of-the-art predictive performance.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"764-773"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919459/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Halley Ruppel, Amina Khan, Rose Mintor, Jessica Nguyen, Meghan McNamara, Brooke Luo, Michelle Kelly, Kenrick Cato, Elizabeth B Froh
This modified explanatory sequential mixed methods study sought to inform redesign of nursing notes in the electronic health record. In the context of OpenNotes and patient and family access to nursing notes via the inpatient portal, redesigning nursing notes offers an opportunity to enhance family-centered care delivery and reduce nurses' documentation burden. We analyzed data on note views via the inpatient portal for 258,841 nursing notes; annotated the contents of 100 nursing notes; and conducted interviews with 18 families and 8 nurses. Our findings support recommendations for more specific care plans, eliminating redundancies, and emphasizing nursing care and expertise otherwise absent from the patient chart. The results of this descriptive study lay the groundwork for pilot testing new nursing note structures.
{"title":"Re-designing inpatient nursing notes shared with families: an opportunity to enhance family-centered care delivery.","authors":"Halley Ruppel, Amina Khan, Rose Mintor, Jessica Nguyen, Meghan McNamara, Brooke Luo, Michelle Kelly, Kenrick Cato, Elizabeth B Froh","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>This modified explanatory sequential mixed methods study sought to inform redesign of nursing notes in the electronic health record. In the context of OpenNotes and patient and family access to nursing notes via the inpatient portal, redesigning nursing notes offers an opportunity to enhance family-centered care delivery and reduce nurses' documentation burden. We analyzed data on note views via the inpatient portal for 258,841 nursing notes; annotated the contents of 100 nursing notes; and conducted interviews with 18 families and 8 nurses. Our findings support recommendations for more specific care plans, eliminating redundancies, and emphasizing nursing care and expertise otherwise absent from the patient chart. The results of this descriptive study lay the groundwork for pilot testing new nursing note structures.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"1249-1257"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919541/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273148","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The rapid growth of unstructured clinical text in electronic health records necessitates robust information extraction systems, yet their development is hindered by the scarcity of high-quality annotated data. This study explores the potential of large language models to generate synthetic data for clinical named entity recognition and examines its impact on model performance. We propose a novel framework that integrates self-verified synthetic data generation with domain-specific semantic mapping using SNOMED-CT. By leveraging GPT-4o-mini for synthetic data creation and refining its quality through iterative verification and anomaly detection, we systematically evaluate the influence of synthetic data quality and quantity on fine-tuning LLaMA-3-8B. Experimental results across four datasets (MTSamples, UTP, MIMIC-III, and i2b2) demonstrate that self-verification and semantic mapping significantly enhance synthetic data utility, improving model generalizability. Our findings highlight the importance of balancing human-annotated and synthetic data, with a 1:1 ratio emerging as the optimal configuration for performance gains. This study advances clinical NLP by providing a scalable approach to mitigating annotation challenges while improving model performance.
{"title":"Facilitating Clinical Information Extraction with Synthetic Data and Ontology using Large Language Models.","authors":"Yan Hu, Huan He, Qingyu Chen, Xiaoqian Jiang, Kirk Roberts, Hua Xu","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The rapid growth of unstructured clinical text in electronic health records necessitates robust information extraction systems, yet their development is hindered by the scarcity of high-quality annotated data. This study explores the potential of large language models to generate synthetic data for clinical named entity recognition and examines its impact on model performance. We propose a novel framework that integrates self-verified synthetic data generation with domain-specific semantic mapping using SNOMED-CT. By leveraging GPT-4o-mini for synthetic data creation and refining its quality through iterative verification and anomaly detection, we systematically evaluate the influence of synthetic data quality and quantity on fine-tuning LLaMA-3-8B. Experimental results across four datasets (MTSamples, UTP, MIMIC-III, and i2b2) demonstrate that self-verification and semantic mapping significantly enhance synthetic data utility, improving model generalizability. Our findings highlight the importance of balancing human-annotated and synthetic data, with a 1:1 ratio emerging as the optimal configuration for performance gains. This study advances clinical NLP by providing a scalable approach to mitigating annotation challenges while improving model performance.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"500-505"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919538/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273139","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Avisha Das, Amara Tariq, Felipe Batalini, Boddhisattwa Dhara, Imon Banerjee
Training Large Language Models (LLMs) with billions of parameters on a dataset and publishing the model for public access is the current standard practice. Despite their transformative impact on natural language processing (NLP), public LLMs present notable vulnerabilities given the source of training data is often web-based or crowdsourced, and hence can be manipulated by perpetrators. We delve into the vulnerabilities of clinical LLMs, particularly BioGPT which is trained on publicly available biomedical literature and clinical notes from MIMIC-III, in the realm of data poisoning attacks. Exploring susceptibility to data poisoning-based attacks on de-identified breast cancer clinical notes, our approach is the first one to assess the extent of such attacks and our findings reveal successful manipulation of LLM outputs. Through this work, we emphasize on the urgency of comprehending these vulnerabilities in LLMs, and encourage the mindful and responsible usage of LLMs in the clinical domain.
{"title":"Exposing Vulnerabilities in Clinical LLMs Through Data Poisoning Attacks: Case Study in Breast Cancer.","authors":"Avisha Das, Amara Tariq, Felipe Batalini, Boddhisattwa Dhara, Imon Banerjee","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Training Large Language Models (LLMs) with billions of parameters on a dataset and publishing the model for public access is the current standard practice. Despite their transformative impact on natural language processing (NLP), public LLMs present notable vulnerabilities given the source of training data is often web-based or crowdsourced, and hence can be manipulated by perpetrators. We delve into the vulnerabilities of clinical LLMs, particularly BioGPT which is trained on publicly available biomedical literature and clinical notes from MIMIC-III, in the realm of data poisoning attacks. Exploring susceptibility to data poisoning-based attacks on de-identified breast cancer clinical notes, our approach is the first one to assess the extent of such attacks and our findings reveal successful manipulation of LLM outputs. Through this work, we emphasize on the urgency of comprehending these vulnerabilities in LLMs, and encourage the mindful and responsible usage of LLMs in the clinical domain.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"339-348"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12099371/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144144642","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Timothy C Shuey, Tyler J Schubert, Katrina Romagnoli, Dylan Cawley, Laney K Jones, Samuel S Gidding, Marc S Williams
Evidence-based clinical guidelines serve to support clinical decision making, but implementing such guidelines into practice remains a challenge. Familial hypercholesterolemia (FH) is a high impact clinical condition that exemplifies this disconnect. Using implementation science methods, we designed clinical decision support tools embedded into the electronic health record, including a FH-focused electronic health record Smart Set and clinic note template, to improve the care of adult and pediatric patients at high-risk of FH. End-user feedback gathered through direct observations, semi-structured interviews, and deliberative engagement sessions was used to inform the development of the tools before and after pilot-testing. Clinicians desired comprehensive, guidelines-based tools that promoted collaborative care. During pilot testing, end-users provided insights into technical issues encountered with the tool's first iteration and suggested regular check-in sessions to monitor issues moving forward. This methodology can be used to surmount challenges that prevent the uptake of evidence-based guidelines into practice.
{"title":"Translating Evidence-Based Guidelines Into Clinical Decision Support Tools to Improve Identification and Management of Familial Hypercholesterolemia.","authors":"Timothy C Shuey, Tyler J Schubert, Katrina Romagnoli, Dylan Cawley, Laney K Jones, Samuel S Gidding, Marc S Williams","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Evidence-based clinical guidelines serve to support clinical decision making, but implementing such guidelines into practice remains a challenge. Familial hypercholesterolemia (FH) is a high impact clinical condition that exemplifies this disconnect. Using implementation science methods, we designed clinical decision support tools embedded into the electronic health record, including a FH-focused electronic health record Smart Set and clinic note template, to improve the care of adult and pediatric patients at high-risk of FH. End-user feedback gathered through direct observations, semi-structured interviews, and deliberative engagement sessions was used to inform the development of the tools before and after pilot-testing. Clinicians desired comprehensive, guidelines-based tools that promoted collaborative care. During pilot testing, end-users provided insights into technical issues encountered with the tool's first iteration and suggested regular check-in sessions to monitor issues moving forward. This methodology can be used to surmount challenges that prevent the uptake of evidence-based guidelines into practice.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"1030-1039"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12099389/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144144758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Robert H Dolin, Waddah Arafat, Bret S E Heale, Edna Shenvi, Srikar Chamala
Introduction: Clinical trials play a crucial role in precision cancer care. Patients generally learn of trials from their physician, and physician recognition of potential matches can be enhanced through decision support tools. But automated trial matching remains challenging, particularly for molecular eligibility criteria. Objective: We assessed the feasibility of FHIR Genomics plus CQL to enable trial matching, particularly for molecular criteria. Methods: We developed a prototype that included (1) encoded trial criteria in CQL; (2) synthetic patient clinical and genomic data; (3) trial eligibility computation. Results: We found that even complex molecular eligibility criteria can be represented in CQL given that the semantics of a criterion are formalized in base FHIR specifications. The proof of concept "CQL for Clinical Trials Matching" is available at [https://elimu.io/downloads/]. Discussion and Conclusions: Proof of concept work suggests FHIR and CQL as viable options for enhancing clinical trial matching.
{"title":"Molecularly-Guided Cancer Clinical Trial Matching using FHIR and HL7 Clinical Quality Language: A Proof of Concept.","authors":"Robert H Dolin, Waddah Arafat, Bret S E Heale, Edna Shenvi, Srikar Chamala","doi":"","DOIUrl":"","url":null,"abstract":"<p><p><b>Introduction</b>: Clinical trials play a crucial role in precision cancer care. Patients generally learn of trials from their physician, and physician recognition of potential matches can be enhanced through decision support tools. But automated trial matching remains challenging, particularly for molecular eligibility criteria. <b>Objective</b>: We assessed the feasibility of FHIR Genomics plus CQL to enable trial matching, particularly for molecular criteria. <b>Methods</b>: We developed a prototype that included (1) encoded trial criteria in CQL; (2) synthetic patient clinical and genomic data; (3) trial eligibility computation. <b>Results</b>: We found that even complex molecular eligibility criteria can be represented in CQL given that the semantics of a criterion are formalized in base FHIR specifications. The proof of concept \"CQL for Clinical Trials Matching\" is available at [https://elimu.io/downloads/]. <b>Discussion and Conclusions</b>: Proof of concept work suggests FHIR and CQL as viable options for enhancing clinical trial matching.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"359-367"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12099354/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144144633","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Health Related Social Needs (HRSN) is an important driver of patient health outcomes. Healthcare organizations address patient HRSN with screening and community resource referral fulfillment (S&RF) processes for which they lack patient retention data, due to information silos. The process is complex and not fully represented in available conceptual models nor adequately assessed for effectiveness. The objective was to develop an evidence-based HRSN S&RF complex model and identify patient retention parameters. Model development drew from the literature and expert input to create a complex S&RF model, and identify parameters for model stages and factors. Studies (50) involved manual S&RF processes in small, specialized populations. The model organized 88 factors among five S&RF stages. Half the studies reported parameters, for which stage and factor ranges were wide and indicated reduced patient retention along the process. Needed is data from routine care in which HRSN platforms are used, and information silos overcome.
{"title":"Health Related Social Needs Screening and Referral Fulfillment: Toward a Complex Model.","authors":"Paulina Sockolow","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Health Related Social Needs (HRSN) is an important driver of patient health outcomes. Healthcare organizations address patient HRSN with screening and community resource referral fulfillment (S&RF) processes for which they lack patient retention data, due to information silos. The process is complex and not fully represented in available conceptual models nor adequately assessed for effectiveness. The objective was to develop an evidence-based HRSN S&RF complex model and identify patient retention parameters. Model development drew from the literature and expert input to create a complex S&RF model, and identify parameters for model stages and factors. Studies (50) involved manual S&RF processes in small, specialized populations. The model organized 88 factors among five S&RF stages. Half the studies reported parameters, for which stage and factor ranges were wide and indicated reduced patient retention along the process. Needed is data from routine care in which HRSN platforms are used, and information silos overcome.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"1040-1049"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12099334/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144144650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In the classroom, artificial intelligence techniques help automate student behavior analysis, and teachers are able to understand students' class status more effectively. We developed an intelligent method for classroom behavior analysis by building a CQStu datasets and annotating 6,687 images through active learning. OpenPose was used to detect the key points of the student's body, and the key points of the key parts of the body were utilized to generate representative points of the student, and the idea of coordinates was used to assign the student's position. Using YOLOV5 to recognize students' classroom behaviors and count the number of times, our experimental results show that the average classroom behavior recognition accuracy is 84.23%, and the overall location accuracy is about 79.6%. In addition, we introduced a nonlinear weighting factor to evaluate the effectiveness of teaching and constructed corresponding classroom behavior weights based on different classroom scenarios. A method for student classroom behavior identification and analysis is provided, and a framework for future intelligent classroom teaching evaluation methods is established, providing objective data support for student performance analysis.
{"title":"Student Behavior Analysis using YOLOv5 and OpenPose in Smart Classroom Environment.","authors":"Xiang Li, Yucheng Ji, Jiayi Yang, Mingyong Li","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>In the classroom, artificial intelligence techniques help automate student behavior analysis, and teachers are able to understand students' class status more effectively. We developed an intelligent method for classroom behavior analysis by building a CQStu datasets and annotating 6,687 images through active learning. OpenPose was used to detect the key points of the student's body, and the key points of the key parts of the body were utilized to generate representative points of the student, and the idea of coordinates was used to assign the student's position. Using YOLOV5 to recognize students' classroom behaviors and count the number of times, our experimental results show that the average classroom behavior recognition accuracy is 84.23%, and the overall location accuracy is about 79.6%. In addition, we introduced a nonlinear weighting factor to evaluate the effectiveness of teaching and constructed corresponding classroom behavior weights based on different classroom scenarios. A method for student classroom behavior identification and analysis is provided, and a framework for future intelligent classroom teaching evaluation methods is established, providing objective data support for student performance analysis.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"674-683"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12099366/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144144807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Introduction: In the evolving field of health informatics, the American Medical Informatics Association (AMIA) highlights the need for professionals skilled in current research. Journal clubs bridge academic learning with practical application, addressing challenges like limited literature review time and fostering critical analysis. Aim: This study evaluates the impact of an interdisciplinary journal club on 33 Master's students in Health and Bioinformatics program at Grand Valley State University. Thirteen students participated, analyzing contemporary literature and applying findings to real-world problems. Results: Significant improvements were observed in key capstone assessments among journal club participants: Capstone Overall Percentage (mean difference 15.23 points, p < 0.05), Project Proposal (mean difference 13.62 points, p < 0.05), and Research Topic Presentations (mean difference 27.30 points, p < 0.05). Conclusion: These findings support integrating journal clubs into curricula to enhance evidence-based practice, interdisciplinary collaboration, and practical application of knowledge, aligning with AMIA's vision of continuous professional development.
{"title":"Journal Club Engagement and Its Impact on Capstone Performance: A Study in a Health and Bioinformatics Master's Program.","authors":"Suhila Sawesi, Mohamed Rashrash, Guenter Tusch","doi":"","DOIUrl":"","url":null,"abstract":"<p><p><b>Introduction:</b> In the evolving field of health informatics, the American Medical Informatics Association (AMIA) highlights the need for professionals skilled in current research. Journal clubs bridge academic learning with practical application, addressing challenges like limited literature review time and fostering critical analysis. <b>Aim:</b> This study evaluates the impact of an interdisciplinary journal club on 33 Master's students in Health and Bioinformatics program at Grand Valley State University. Thirteen students participated, analyzing contemporary literature and applying findings to real-world problems. <b>Results:</b> Significant improvements were observed in key capstone assessments among journal club participants: Capstone Overall Percentage (mean difference 15.23 points, p < 0.05), Project Proposal (mean difference 13.62 points, p < 0.05), and Research Topic Presentations (mean difference 27.30 points, p < 0.05). <b>Conclusion:</b> These findings support integrating journal clubs into curricula to enhance evidence-based practice, interdisciplinary collaboration, and practical application of knowledge, aligning with AMIA's vision of continuous professional development.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"987-996"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12099391/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144144431","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fateme Nateghi Haredasht, Manoj V Maddali, Stephen P Ma, Amy Chang, Grace Y E Kim, Niaz Banaei, Stanley Deresinski, Mary K Goldstein, Steven M Asch, Jonathan H Chen
Antibiotics have been crucial in advancing medical treatments, but the growing threat of antibiotic resistance challenges these achievements and emphasizes the need for innovative stewardship strategies. In this study, we developed machine learning models, 'personalized antibiograms', to predict antibiotic resistance across five key antibiotics using Stanford's electronic health record data of 49,872 urine, blood, and respiratory infections. We aimed to ascertain the efficacy of these models in predicting antibiotic susceptibility and identify the clinical factors most indicative of resistance. Employing LightGBM, we incorporated demographics, prior resistance, prescriptions, and comorbidities as features. The models demonstrated notable discriminative ability, with AUROCs between 0.74 and 0.78, and highlighted prior resistance and prescriptions as significant predictive factors. The high specificity demonstrates machine learning models' potential to inform antibiotic de-escalation, aiding stewardship without risking safety. By leveraging machine learning with relevant clinical features, we show that it is feasible to improve empirical antibiotic prescribing.
{"title":"Enhancing Antibiotic Stewardship: A Machine Learning Approach to Predicting Antibiotic Resistance in Inpatient Care.","authors":"Fateme Nateghi Haredasht, Manoj V Maddali, Stephen P Ma, Amy Chang, Grace Y E Kim, Niaz Banaei, Stanley Deresinski, Mary K Goldstein, Steven M Asch, Jonathan H Chen","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Antibiotics have been crucial in advancing medical treatments, but the growing threat of antibiotic resistance challenges these achievements and emphasizes the need for innovative stewardship strategies. In this study, we developed machine learning models, 'personalized antibiograms', to predict antibiotic resistance across five key antibiotics using Stanford's electronic health record data of 49,872 urine, blood, and respiratory infections. We aimed to ascertain the efficacy of these models in predicting antibiotic susceptibility and identify the clinical factors most indicative of resistance. Employing LightGBM, we incorporated demographics, prior resistance, prescriptions, and comorbidities as features. The models demonstrated notable discriminative ability, with AUROCs between 0.74 and 0.78, and highlighted prior resistance and prescriptions as significant predictive factors. The high specificity demonstrates machine learning models' potential to inform antibiotic de-escalation, aiding stewardship without risking safety. By leveraging machine learning with relevant clinical features, we show that it is feasible to improve empirical antibiotic prescribing.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"857-864"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12099390/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144144583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}