JAMIA Open最新文献

Objectives: To provide a real-world example on how and to what extent Health Level Seven Fast Healthcare Interoperability Resources (FHIR) implements the Findable, Accessible, Interoperable, and Reusable (FAIR) guiding principles for scientific data. Additionally, presents a list of FAIR implementation choices for supporting future FAIR implementations that use FHIR.

Materials and methods: A case study was conducted on the Medical Information Mart for Intensive Care-IV Emergency Department (MIMIC-ED) dataset, a deidentified clinical dataset converted into FHIR. The FAIRness of this dataset was assessed using a set of common FAIR assessment indicators.

Results: The FHIR distribution of MIMIC-ED, comprising an implementation guide and demo data, was more FAIR compared to the non-FHIR distribution. The FAIRness score increased from 60 to 82 out of 95 points, a relative improvement of 37%. The most notable improvements were observed in interoperability, with a score increase from 5 to 19 out of 19 points, and reusability, with a score increase from 8 to 14 out of 24 points. A total of 14 FAIR implementation choices were identified.

Discussion: Our work examined how and to what extent the FHIR standard contributes to FAIR data. Challenges arose from interpreting the FAIR assessment indicators. This study stands out for providing a real-world example of a dataset that was made more FAIR using FHIR.

Conclusion: To the best of our knowledge, this is the first study that formally assessed the conformance of a FHIR dataset to the FAIR principles. FHIR improved the accessibility, interoperability, and reusability of MIMIC-ED. Future research should focus on implementing FHIR in research data infrastructures.

Objectives: Since the 1970s, a plethora of tools have been introduced to support the medication use process. However, automation initiatives to assist pharmacists in prospectively reviewing medication orders are lacking. The review of many medications may be protocolized and implemented in an algorithmic fashion utilizing discrete data from the electronic health record (EHR). This research serves as a proof of concept to evaluate the capability and effectiveness of an electronic prospective medication order review (EPMOR) system compared to pharmacists' review.

Materials and methods: A subset of the most frequently verified medication orders were identified for inclusion. A team of clinical pharmacist experts developed best-practice EPMOR criteria. The established criteria were incorporated into conditional logic built within the EHR. Verification outcomes from the pharmacist (human) and EPMOR (automation) were compared.

Results: Overall, 13 404 medication orders were included. Of those orders, 13 133 passed pharmacist review, 7388 of which passed EPMOR. A total of 271 medication orders failed pharmacist review due to order modification or discontinuation, 105 of which passed EPMOR. Of the 105 orders, 19 were duplicate orders correctly caught by both EPMOR and pharmacists, but the opposite duplicate order was rejected, 51 orders failed due to scheduling changes.

Discussion: This simulation was capable of effectively discriminating and triaging orders. Protocolization and automation of the prospective medication order review process in the EHR appear possible using clinically driven algorithms.

Conclusion: Further research is necessary to refine such algorithms to maximize value, improve efficiency, and minimize safety risks in preparation for the implementation of fully automated systems.

Purpose: To link compliant, universal Digital Imaging and Communications in Medicine (DICOM) ophthalmic imaging data at the individual patient level with the American Academy of Ophthalmology IRIS^® Registry (Intelligent Research in Sight).

Design: A retrospective study using de-identified EHR registry data.

Subjects participants controls: IRIS Registry records.

Materials and methods: DICOM files of several imaging modalities were acquired from two large retina ophthalmology practices. Metadata tags were extracted and harmonized to facilitate linkage to the IRIS Registry using a proprietary, heuristic patient-matching algorithm, adhering to HITRUST guidelines. Linked patients and images were assessed by image type and clinical diagnosis. Reasons for failed linkage were assessed by examining patients' records.

Main outcome measures: Success rate of linking clinicoimaging and EHR data at the patient level.

Results: A total of 2 287 839 DICOM files from 54 896 unique patients were available. Of these, 1 937 864 images from 46 196 unique patients were successfully linked to existing patients in the registry. After removing records with abnormal patient names and invalid birthdates, the success linkage rate was 93.3% for images. 88.2% of all patients at the participating practices were linked to at least one image.

Conclusions and relevance: Using identifiers from DICOM metadata, we created an automated pipeline to connect longitudinal real-world clinical data comprehensively and accurately to various imaging modalities from multiple manufacturers at the patient and visit levels. The process has produced an enriched and multimodal IRIS Registry, bridging the gap between basic research and clinical care by enabling future applications in artificial intelligence algorithmic development requiring large linked clinicoimaging datasets.

Objectives: Early discontinuation is common among breast cancer patients taking aromatase inhibitors (AIs). Although several predictors have been identified, it is unclear how to simultaneously consider multiple risk factors for an individual. We sought to develop a tool for prediction of AI discontinuation and to explore how predictive value of risk factors changes with time.

Materials and methods: Survival machine learning was used to predict time-to-discontinuation of AIs in 181 women who enrolled in a prospective cohort. Models were evaluated via time-dependent area under the curve (AUC), c-index, and integrated Brier score. Feature importance was analysis was conducted via Shapley Additive Explanations (SHAP) and time-dependence of their predictive value was analyzed by time-dependent AUC. Personalized survival curves were constructed for risk communication.

Results: The best-performing model incorporated genetic risk factors and changes in patient-reported outcomes, achieving mean time-dependent AUC of 0.66, and AUC of 0.72 and 0.67 at 6- and 12-month cutoffs, respectively. The most significant features included variants in ESR1 and emergent symptoms. Predictive value of genetic risk factors was highest in the first year of treatment. Decrease in physical function was the strongest independent predictor at follow-up.

Discussion and conclusion: Incorporation of genomic and 3-month follow-up data improved the ability of the models to identify the individuals at risk of AI discontinuation. Genetic risk factors were particularly important for predicting early discontinuers. This study provides insight into the complex nature of AI discontinuation and highlights the importance of incorporating genetic risk factors and emergent symptoms into prediction models.

Objectives: To design a novel artificial intelligence-based software platform that allows users to analyze text data by identifying various coherent topics and parts of the data related to a specific research theme-of-interest (TOI).

Materials and methods: Our platform uses state-of-the-art unsupervised natural language processing methods, building on top of a large language model, to analyze social media text data. At the center of the platform's functionality is BERTopic, which clusters social media posts, forming collections of words representing distinct topics. A key feature of our platform is its ability to identify whole sentences corresponding to topic words, vastly improving the platform's ability to perform downstream similarity operations with respect to a user-defined TOI.

Results: Two case studies on mental health among university students are performed to demonstrate the utility of the platform, focusing on signals within social media (Reddit) data related to depression and their connection to various emergent themes within the data.

Discussion and conclusion: Our platform provides researchers with a readily available and inexpensive tool to parse large quantities of unstructured, noisy data into coherent themes, as well as identifying portions of the data related to the research TOI. While the development process for the platform was focused on mental health themes, we believe it to be generalizable to other domains of research as well.

Objective: Existing research on social determinants of health (SDoH) predominantly focuses on physician notes and structured data within electronic medical records. This study posits that social work notes are an untapped, potentially rich source for SDoH information. We hypothesize that clinical notes recorded by social workers, whose role is to ameliorate social and economic factors, might provide a complementary information source of data on SDoH compared to physician notes, which primarily concentrate on medical diagnoses and treatments. We aimed to use word frequency analysis and topic modeling to identify prevalent terms and robust topics of discussion within a large cohort of social work notes including both outpatient and in-patient consultations.

Materials and methods: We retrieved a diverse, deidentified corpus of 0.95 million clinical social work notes from 181 644 patients at the University of California, San Francisco. We conducted word frequency analysis related to ICD-10 chapters to identify prevalent terms within the notes. We then applied Latent Dirichlet Allocation (LDA) topic modeling analysis to characterize this corpus and identify potential topics of discussion, which was further stratified by note types and disease groups.

Results: Word frequency analysis primarily identified medical-related terms associated with specific ICD10 chapters, though it also detected some subtle SDoH terms. In contrast, the LDA topic modeling analysis extracted 11 topics explicitly related to social determinants of health risk factors, such as financial status, abuse history, social support, risk of death, and mental health. The topic modeling approach effectively demonstrated variations between different types of social work notes and across patients with different types of diseases or conditions.

Discussion: Our findings highlight LDA topic modeling's effectiveness in extracting SDoH-related themes and capturing variations in social work notes, demonstrating its potential for informing targeted interventions for at-risk populations.

Conclusion: Social work notes offer a wealth of unique and valuable information on an individual's SDoH. These notes present consistent and meaningful topics of discussion that can be effectively analyzed and utilized to improve patient care and inform targeted interventions for at-risk populations.

Objective: To assess the impact of potential errors in natural language processing (NLP) on the results of epidemiologic studies.

Materials and methods: We utilized data from three outcomes research studies where the primary predictor variable was generated using NLP. For each of these studies, Monte Carlo simulations were applied to generate datasets simulating potential errors in NLP-derived variables. We subsequently fit the original regression models to these partially simulated datasets and compared the distribution of coefficient estimates to the original study results.

Results: Among the four models evaluated, the mean change in the point estimate of the relationship between the predictor variable and the outcome ranged from -21.9% to 4.12%. In three of the four models, significance of this relationship was not eliminated in a single of the 500 simulations, and in one model it was eliminated in 12% of simulations. Mean changes in the estimates for confounder variables ranged from 0.27% to 2.27% and significance of the relationship was eliminated between 0% and 9.25% of the time. No variables underwent a shift in the direction of its interpretation.

Discussion: Impact of simulated NLP errors on the results of epidemiologic studies was modest, with only small changes in effect estimates and no changes in the interpretation of the findings (direction and significance of association with the outcome) for either the NLP-generated variables or other variables in the models.

Conclusion: NLP errors are unlikely to affect the results of studies that use NLP as the source of data.

Objectives: imPROVE is a new Health Information Technology platform that enables systematic patient-reported outcome measure (PROM) collection through a mobile phone application. The purpose of this study is to describe our initial experience and approach to implementing imPROVE among breast cancer patients treated in breast and plastic surgery clinics.

Materials and methods: We describe our initial implementation in 4 phases between June 2021 and February 2022: preimplementation, followed by 3 consecutive implementation periods (P1, P2, P3). The Standards for Reporting Implementation Studies statement guided this study. Iterative Plan-Do-Study-Act (PDSA) cycles supported implementation, and success was evaluated using the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework.

Results: Qualitative interviews conducted during the preimplementation phase elicited 4 perceived implementation barriers. Further feedback collected during each phase of implementation resulted in the development of brochures, posters in clinic spaces, and scripts for clinic staff to streamline discussions with patients, and the resolution of technical issues concerning patient login capabilities, such as compatibility with cell phone software and barriers to downloading imPROVE. Feedback also generated ideas for facilitating provider interpretation of PROM results. By the end of P3, 2961 patients were eligible, 1375 (46.4%) downloaded imPROVE, and 1070 (36.1% of those eligible, 78% of those who downloaded) completed at least 1 PROM.

Discussion and conclusion: Implementation efforts across 2 surgical departments at 2 academic teaching hospitals enabled collaboration across clinical specialties and longitudinal PROM reporting for patients receiving breast cancer care; the implementation effort also highlighted patient difficulties with mobile app-based PROM collection, particularly around initial engagement.