JAMIA Open最新文献

Objective: To describe a user-centered approach to develop, pilot test, and refine requirements for 3 electronic health record (EHR)-integrated interventions that target key diagnostic process failures in hospitalized patients.

Materials and methods: Three interventions were prioritized for development: a Diagnostic Safety Column (DSC) within an EHR-integrated dashboard to identify at-risk patients; a Diagnostic Time-Out (DTO) for clinicians to reassess the working diagnosis; and a Patient Diagnosis Questionnaire (PDQ) to gather patient concerns about the diagnostic process. Initial requirements were refined from analysis of test cases with elevated risk predicted by DSC logic compared to risk perceived by a clinician working group; DTO testing sessions with clinicians; PDQ responses from patients; and focus groups with clinicians and patient advisors using storyboarding to model the integrated interventions. Mixed methods analysis of participant responses was used to identify final requirements and potential implementation barriers.

Results: Final requirements from analysis of 10 test cases predicted by the DSC, 18 clinician DTO participants, and 39 PDQ responses included the following: DSC configurable parameters (variables, weights) to adjust baseline risk estimates in real-time based on new clinical data collected during hospitalization; more concise DTO wording and flexibility for clinicians to conduct the DTO with or without the patient present; and integration of PDQ responses into the DSC to ensure closed-looped communication with clinicians. Analysis of focus groups confirmed that tight integration of the interventions with the EHR would be necessary to prompt clinicians to reconsider the working diagnosis in cases with elevated diagnostic error (DE) risk or uncertainty. Potential implementation barriers included alert fatigue and distrust of the risk algorithm (DSC); time constraints, redundancies, and concerns about disclosing uncertainty to patients (DTO); and patient disagreement with the care team's diagnosis (PDQ).

Discussion: A user-centered approach led to evolution of requirements for 3 interventions targeting key diagnostic process failures in hospitalized patients at risk for DE.

Conclusions: We identify challenges and offer lessons from our user-centered design process.

With the burgeoning development of computational phenotypes, it is increasingly difficult to identify the right phenotype for the right tasks. This study uses a mixed-methods approach to develop and evaluate a novel metadata framework for retrieval of and reusing computational phenotypes. Twenty active phenotyping researchers from 2 large research networks, Electronic Medical Records and Genomics and Observational Health Data Sciences and Informatics, were recruited to suggest metadata elements. Once consensus was reached on 39 metadata elements, 47 new researchers were surveyed to evaluate the utility of the metadata framework. The survey consisted of 5-Likert multiple-choice questions and open-ended questions. Two more researchers were asked to use the metadata framework to annotate 8 type-2 diabetes mellitus phenotypes. More than 90% of the survey respondents rated metadata elements regarding phenotype definition and validation methods and metrics positively with a score of 4 or 5. Both researchers completed annotation of each phenotype within 60 min. Our thematic analysis of the narrative feedback indicates that the metadata framework was effective in capturing rich and explicit descriptions and enabling the search for phenotypes, compliance with data standards, and comprehensive validation metrics. Current limitations were its complexity for data collection and the entailed human costs.

Objective: To assess whether an individual's degree of psychological resilience can be determined from physiological metrics passively collected from a wearable device.

Materials and methods: Data were analyzed in this secondary analysis of the Warrior Watch Study dataset, a prospective cohort of healthcare workers enrolled across 7 hospitals in New York City. Subjects wore an Apple Watch for the duration of their participation. Surveys were collected measuring resilience, optimism, and emotional support at baseline.

Results: We evaluated data from 329 subjects (mean age 37.4 years, 37.1% male). Across all testing sets, gradient-boosting machines (GBM) and extreme gradient-boosting models performed best for high- versus low-resilience prediction, stratified on a median Connor-Davidson Resilience Scale-2 score of 6 (interquartile range = 5-7), with an AUC of 0.60. When predicting resilience as a continuous variable, multivariate linear models had a correlation of 0.24 (P = .029) and RMSE of 1.37 in the testing data. A positive psychological construct, comprised of resilience, optimism, and emotional support was also evaluated. The oblique random forest method performed best in estimating high- versus low-composite scores stratified on a median of 32.5, with an AUC of 0.65, a sensitivity of 0.60, and a specificity of 0.70.

Discussion: In a post hoc analysis, machine learning models applied to physiological metrics collected from wearable devices had some predictive ability in identifying resilience states and a positive psychological construct.

Conclusions: These findings support the further assessment of psychological characteristics from passively collected wearable data in dedicated studies.

Objective: To enable interactive visualization of phenome-wide association studies (PheWAS) on electronic health records (EHR).

Materials and methods: Current PheWAS technologies require familiarity with command-line interfaces and lack end-to-end data visualizations. pyPheWAS Explorer allows users to examine group variables, test assumptions, design PheWAS models, and evaluate results in a streamlined graphical interface.

Results: A cohort of attention deficit hyperactivity disorder (ADHD) subjects and matched non-ADHD controls is examined. pyPheWAS Explorer is used to build a PheWAS model including sex and deprivation index as covariates, and the Explorer's result visualization for this model reveals known ADHD comorbidities.

Discussion: pyPheWAS Explorer may be used to rapidly investigate potentially novel EHR associations. Broader applications include deployment for clinical experts and preliminary exploration tools for institutional EHR repositories.

Conclusion: pyPheWAS Explorer provides a seamless graphical interface for designing, executing, and analyzing PheWAS experiments, emphasizing exploratory analysis of regression types and covariate selection.

Coronavirus disease (COVID)-related misinformation is prevalent online, including on social media. The purpose of this study was to explore factors associated with user engagement with COVID-related misinformation on the social media platform, TikTok. A sample of TikTok videos associated with the hashtag #coronavirus was downloaded on September 20, 2020. Misinformation was evaluated on a scale (low, medium, and high) using a codebook developed by experts in infectious diseases. Multivariable modeling was used to evaluate factors associated with number of views and presence of user comments indicating intention to change behavior. One hundred and sixty-six TikTok videos were identified and reviewed. Moderate misinformation was present in 36 (22%) videos viewed a median of 6.8 million times (interquartile range [IQR] 3.6-16 million), and high-level misinformation was present in 11 (7%) videos viewed a median of 9.4 million times (IQR 5.1-18 million). After controlling for characteristics and content, videos containing moderate misinformation were less likely to generate a user response indicating intended behavior change. By contrast, videos containing high-level misinformation were less likely to be viewed but demonstrated a nonsignificant trend towards higher engagement among viewers. COVID-related misinformation is less frequently viewed on TikTok but more likely to engage viewers. Public health authorities can combat misinformation on social media by posting informative content of their own.

Objective: Automatically identifying patients at risk of immune checkpoint inhibitor (ICI)-induced colitis allows physicians to improve patientcare. However, predictive models require training data curated from electronic health records (EHR). Our objective is to automatically identify notes documenting ICI-colitis cases to accelerate data curation.

Materials and methods: We present a data pipeline to automatically identify ICI-colitis from EHR notes, accelerating chart review. The pipeline relies on BERT, a state-of-the-art natural language processing (NLP) model. The first stage of the pipeline segments long notes using keywords identified through a logistic classifier and applies BERT to identify ICI-colitis notes. The next stage uses a second BERT model tuned to identify false positive notes and remove notes that were likely positive for mentioning colitis as a side-effect. The final stage further accelerates curation by highlighting the colitis-relevant portions of notes. Specifically, we use BERT's attention scores to find high-density regions describing colitis.

Results: The overall pipeline identified colitis notes with 84% precision and reduced the curator note review load by 75%. The segment BERT classifier had a high recall of 0.98, which is crucial to identify the low incidence (<10%) of colitis.

Discussion: Curation from EHR notes is a burdensome task, especially when the curation topic is complicated. Methods described in this work are not only useful for ICI colitis but can also be adapted for other domains.

Conclusion: Our extraction pipeline reduces manual note review load and makes EHR data more accessible for research.

Background: Problem-oriented documentation is an accepted method of note construction which facilitates clinical thought processes. However, problem-oriented documentation is challenging to put into practice using commercially available electronic health record (EHR) systems.

Objective: Our goal was to create, iterate, and distribute a problem-oriented documentation toolkit within a commercial EHR that maximally supported clinicians' thinking, was intuitive to use, and produced clear documentation.

Materials and methods: We used an iterative design process that stressed visual simplicity, data integration, a predictable interface, data reuse, and clinician efficiency. Creation of the problem-oriented documentation toolkit required the use of EHR-provided tools and custom programming.

Results: We developed a problem-oriented documentation interface with a 3-column view showing (1) a list of visit diagnoses, (2) the current overview and assessment and plan for a selected diagnosis, and (3) a list of medications, labs, data, and orders relevant to that diagnosis. We also created a series of macros to bring information collected through the interface into clinicians' notes. This toolkit was put into a live environment in February 2019. Over the first 9 months, the custom problem-oriented documentation toolkit was used in a total of 8385 discrete visits by 28 clinicians in 13 ambulatory departments. After 9 months, the go-live education and EHR optimization teams in our health system began promoting the toolkit to new and existing users of our EHR resulting in a significantly increased uptake by outpatient clinicians. In April 2022 alone, the toolkit was used in more than 92 000 ambulatory visits by 894 users in 271 departments across our health system.

Conclusions: As a health-system client of a commercial EHR, we developed and deployed a revised problem-oriented documentation toolkit that is used by clinicians more than 92 000 times a month. Key success elements include an emphasis on usability and an effective training effort.

Objectives: Post-acute sequalae of SARS-CoV-2 infection (PASC) is not well defined in pediatrics given its heterogeneity of presentation and severity in this population. The aim of this study is to use novel methods that rely on data mining approaches rather than clinical experience to detect conditions and symptoms associated with pediatric PASC.

Materials and methods: We used a propensity-matched cohort design comparing children identified using the new PASC ICD10CM diagnosis code (U09.9) (N = 1309) to children with (N = 6545) and without (N = 6545) SARS-CoV-2 infection. We used a tree-based scan statistic to identify potential condition clusters co-occurring more frequently in cases than controls.

Results: We found significant enrichment among children with PASC in cardiac, respiratory, neurologic, psychological, endocrine, gastrointestinal, and musculoskeletal systems, the most significant related to circulatory and respiratory such as dyspnea, difficulty breathing, and fatigue and malaise.

Discussion: Our study addresses methodological limitations of prior studies that rely on prespecified clusters of potential PASC-associated diagnoses driven by clinician experience. Future studies are needed to identify patterns of diagnoses and their associations to derive clinical phenotypes.

Conclusion: We identified multiple conditions and body systems associated with pediatric PASC. Because we rely on a data-driven approach, several new or under-reported conditions and symptoms were detected that warrant further investigation.

[This corrects the article DOI: 10.1093/jamiaopen/ooac113.].

Objective: This study aimed to understand how a metaverse-based (virtual) workspace can be used to support the communication and collaboration in an academic health informatics lab.

Materials and methods: A survey of lab members (n = 14) was analyzed according to a concurrent triangulation mixed methods design. The qualitative survey data were organized according to the Capability, Opportunity, Motivation, Behavior (COM-B) model and combined to generate personas that represent the overall types of lab members. Additionally, scheduled work hours were analyzed quantitatively to complement the findings of the survey feedback.

Results: Four personas, representative of different types of virtual workers, were developed using the survey responses. These personas reflected the wide variety of opinions about virtual work among the participants and helped to categorize the most common feedback. The Work Hours Schedule Sheet analysis showed the low number of possible collaboration opportunities that were utilized compared to the number available.

Discussion: We found that informal communication and co-location were not supported by the virtual workplace as we had originally planned. To solve this issue, we offer 3 design recommendations for those looking to implement their own virtual informatics lab. First, labs should establish common goals and norms for virtual workplace interactions. Second, labs should carefully plan the virtual space layout to maximize communication opportunities. Finally, labs should work with their platform of choice to address technical limitations for their lab members to improve user experience. Future work includes a formal, theory-guided experiment with consideration on ethical and behavioral impact.