Methods of Information in Medicine最新文献

Objective: Data harmonization is essential to integrate individual participant data from multiple sites, time periods, and trials for meta-analysis. The process of mapping terms and phrases to an ontology is complicated by typographic errors, abbreviations, truncation, and plurality. We sought to harmonize medical history (MH) and adverse events (AE) term records across 21 randomized clinical trials in pulmonary arterial hypertension and chronic thromboembolic pulmonary hypertension.

Methods: We developed and applied a semi-automated harmonization pipeline for use with domain-expert annotators to resolve ambiguous term mappings using exact and fuzzy matching. We summarized MH and AE term mapping success, including map quality measures, and imputation of a generalizing term hierarchy as defined by the applied Medical Dictionary for Regulatory Activities (MedDRA) ontology standard.

Results: Over 99.6% of both MH (N = 37,105) and AE (N = 58,170) records were successfully mapped to MedDRA low-level terms. Automated exact matching accounted for 74.9% of MH and 85.5% of AE mappings. Term recommendations from fuzzy matching in the pipeline facilitated annotator mapping of the remaining 24.9% of MH and 13.8% of AE records. Imputation of the generalized MedDRA term hierarchy was unambiguous in 85.2% of high-level terms, 99.4% of high-level group terms, and 99.5% of system organ class in MH, and 75% of high-level terms, 98.3% of high-level group terms, and 98.4% of system organ class in AE.

Conclusion: This pipeline dramatically reduced the burden of manual annotation for MH and AE term harmonization and could be adapted to other data integration efforts.

Objectives: The aim of the study is to design an ontology model for the representation of assets and its features in distributed health care environments. Allow the interchange of information about these assets through the use of specific vocabularies based on the use of ontologies.

Methods: Ontologies are a formal way to represent knowledge by means of triples composed of a subject, a predicate, and an object. Given the sensitivity of network assets in health care institutions, this work by using an ontology-based representation of information complies with the FAIR principles. Federated queries to the ontology systems, allow users to obtain data from multiple sources (i.e., several hospitals belonging to the same public body). Therefore, this representation makes it possible for network administrators in health care institutions to have a clear understanding of possible threats that may emerge in the network.

Results: As a result of this work, the "Software Defined Networking Description Language-CUREX Asset Discovery Tool Ontology" (SDNDL-CAO) has been developed. This ontology uses the main concepts in network assets to represent the knowledge extracted from the distributed health care environments: interface, device, port, service, etc. CONCLUSION:  The developed SDNDL-CAO ontology allows to represent the aforementioned knowledge about the distributed health care environments. Network administrators of these institutions will benefit as they will be able to monitor emerging threats in real-time, something critical when managing personal medical information.

Objective: Developing an ontology can help collecting and sharing information in traditional medicine including Persian medicine in a well-defined format. The present study aimed to develop an ontology for gastric dystemperament in the Persian medicine.

Methods: This was a mixed-methods study conducted in 2019. The first stage was related to providing an ontology requirements specification document. In the second stage, important terms, concepts, and their relationships were identified via literature review and expert panels. Then, the results derived from the second stage were refined and validated using the Delphi method in three rounds. Finally, in the fourth stage, the ontology was evaluated in terms of consistency and coherence.

Results: In this study, 241 concepts related to different types of gastric dystemperament, diagnostic criteria, and treatments in the Persian medicine were identified through literature review and expert panels, and 12 new concepts were suggested during the Delphi study. In total, after performing three rounds of the Delphi study, 233 concepts were identified. Finally, an ontology was developed with 71 classes, and the results of the evaluation study revealed that the ontology was consistent and coherent.

Conclusion: In this study, an ontology was created for gastric dystemperament in the Persian medicine. This ontology can be used for designing future systems, such as case-based reasoning and expert systems. Moreover, the use of other evaluation methods is suggested to construct a more complete and precise ontology.

Background: AI-enabled Clinical Decision Support Systems (AI + CDSSs) were heralded to contribute greatly to the advancement of health care services. There is an increased availability of monetary funds and technical expertise invested in projects and proposals targeting the building and implementation of such systems. Therefore, understanding the actual system implementation status in clinical practice is imperative.

Objectives: The aim of the study is to understand (1) the current situation of AI + CDSSs clinical implementations in Chinese hospitals and (2) concerns regarding AI + CDSSs current and future implementations.

Methods: We investigated 160 tertiary hospitals from six provinces and province-level cities. Descriptive analysis, two-sided Fisher exact test, and Mann-Whitney U-test were utilized for analysis.

Results: Thirty-eight of the surveyed hospitals (23.75%) had implemented AI + CDSSs. There were statistical differences on grade, scales, and medical volume between the two groups of hospitals (implemented vs. not-implemented AI + CDSSs, p <0.05). On the 5-point Likert scale, 81.58% (31/38) of respondents rated their overall satisfaction with the systems as "just neutral" to "satisfied." The three most common concerns were system functions improvement and integration into the clinical process, data quality and availability, and methodological bias.

Conclusion: While AI + CDSSs were not yet widespread in Chinese clinical settings, professionals recognize the potential benefits and challenges regarding in-hospital AI + CDSSs.

Background: Through targeted medication alerts, clinical decision support systems (CDSS) help users to identify medication errors such as disregarded drug-drug interactions (DDIs). Override rates of such alerts are high; however, they can be mitigated by alert tailoring or workflow-interrupting display of severe alerts that need active user acceptance or overriding. Yet, the extent to which the displayed alert interferes with the prescribers' workflow showed inconclusive impact on alert acceptance.

Objectives: We aimed to assess whether and how often prescriptions were changed as a potential result of interruptive alerts on different (contraindicated) prescription constellations with particularly high risks for adverse drug events (ADEs).

Methods: We retrospectively collected data of all interruptive alerts issued between March 2016 and August 2020 in the local CDSS (AiDKlinik) at Heidelberg University Hospital. The alert battery consisted of 31 distinct alerts for contraindicated DDI with simvastatin, potentially inappropriate medication for patients > 65 years (PIM, N = 14 drugs and 36 drug combinations), and contraindicated drugs in hyperkalemia (N = 5) that could be accepted or overridden giving a reason in free-text form.

Results: In 935 prescribing sessions of 500 274 total sessions, at least one interruptive alert was fired. Of all interruptive alerts, about half of the sessions were evaluable whereof in total 57.5% (269 of 468 sessions) were accepted while 42.5% were overridden. The acceptance rate of interruptive alerts differed significantly depending on the alert type (p <0.0001), reaching 85.7% for DDI alerts (N = 185), 65.3% for contraindicated drugs in hyperkalemia (N = 98), and 25.1% for PIM alerts (N = 185).

Conclusion: A total of 57.5% of the interruptive medication alerts with particularly high risks for ADE in our setting were accepted while the acceptance rate differed according to the alert type with contraindicated simvastatin DDI alerts being accepted most frequently.

Background: In recent years, an increasing number of health chatbots has been published in app stores and described in research literature. Given the sensitive data they are processing and the care settings for which they are developed, evaluation is essential to avoid harm to users. However, evaluations of those systems are reported inconsistently and without using a standardized set of evaluation metrics. Missing standards in health chatbot evaluation prevent comparisons of systems, and this may hamper acceptability since their reliability is unclear.

Objectives: The objective of this paper is to make an important step toward developing a health-specific chatbot evaluation framework by finding consensus on relevant metrics.

Methods: We used an adapted Delphi study design to verify and select potential metrics that we retrieved initially from a scoping review. We invited researchers, health professionals, and health informaticians to score each metric for inclusion in the final evaluation framework, over three survey rounds. We distinguished metrics scored relevant with high, moderate, and low consensus. The initial set of metrics comprised 26 metrics (categorized as global metrics, metrics related to response generation, response understanding and aesthetics).

Results: Twenty-eight experts joined the first round and 22 (75%) persisted to the third round. Twenty-four metrics achieved high consensus and three metrics achieved moderate consensus. The core set for our framework comprises mainly global metrics (e.g., ease of use, security content accuracy), metrics related to response generation (e.g., appropriateness of responses), and related to response understanding. Metrics on aesthetics (font type and size, color) are less well agreed upon-only moderate or low consensus was achieved for those metrics.

Conclusion: The results indicate that experts largely agree on metrics and that the consensus set is broad. This implies that health chatbot evaluation must be multifaceted to ensure acceptability.