Background: Medical examinations contain repeatedly measured data from multiple visits, including imaging variables collected from different modalities. However, the utility of such data for the prediction of time-to-event is unknown, and only a fraction of the data is typically used for risk prediction. We hypothesized that multimodal longitudinal imaging data could improve dynamic disease prognosis of cardiovascular and renal disease (CVRD).
Methods: In a multi-centered cohort of 5,114 CARDIA participants, we included 166 longitudinal imaging variables from five imaging modalities: Echocardiography (Echo), Cardiac and Abdominal Computed Tomography (CT), Dual-Energy x-ray Absorptiometry (DEXA), Brain Magnetic Resonance Imaging (MRI) collected from young adulthood to mid-life over 30 years (1985-2016) to perform dynamic survival analysis of CVRD events using machine learning dynamic survival analysis (Dynamic-DeepHit, LTRCforest, and Extended Cox for Time-varying Covariates). Risk probabilities were continuously updated as new data were collected. Model performance was assessed using integrated AUC and C-index and compared to traditional risk factors.
Results: Longitudinal imaging data, even when being irregularly collected with high missing rates, improved CVRD dynamic prediction (0.03 in integrated AUC, up to 0.05 in C-index compared to traditional risk factors; best model's C-index = 0.80-0.83 up to 20 years from baseline) from young adulthood followed up to midlife. Among imaging variables, Echo and CT variables contributed significantly to improved risk estimation. Echo measured in early adulthood predicted midlife CVRD risks almost as well as Echo measured 10-15 years later (0.01 C-index difference). The most recent CT exam provided the most accurate prediction for short-term risk estimation. Brain MRI markers provided additional information from cardiac Echo and CT variables that led to a slightly improved prediction.
Conclusions: Longitudinal multimodal imaging data readily collected from follow-up exams can improve CVRD dynamic prediction. Echocardiography measured early can provide a good long-term risk estimation, while CT/calcium scoring variables carry atherosclerotic signatures that benefit more immediate risk assessment starting in middle-age.
At the dawn of of Artificial General Intelligence (AGI), the emergence of large language models such as ChatGPT show promise in revolutionizing healthcare by improving patient care, expanding medical access, and optimizing clinical processes. However, their integration into healthcare systems requires careful consideration of potential risks, such as inaccurate medical advice, patient privacy violations, the creation of falsified documents or images, overreliance on AGI in medical education, and the perpetuation of biases. It is crucial to implement proper oversight and regulation to address these risks, ensuring the safe and effective incorporation of AGI technologies into healthcare systems. By acknowledging and mitigating these challenges, AGI can be harnessed to enhance patient care, medical knowledge, and healthcare processes, ultimately benefiting society as a whole.
Relative cerebral blood volume (rCBV) derived from dynamic susceptibility contrast (DSC) perfusion MR imaging (pMRI) has been shown to be a robust marker of neuroradiological tumor burden. Recent consensus recommendations in pMRI acquisition strategies have provided a pathway for pMRI inclusion in diverse patient care centers, regardless of size or experience. However, even with proper implementation and execution of the DSC-MRI protocol, issues will arise that many centers may not easily recognize or be aware of. Furthermore, missed pMRI issues are not always apparent in the resulting rCBV images, potentiating inaccurate or missed radiological diagnoses. Therefore, we gathered from our database of DSC-MRI datasets, true-to-life examples showcasing the breakdowns in acquisition, postprocessing, and interpretation, along with appropriate mitigation strategies when possible. The pMRI issues addressed include those related to image acquisition and postprocessing with a focus on contrast agent administration, timing, and rate, signal-to-noise quality, and susceptibility artifact. The goal of this work is to provide guidance to minimize and recognize pMRI issues to ensure that only quality data is interpreted.
Introduction: Dual-energy CT (DECT) is a non-invasive way to determine the presence of monosodium urate (MSU) crystals in the workup of gout. Color-coding distinguishes MSU from calcium following material decomposition and post-processing. Manually identifying these foci (most commonly labeled green) is tedious, and an automated detection system could streamline the process. This study aims to evaluate the impact of a deep-learning (DL) algorithm developed for detecting green pixelations on DECT on reader time, accuracy, and confidence.
Methods: We collected a sample of positive and negative DECTs, reviewed twice-once with and once without the DL tool-with a 2-week washout period. An attending musculoskeletal radiologist and a fellow separately reviewed the cases, simulating clinical workflow. Metrics such as time taken, confidence in diagnosis, and the tool's helpfulness were recorded and statistically analyzed.
Results: We included thirty DECTs from different patients. The DL tool significantly reduced the reading time for the trainee radiologist (p = 0.02), but not for the attending radiologist (p = 0.15). Diagnostic confidence remained unchanged for both (p = 0.45). However, the DL model identified tiny MSU deposits that led to a change in diagnosis in two cases for the in-training radiologist and one case for the attending radiologist. In 3/3 of these cases, the diagnosis was correct when using DL.
Conclusions: The implementation of the developed DL model slightly reduced reading time for our less experienced reader and led to improved diagnostic accuracy. There was no statistically significant difference in diagnostic confidence when studies were interpreted without and with the DL model.
Image-to-text radiology report generation aims to automatically produce radiology reports that describe the findings in medical images. Most existing methods focus solely on the image data, disregarding the other patient information accessible to radiologists. In this paper, we present a novel multi-modal deep neural network framework for generating chest x-rays reports by integrating structured patient data, such as vital signs and symptoms, alongside unstructured clinical notes. We introduce a conditioned cross-multi-head attention module to fuse these heterogeneous data modalities, bridging the semantic gap between visual and textual data. Experiments demonstrate substantial improvements from using additional modalities compared to relying on images alone. Notably, our model achieves the highest reported performance on the ROUGE-L metric compared to relevant state-of-the-art models in the literature. Furthermore, we employed both human evaluation and clinical semantic similarity measurement alongside word-overlap metrics to improve the depth of quantitative analysis. A human evaluation, conducted by a board-certified radiologist, confirms the model's accuracy in identifying high-level findings, however, it also highlights that more improvement is needed to capture nuanced details and clinical context.
Rationale and objectives: Cerebral microdialysis is a technique that enables monitoring of the neurochemistry of patients with significant acquired brain injury, such as traumatic brain injury (TBI) and subarachnoid haemorrhage (SAH). Cerebral microdialysis can also be used to characterise the neuro-pharmacokinetics of small-molecule study substrates using retrodialysis/retromicrodialysis. However, challenges remain: (i) lack of a simple, stable, and inexpensive brain tissue model for the study of drug neuropharmacology; and (ii) it is unclear how far small study-molecules administered via retrodialysis diffuse within the human brain.
Materials and methods: Here, we studied the radial diffusion distance of small-molecule gadolinium-DTPA from microdialysis catheters in a newly developed, simple, stable, inexpensive brain tissue model as a precursor for in-vivo studies. Brain tissue models consisting of 0.65% weight/volume agarose gel in two kinds of buffers were created. The distribution of a paramagnetic contrast agent gadolinium-DTPA (Gd-DTPA) perfusion from microdialysis catheters using magnetic resonance imaging (MRI) was characterized as a surrogate for other small-molecule study substrates.
Results: We found the mean radial diffusion distance of Gd-DTPA to be 18.5 mm after 24 h (p < 0.0001).
Conclusion: Our brain tissue model provides avenues for further tests and research into infusion studies using cerebral microdialysis, and consequently effective focal drug delivery for patients with TBI and other brain disorders.