Enhancing Diagnostic Accuracy and Efficiency with GPT-4-Generated Structured Reports: A Comprehensive Study

Abstract

Purpose

Interpreting free-text contrast-enhanced ultrasound (CEUS) reports can lead to diagnostic errors and prolonged patient waiting times. Generative Pre-trained Transformer (GPT)-4, a state-of-the-art natural language processing model, may improve diagnostic efficiency by generating structured medical reports from unstructured data. This experimental study investigates the impact of GPT-4-generated structured reports on doctors’ diagnostic efficiency in liver nodule CEUS examinations, comparing their performance with that of doctors using conventional free-text reports.

Methods

A total of 159 CEUS reports were collected and structured using GPT-4, and 30 doctors of varying experience levels participated in the study. The performance of doctors using free-text reports was compared with those using structured reports in terms of diagnostic efficiency and accuracy.

Results

The study revealed significant improvements in diagnostic efficiency (20 vs. 17 min) and accuracy (73% vs. 79%) for doctors using GPT-4-generated structured reports compared to traditional free-text reports. This trend was consistent across all experience levels. Qualitative insights from frontline ultrasound doctors provided valuable feedback on the strengths and weaknesses of GPT-4-generated structured reports.

Conclusion

GPT-4-generated structured reports show potential in enhancing diagnostic efficiency and accuracy in liver nodule CEUS examinations. Despite certain limitations, refining GPT-4 or similar natural language processing models in future iterations can yield greater benefits. Future research should explore broader clinical applications and investigate GPT models and natural language processing techniques in areas such as decision support, patient communication, and medical research, ultimately contributing to improved patient care and healthcare outcomes.

Clinical Relevance

This study suggests that GPT-4-generated structured reports enhance diagnostic efficiency and accuracy in liver nodule CEUS examinations, potentially improving patient care and outcomes by reducing diagnostic errors and patient wait times.