ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament Reconstruction

Purpose

To determine whether ChatGPT effectively responds to 10 commonly asked questions concerning ulnar collateral ligament (UCL) reconstruction.

Methods

A comprehensive list of 90 UCL reconstruction questions was initially created, with a final set of 10 “most commonly asked” questions ultimately selected. Questions were presented to ChatGPT and its response was documented. Responses were evaluated independently by 3 authors using an evidence-based methodology, resulting in a grading system categorized as follows: (1) excellent response not requiring clarification; (2) satisfactory requiring minimal clarification; (3) satisfactory requiring moderate clarification; and (4) unsatisfactory requiring substantial clarification.

Results

Six of 10 ten responses were rated as “excellent” or “satisfactory.” Of those 6 responses, 2 were determined to be “excellent response not requiring clarification,” 3 were “satisfactory requiring minimal clarification,” and 1 was “satisfactory requiring moderate clarification.” Four questions encompassing inquiries about “What are the potential risks of UCL reconstruction surgery?” “Which type of graft should be used for my UCL reconstruction?” and “Should I have UCL reconstruction or repair?” were rated as “unsatisfactory requiring substantial clarification.”

Conclusions

ChatGPT exhibited the potential to improve a patient’s basic understanding of UCL reconstruction and provided responses that were deemed satisfactory to excellent for 60% of the most commonly asked questions. For the other 40% of questions, ChatGPT gave unsatisfactory responses, primarily due to a lack of relevant details or the need for further explanation.

Clinical Relevance

ChatGPT can assist in patient education regarding UCL reconstruction; however, its ability to appropriately answer more complex questions remains to be an area of skepticism and future improvement.