Do we need to reconsider how we gauge success after anatomic total shoulder arthroplasty? A study of thresholds optimized for patient satisfaction using the Simple Shoulder Test.
Noah J Quinlan, Suhas P Dasari, Behnam Sharareh, James G Levins, Anastasia J Whitson, Frederick A Matsen, Jason E Hsu
{"title":"Do we need to reconsider how we gauge success after anatomic total shoulder arthroplasty? A study of thresholds optimized for patient satisfaction using the Simple Shoulder Test.","authors":"Noah J Quinlan, Suhas P Dasari, Behnam Sharareh, James G Levins, Anastasia J Whitson, Frederick A Matsen, Jason E Hsu","doi":"10.1016/j.jse.2024.11.013","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Clinically important improvement after total shoulder arthroplasty is often assessed with shoulder-specific patient-reported outcome measures (PROMs) quantifying reduction in pain and restoration in function. It is unclear if commonly used thresholds such as minimal clinically important difference (MCID), substantial clinical benefit (SCB), or patient acceptable symptom state (PASS) represent optimal improvement from the patients' perspective. The objectives of this study were to use the Simple Shoulder Test (SST) to (1) compare commonly used thresholds for change in score and final score to thresholds optimized to patient satisfaction using receiver operating characteristic (ROC) curve analysis, and (2) determine the impact of using different thresholds on reporting of independent predictors of successful outcome in terms of patient satisfaction.</p><p><strong>Methods: </strong>This study included 406 anatomic total shoulder arthroplasty (aTSA) patients from a longitudinally maintained database with 2-year follow-up. Surveys included the SST and a satisfaction questionnaire. SST thresholds were calculated by commonly described techniques for MCID, SCB, %MPI (percentage of maximal possible improvement), and PASS. ROC curves were constructed to determine the optimal threshold of SST change in score (Change-ROC), final SST score (Final-ROC), and %MPI (%MPI-ROC) based on patient satisfaction. Youden index (J) was calculated to determine each threshold's performance in maximizing sensitivity and specificity. Multivariable analysis was performed to determine predictors of surpassing selected threshold values.</p><p><strong>Results: </strong>The thresholds with the highest Youden index correlating best with patient satisfaction were %MPI-ROC (aTSA, 61%, J = 0.49) and Final-ROC (aTSA, 9.5, J = 0.48). Commonly used thresholds including MCID of 2.0 (J = 0.21) and SCB of 2.7 (2.7) had the lowest Youden index of the thresholds studied. Characteristics predictive of success varied substantially according to the selected threshold.</p><p><strong>Conclusions: </strong>Current thresholds commonly used to gauge success after aTSA have limited ability to predict success based on patient satisfaction using the SST. Given that focus in health care value is shifting toward patient satisfaction, optimal thresholds used to measure success after shoulder arthroplasty may require reconsideration.</p>","PeriodicalId":50051,"journal":{"name":"Journal of Shoulder and Elbow Surgery","volume":" ","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Shoulder and Elbow Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jse.2024.11.013","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Clinically important improvement after total shoulder arthroplasty is often assessed with shoulder-specific patient-reported outcome measures (PROMs) quantifying reduction in pain and restoration in function. It is unclear if commonly used thresholds such as minimal clinically important difference (MCID), substantial clinical benefit (SCB), or patient acceptable symptom state (PASS) represent optimal improvement from the patients' perspective. The objectives of this study were to use the Simple Shoulder Test (SST) to (1) compare commonly used thresholds for change in score and final score to thresholds optimized to patient satisfaction using receiver operating characteristic (ROC) curve analysis, and (2) determine the impact of using different thresholds on reporting of independent predictors of successful outcome in terms of patient satisfaction.
Methods: This study included 406 anatomic total shoulder arthroplasty (aTSA) patients from a longitudinally maintained database with 2-year follow-up. Surveys included the SST and a satisfaction questionnaire. SST thresholds were calculated by commonly described techniques for MCID, SCB, %MPI (percentage of maximal possible improvement), and PASS. ROC curves were constructed to determine the optimal threshold of SST change in score (Change-ROC), final SST score (Final-ROC), and %MPI (%MPI-ROC) based on patient satisfaction. Youden index (J) was calculated to determine each threshold's performance in maximizing sensitivity and specificity. Multivariable analysis was performed to determine predictors of surpassing selected threshold values.
Results: The thresholds with the highest Youden index correlating best with patient satisfaction were %MPI-ROC (aTSA, 61%, J = 0.49) and Final-ROC (aTSA, 9.5, J = 0.48). Commonly used thresholds including MCID of 2.0 (J = 0.21) and SCB of 2.7 (2.7) had the lowest Youden index of the thresholds studied. Characteristics predictive of success varied substantially according to the selected threshold.
Conclusions: Current thresholds commonly used to gauge success after aTSA have limited ability to predict success based on patient satisfaction using the SST. Given that focus in health care value is shifting toward patient satisfaction, optimal thresholds used to measure success after shoulder arthroplasty may require reconsideration.
期刊介绍:
The official publication for eight leading specialty organizations, this authoritative journal is the only publication to focus exclusively on medical, surgical, and physical techniques for treating injury/disease of the upper extremity, including the shoulder girdle, arm, and elbow. Clinically oriented and peer-reviewed, the Journal provides an international forum for the exchange of information on new techniques, instruments, and materials. Journal of Shoulder and Elbow Surgery features vivid photos, professional illustrations, and explicit diagrams that demonstrate surgical approaches and depict implant devices. Topics covered include fractures, dislocations, diseases and injuries of the rotator cuff, imaging techniques, arthritis, arthroscopy, arthroplasty, and rehabilitation.