Amar Dhand, Rama Mangipudi, Anubodh S Varshney, Jonathan R Crowe, Andria L Ford, Nancy K Sweitzer, Min Shin, Samuel Tate, Haissam Haddad, Michael E Kelly, James Muller, Jay S Shavadia
{"title":"Assessment of the Sensitivity of a Smartphone App to Assist Patients in the Identification of Stroke and Myocardial Infarction: Cross-Sectional Study.","authors":"Amar Dhand, Rama Mangipudi, Anubodh S Varshney, Jonathan R Crowe, Andria L Ford, Nancy K Sweitzer, Min Shin, Samuel Tate, Haissam Haddad, Michael E Kelly, James Muller, Jay S Shavadia","doi":"10.2196/60465","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Most people do not recognize symptoms of neurological and cardiac emergencies in a timely manner. This leads to delays in hospital arrival and reduced access to therapies that can open arteries. We created a smartphone app to help patients and families evaluate if symptoms may be high risk for stroke or heart attack (myocardial infarction, MI). The ECHAS (Emergency Call for Heart Attack and Stroke) app guides users to assess their risk through evidence-based questions and a test of weakness in one arm by evaluating finger-tapping on the smartphone.</p><p><strong>Objective: </strong>This study is an initial step in the accuracy evaluation of the app focused on sensitivity. We evaluated whether the app provides appropriate triage advice for patients with known stroke or MI symptoms in the Emergency Department. We designed this study to evaluate the sensitivity of the app, since the most dangerous output of the app would be failure to recognize the need for emergency evaluation. Specificity is also important, but the consequences of low specificity are less dangerous than those of low sensitivity.</p><p><strong>Methods: </strong>In this single-center cross-sectional study, we enrolled patients presenting with symptoms of possible stroke or MI. The ECHAS app assessment consisted of a series of evidence-based questions regarding symptoms and a test of finger-tapping speed and accuracy on the phone's screen to detect unilateral arm weakness. The primary outcome was the sensitivity of the ECHAS app in detecting the need for ED evaluation. The secondary outcome was the sensitivity of the ECHAS app in detecting the need for hospital admission. Two independent and blinded board-certified physicians reviewed the medical record and adjudicated the appropriateness of the ED visit based on a 5-point score (ground truth). Finally, we asked patients semistructured questions about the app's ease of use, drawbacks, and benefits.</p><p><strong>Results: </strong>We enrolled 202 patients (57 with stroke and 145 with MI). The ECHAS score was strongly correlated with the ground truth appropriateness score (Spearman correlation 0.41, P<.001). The ECHAS app had a sensitivity of 0.98 for identifying patients in whom ED evaluation was appropriate. The app had a sensitivity of 1.0 for identifying patients who were admitted to the hospital because of their ED evaluation. Patients completed an app session in an average of 111 (SD 60) seconds for the stroke pathway and 60 (SD 33) seconds for the MI pathway. Patients reported that the app was easy to use and valuable for personal emergency situations at home.</p><p><strong>Conclusions: </strong>The ECHAS app demonstrated a high sensitivity for the detection of patients who required emergency evaluation for symptoms of stroke or MI. This study supports the need for a study of specificity of the app, and then a prospective trial of the app in patients at increased risk of MI and stroke.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"9 ","pages":"e60465"},"PeriodicalIF":2.0000,"publicationDate":"2025-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Formative Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/60465","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Most people do not recognize symptoms of neurological and cardiac emergencies in a timely manner. This leads to delays in hospital arrival and reduced access to therapies that can open arteries. We created a smartphone app to help patients and families evaluate if symptoms may be high risk for stroke or heart attack (myocardial infarction, MI). The ECHAS (Emergency Call for Heart Attack and Stroke) app guides users to assess their risk through evidence-based questions and a test of weakness in one arm by evaluating finger-tapping on the smartphone.
Objective: This study is an initial step in the accuracy evaluation of the app focused on sensitivity. We evaluated whether the app provides appropriate triage advice for patients with known stroke or MI symptoms in the Emergency Department. We designed this study to evaluate the sensitivity of the app, since the most dangerous output of the app would be failure to recognize the need for emergency evaluation. Specificity is also important, but the consequences of low specificity are less dangerous than those of low sensitivity.
Methods: In this single-center cross-sectional study, we enrolled patients presenting with symptoms of possible stroke or MI. The ECHAS app assessment consisted of a series of evidence-based questions regarding symptoms and a test of finger-tapping speed and accuracy on the phone's screen to detect unilateral arm weakness. The primary outcome was the sensitivity of the ECHAS app in detecting the need for ED evaluation. The secondary outcome was the sensitivity of the ECHAS app in detecting the need for hospital admission. Two independent and blinded board-certified physicians reviewed the medical record and adjudicated the appropriateness of the ED visit based on a 5-point score (ground truth). Finally, we asked patients semistructured questions about the app's ease of use, drawbacks, and benefits.
Results: We enrolled 202 patients (57 with stroke and 145 with MI). The ECHAS score was strongly correlated with the ground truth appropriateness score (Spearman correlation 0.41, P<.001). The ECHAS app had a sensitivity of 0.98 for identifying patients in whom ED evaluation was appropriate. The app had a sensitivity of 1.0 for identifying patients who were admitted to the hospital because of their ED evaluation. Patients completed an app session in an average of 111 (SD 60) seconds for the stroke pathway and 60 (SD 33) seconds for the MI pathway. Patients reported that the app was easy to use and valuable for personal emergency situations at home.
Conclusions: The ECHAS app demonstrated a high sensitivity for the detection of patients who required emergency evaluation for symptoms of stroke or MI. This study supports the need for a study of specificity of the app, and then a prospective trial of the app in patients at increased risk of MI and stroke.