Polona Caserman, Sungsoo Yum, Stefan Göbel, Andreas Reif, Silke Matura
{"title":"Assessing the Accuracy of Smartwatch-Based Estimation of Maximum Oxygen Uptake Using the Apple Watch Series 7: Validation Study.","authors":"Polona Caserman, Sungsoo Yum, Stefan Göbel, Andreas Reif, Silke Matura","doi":"10.2196/59459","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Determining maximum oxygen uptake (VO<sub>2</sub>max) is essential for evaluating cardiorespiratory fitness. While laboratory-based testing is considered the gold standard, sports watches or fitness trackers offer a convenient alternative. However, despite the high number of wrist-worn devices, there is a lack of scientific validation for VO<sub>2</sub>max estimation outside the laboratory setting.</p><p><strong>Objective: </strong>This study aims to compare the Apple Watch Series 7's performance against the gold standard in VO<sub>2</sub>max estimation and Apple's validation findings.</p><p><strong>Methods: </strong>A total of 19 participants (7 female and 12 male), aged 18 to 63 (mean 28.42, SD 11.43) years were included in the validation study. VO<sub>2</sub>max for all participants was determined in a controlled laboratory environment using a metabolic gas analyzer. Thereby, they completed a graded exercise test on a cycle ergometer until reaching subjective exhaustion. This value was then compared with the estimated VO<sub>2</sub>max value from the Apple Watch, which was calculated after wearing the watch for at least 2 consecutive days and measured directly after an outdoor running test.</p><p><strong>Results: </strong>The measured VO<sub>2</sub>max (mean 45.88, SD 9.42 mL/kg/minute) in the laboratory setting was significantly higher than the predicted VO<sub>2</sub>max (mean 41.37, SD 6.5 mL/kg/minute) from the Apple Watch (t<sub>18</sub>=2.51; P=.01) with a medium effect size (Hedges g=0.53). The Bland-Altman analysis revealed a good overall agreement between both measurements. However, the intraclass correlation coefficient ICC(2,1)=0.47 (95% CI 0.06-0.75) indicated poor reliability. The mean absolute percentage error between the predicted and the actual VO<sub>2</sub>max was 15.79%, while the root mean square error was 8.85 mL/kg/minute. The analysis further revealed higher accuracy when focusing on participants with good fitness levels (mean absolute percentage error=14.59%; root-mean-square error=7.22 ml/kg/minute; ICC(2,1)=0.60 95% CI 0.09-0.87).</p><p><strong>Conclusions: </strong>Similar to other smartwatches, the Apple Watch also overestimates or underestimates the VO<sub>2</sub>max in individuals with poor or excellent fitness levels, respectively. Assessing the accuracy and reliability of the Apple Watch's VO<sub>2</sub>max estimation is crucial for determining its suitability as an alternative to laboratory testing. The findings of this study will apprise researchers, physical training professionals, and end users of wearable technology, thereby enhancing the knowledge base and practical application of such devices in assessing cardiorespiratory fitness parameters.</p>","PeriodicalId":87288,"journal":{"name":"JMIR biomedical engineering","volume":"9 ","pages":"e59459"},"PeriodicalIF":0.0000,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11325102/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR biomedical engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/59459","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Determining maximum oxygen uptake (VO2max) is essential for evaluating cardiorespiratory fitness. While laboratory-based testing is considered the gold standard, sports watches or fitness trackers offer a convenient alternative. However, despite the high number of wrist-worn devices, there is a lack of scientific validation for VO2max estimation outside the laboratory setting.
Objective: This study aims to compare the Apple Watch Series 7's performance against the gold standard in VO2max estimation and Apple's validation findings.
Methods: A total of 19 participants (7 female and 12 male), aged 18 to 63 (mean 28.42, SD 11.43) years were included in the validation study. VO2max for all participants was determined in a controlled laboratory environment using a metabolic gas analyzer. Thereby, they completed a graded exercise test on a cycle ergometer until reaching subjective exhaustion. This value was then compared with the estimated VO2max value from the Apple Watch, which was calculated after wearing the watch for at least 2 consecutive days and measured directly after an outdoor running test.
Results: The measured VO2max (mean 45.88, SD 9.42 mL/kg/minute) in the laboratory setting was significantly higher than the predicted VO2max (mean 41.37, SD 6.5 mL/kg/minute) from the Apple Watch (t18=2.51; P=.01) with a medium effect size (Hedges g=0.53). The Bland-Altman analysis revealed a good overall agreement between both measurements. However, the intraclass correlation coefficient ICC(2,1)=0.47 (95% CI 0.06-0.75) indicated poor reliability. The mean absolute percentage error between the predicted and the actual VO2max was 15.79%, while the root mean square error was 8.85 mL/kg/minute. The analysis further revealed higher accuracy when focusing on participants with good fitness levels (mean absolute percentage error=14.59%; root-mean-square error=7.22 ml/kg/minute; ICC(2,1)=0.60 95% CI 0.09-0.87).
Conclusions: Similar to other smartwatches, the Apple Watch also overestimates or underestimates the VO2max in individuals with poor or excellent fitness levels, respectively. Assessing the accuracy and reliability of the Apple Watch's VO2max estimation is crucial for determining its suitability as an alternative to laboratory testing. The findings of this study will apprise researchers, physical training professionals, and end users of wearable technology, thereby enhancing the knowledge base and practical application of such devices in assessing cardiorespiratory fitness parameters.