A Framework for Testing the Reliability and Validity of a Novel Non-Invasive Digital Biomarker Instrument Using Statistical Techniques: A Case Study with Lyfas
{"title":"A Framework for Testing the Reliability and Validity of a Novel Non-Invasive Digital Biomarker Instrument Using Statistical Techniques: A Case Study with Lyfas","authors":"S. Chattopadhyay, Rupam Das","doi":"10.14738/tmlai.102.11845","DOIUrl":null,"url":null,"abstract":"Background: This paper demonstrates a framework for testing of efficacy (reliability and validity) of a novel instrument against a gold-standard instrument. Lyfas is a novel, non-wearable, non-invasive, and economic optical biomarker instrument that runs on android smartphones. By capturing the Pulse Rate (PR) and Pulse Rate Variability (PRV) from the index finger capillary using photoplethysmography, it measures the Cardiovascular Autonomic Modulation (CvAM). The Polar H10 sensor is a gold-standard electrical biofeedback instrument that comes with a wearable chest belt and is a relatively costly device. It captures the Heart Rate (HR) and Heart Rate Variability (HRV) that surrogates Cardiac Autonomic Modulation (CAM). Objective: To showcase the statistical framework in mining the efficacy of Lyfas as a biofeedback instrument by comparing it with that of the Polar H10 instrument following a ‘6Minute Walk Test’. Method: Using Lyfas and Polar H10 HR sensor, PR and HR were captured from 567 subjects(n=567, 312 healthy adult males, and 255 females, respectively). The data was checked for the (a) internal consistency (Cronbach’s alpha), (b) its distribution (Q-Q plots), (c) descriptive statistics (box plots), (d) Root Mean Square difference between the HR and PR, (e) reliability (Bland-Altman Reliability Test), and (f) correlations using (i) Pearson’s inter-class correlations (r), and (ii) Linear regressions (R2). Results: The efficacy of Lyfas as a biofeedback instrument has finally been computed by averaging the mean scores of BART (93.53%), ‘r’ (86.96%), and R2 (87.58%) for the sample and found to be 87.27%. Conclusion: Lyfas can also be used as a biofeedback instrument.","PeriodicalId":119801,"journal":{"name":"Transactions on Machine Learning and Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2022-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transactions on Machine Learning and Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.14738/tmlai.102.11845","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3
Abstract
Background: This paper demonstrates a framework for testing of efficacy (reliability and validity) of a novel instrument against a gold-standard instrument. Lyfas is a novel, non-wearable, non-invasive, and economic optical biomarker instrument that runs on android smartphones. By capturing the Pulse Rate (PR) and Pulse Rate Variability (PRV) from the index finger capillary using photoplethysmography, it measures the Cardiovascular Autonomic Modulation (CvAM). The Polar H10 sensor is a gold-standard electrical biofeedback instrument that comes with a wearable chest belt and is a relatively costly device. It captures the Heart Rate (HR) and Heart Rate Variability (HRV) that surrogates Cardiac Autonomic Modulation (CAM). Objective: To showcase the statistical framework in mining the efficacy of Lyfas as a biofeedback instrument by comparing it with that of the Polar H10 instrument following a ‘6Minute Walk Test’. Method: Using Lyfas and Polar H10 HR sensor, PR and HR were captured from 567 subjects(n=567, 312 healthy adult males, and 255 females, respectively). The data was checked for the (a) internal consistency (Cronbach’s alpha), (b) its distribution (Q-Q plots), (c) descriptive statistics (box plots), (d) Root Mean Square difference between the HR and PR, (e) reliability (Bland-Altman Reliability Test), and (f) correlations using (i) Pearson’s inter-class correlations (r), and (ii) Linear regressions (R2). Results: The efficacy of Lyfas as a biofeedback instrument has finally been computed by averaging the mean scores of BART (93.53%), ‘r’ (86.96%), and R2 (87.58%) for the sample and found to be 87.27%. Conclusion: Lyfas can also be used as a biofeedback instrument.