Pub Date : 2020-12-30eCollection Date: 2021-01-01DOI: 10.1159/000512394
Katharina Schultebraucks, Vijay Yadav, Isaac R Galatzer-Levy
Background: Alterations in multiple domains of cognition have been observed in individuals who have experienced a traumatic stressor. These domains may provide important insights in identifying underlying neurobiological dysfunction driving an individual's clinical response to trauma. However, such assessments are burdensome, costly, and time-consuming. To overcome barriers, efforts have emerged to measure multiple domains of cognitive functioning through the application of machine learning (ML) models to passive data sources.
Methods: We utilized automated computer vision and voice analysis methods to extract facial, movement, and speech characteristics from semi-structured clinical interviews in 81 trauma survivors who additionally completed a cognitive assessment battery. A ML-based regression framework was used to identify variance in visual and auditory measures that relate to multiple cognitive domains.
Results: Models derived from visual and auditory measures collectively accounted for a large variance in multiple domains of cognitive functioning, including motor coordination (R2 = 0.52), processing speed (R2 = 0.42), emotional bias (R2 = 0.52), sustained attention (R2 = 0.51), controlled attention (R2 = 0.44), cognitive flexibility (R2 = 0.43), cognitive inhibition (R2 = 0.64), and executive functioning (R2 = 0.63), consistent with the high test-retest reliability of traditional cognitive assessments. Face, voice, speech content, and movement have all significantly contributed to explaining the variance in predicting functioning in all cognitive domains.
Conclusions: The results demonstrate the feasibility of automated measurement of reliable proxies of cognitive functioning through low-burden passive patient evaluations. This makes it easier to monitor cognitive functions and to intervene earlier and at a lower threshold without requiring a time-consuming neurocognitive assessment by, for instance, a licensed psychologist with specialized training in neuropsychology.
{"title":"Utilization of Machine Learning-Based Computer Vision and Voice Analysis to Derive Digital Biomarkers of Cognitive Functioning in Trauma Survivors.","authors":"Katharina Schultebraucks, Vijay Yadav, Isaac R Galatzer-Levy","doi":"10.1159/000512394","DOIUrl":"https://doi.org/10.1159/000512394","url":null,"abstract":"<p><strong>Background: </strong>Alterations in multiple domains of cognition have been observed in individuals who have experienced a traumatic stressor. These domains may provide important insights in identifying underlying neurobiological dysfunction driving an individual's clinical response to trauma. However, such assessments are burdensome, costly, and time-consuming. To overcome barriers, efforts have emerged to measure multiple domains of cognitive functioning through the application of machine learning (ML) models to passive data sources.</p><p><strong>Methods: </strong>We utilized automated computer vision and voice analysis methods to extract facial, movement, and speech characteristics from semi-structured clinical interviews in 81 trauma survivors who additionally completed a cognitive assessment battery. A ML-based regression framework was used to identify variance in visual and auditory measures that relate to multiple cognitive domains.</p><p><strong>Results: </strong>Models derived from visual and auditory measures collectively accounted for a large variance in multiple domains of cognitive functioning, including motor coordination (<i>R</i><sup>2</sup> = 0.52), processing speed (<i>R</i><sup>2</sup> = 0.42), emotional bias (<i>R</i><sup>2</sup> = 0.52), sustained attention (<i>R</i><sup>2</sup> = 0.51), controlled attention (<i>R</i><sup>2</sup> = 0.44), cognitive flexibility (<i>R</i><sup>2</sup> = 0.43), cognitive inhibition (<i>R</i><sup>2</sup> = 0.64), and executive functioning (<i>R</i><sup>2</sup> = 0.63), consistent with the high test-retest reliability of traditional cognitive assessments. Face, voice, speech content, and movement have all significantly contributed to explaining the variance in predicting functioning in all cognitive domains.</p><p><strong>Conclusions: </strong>The results demonstrate the feasibility of automated measurement of reliable proxies of cognitive functioning through low-burden passive patient evaluations. This makes it easier to monitor cognitive functions and to intervene earlier and at a lower threshold without requiring a time-consuming neurocognitive assessment by, for instance, a licensed psychologist with specialized training in neuropsychology.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"5 1","pages":"16-23"},"PeriodicalIF":0.0,"publicationDate":"2020-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1159/000512394","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"25391025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-12-30eCollection Date: 2021-01-01DOI: 10.1159/000511287
T Maxwell Parker, Nathan Farrell, Jorge Otero-Millan, Amir Kheradmand, Ayodele McClenney, David E Newman-Toker
Objective: Differentiating benign from dangerous causes of dizziness or vertigo presents a major diagnostic challenge for many clinicians. Bedside presentations of peripheral vestibular disorders and posterior fossa strokes are often indistinguishable other than by a few subtle vestibular eye movements. The most challenging of these to interpret is the head impulse test (HIT) of vestibulo-ocular reflex (VOR) function. There have been major advances in portable video-oculography (VOG) quantification of the video HIT (vHIT), but these specialized devices are not routinely available in most clinical settings. As a first step towards smartphone-based diagnosis of strokes in patients presenting vestibular symptoms, we sought proof of concept that we could use a smartphone application ("app") to accurately record the vHIT.
Methods: This was a cross-sectional agreement study comparing a novel index test (smartphone-based vHIT app) to an accepted reference standard test (VOG-based vHIT) for measuring VOR function. We recorded passive (examiner-performed) vHIT sequentially with both methods in a convenience sample of patients visiting an otoneurology clinic. We quantitatively correlated VOR gains (ratio of eye to head movements during the HIT) from each side/ear and experts qualitatively assessed the physiologic traces by the two methods.
Results: We recruited 11 patients; 1 patient's vHIT could not be reliably quantified with either device. The novel and reference test VOR gain measurements for each ear (n = 20) were highly correlated (Pearson's r = 0.9, p = 0.0000001) and, qualitatively, clinically equivalent.
Conclusions: This preliminary study provides proof of concept that an "eyePhone" app could be used to measure vHIT and eventually developed to diagnose vestibular strokes by smartphone.
目的:区分良性与危险原因的头晕或眩晕是许多临床医生面临的主要诊断挑战。外周前庭疾病和后窝中风的床边表现除了一些细微的前庭眼球运动外,通常难以区分。其中最具挑战性的是前庭-眼反射(VOR)功能的头部脉冲测试(HIT)。在便携式视频视觉成像(VOG)量化视频HIT (vHIT)方面取得了重大进展,但这些专门的设备在大多数临床环境中并不常见。作为基于智能手机诊断出现前庭症状的中风患者的第一步,我们寻求概念证明,我们可以使用智能手机应用程序(“应用程序”)来准确记录vHIT。方法:这是一项横断面协议研究,比较了一种新的指数测试(基于智能手机的vHIT应用程序)和一种公认的参考标准测试(基于vog的vHIT)来测量VOR功能。我们记录被动(检查员执行)vHIT顺序用两种方法方便样本的患者访问耳神经病学诊所。我们定量地关联了每侧/耳朵的VOR增益(HIT期间眼睛与头部运动的比率),专家通过两种方法定性地评估了生理痕迹。结果:我们招募了11例患者;两种仪器均不能可靠地量化1例患者的vHIT。每只耳朵(n = 20)的新试验和参考试验的VOR增益测量值高度相关(Pearson’s r = 0.9, p = 0.0000001),并且在质量上临床等效。结论:这项初步研究提供了概念证明,“eyePhone”应用程序可以用于测量vHIT,并最终开发用于通过智能手机诊断前庭中风。
{"title":"Proof of Concept for an \"eyePhone\" App to Measure Video Head Impulses.","authors":"T Maxwell Parker, Nathan Farrell, Jorge Otero-Millan, Amir Kheradmand, Ayodele McClenney, David E Newman-Toker","doi":"10.1159/000511287","DOIUrl":"https://doi.org/10.1159/000511287","url":null,"abstract":"<p><strong>Objective: </strong>Differentiating benign from dangerous causes of dizziness or vertigo presents a major diagnostic challenge for many clinicians. Bedside presentations of peripheral vestibular disorders and posterior fossa strokes are often indistinguishable other than by a few subtle vestibular eye movements. The most challenging of these to interpret is the head impulse test (HIT) of vestibulo-ocular reflex (VOR) function. There have been major advances in portable video-oculography (VOG) quantification of the video HIT (vHIT), but these specialized devices are not routinely available in most clinical settings. As a first step towards smartphone-based diagnosis of strokes in patients presenting vestibular symptoms, we sought proof of concept that we could use a smartphone application (\"app\") to accurately record the vHIT.</p><p><strong>Methods: </strong>This was a cross-sectional agreement study comparing a novel index test (smartphone-based vHIT app) to an accepted reference standard test (VOG-based vHIT) for measuring VOR function. We recorded passive (examiner-performed) vHIT sequentially with both methods in a convenience sample of patients visiting an otoneurology clinic. We quantitatively correlated VOR gains (ratio of eye to head movements during the HIT) from each side/ear and experts qualitatively assessed the physiologic traces by the two methods.</p><p><strong>Results: </strong>We recruited 11 patients; 1 patient's vHIT could not be reliably quantified with either device. The novel and reference test VOR gain measurements for each ear (<i>n</i> = 20) were highly correlated (Pearson's <i>r</i> = 0.9, <i>p</i> = 0.0000001) and, qualitatively, clinically equivalent.</p><p><strong>Conclusions: </strong>This preliminary study provides proof of concept that an \"eyePhone\" app could be used to measure vHIT and eventually developed to diagnose vestibular strokes by smartphone.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"5 1","pages":"1-8"},"PeriodicalIF":0.0,"publicationDate":"2020-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1159/000511287","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"25391021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-12-30eCollection Date: 2021-01-01DOI: 10.1159/000512207
Sylvia Josephy-Hernandez, Catherine Norise, Jee-Young Han, Kara M Smith
Introduction: Digital biomarkers may act as a tool for early detection of changes in cognition. It is important to understand public perception of technologies focused on monitoring cognition to better guide the design of these tools and inform patients appropriately about the associated risks and benefits. Health care systems may also play a role in the clinical, legal, and financial implications of such technologies.
Objective: To evaluate public opinion on the use of passive technology for monitoring cognition.
Methods: This was a one-time, Internet-based survey conducted in English and Spanish.
Results: Within the English survey distributed in the USA (n = 173), 58.1% of respondents would be highly likely to agree to passive monitoring of cognition via a smartphone application. Thirty-eight percent of those with a higher degree of experience with technology were likely to agree to monitoring versus 20% of those with less experience with technology (p = 0.003). Sixty-two percent of non-health-care professionals were likely to agree to monitoring versus 45% of health-care workers (p = 0.012). There were significant concerns regarding privacy (p < 0.01). We compared the surveys answered in Spanish in Costa Rica via logistic regression (n = 43, total n = 216), adjusting for age, education level, health-care profession, owning a smartphone, experience with technology, and perception of cognitive decline. Costa Rican/Spanish-speaking respondents were 7 times more likely to select a high probability of agreeing to such a technology (p < 0.01). English-speaking respondents from the USA were 5 times more likely to be concerned about the impact on health insurance (p = 0.001) and life insurance (p = 0.01).
Conclusions: Understanding public perception and ethical implications should guide the design of digital biomarkers for cognition. Privacy and the health-care system in which the participants take part are 2 major factors to be considered. It is the responsibility of researchers to convey the ethical and legal implications of cognition monitoring.
{"title":"Survey on Acceptance of Passive Technology Monitoring for Early Detection of Cognitive Impairment.","authors":"Sylvia Josephy-Hernandez, Catherine Norise, Jee-Young Han, Kara M Smith","doi":"10.1159/000512207","DOIUrl":"https://doi.org/10.1159/000512207","url":null,"abstract":"<p><strong>Introduction: </strong>Digital biomarkers may act as a tool for early detection of changes in cognition. It is important to understand public perception of technologies focused on monitoring cognition to better guide the design of these tools and inform patients appropriately about the associated risks and benefits. Health care systems may also play a role in the clinical, legal, and financial implications of such technologies.</p><p><strong>Objective: </strong>To evaluate public opinion on the use of passive technology for monitoring cognition.</p><p><strong>Methods: </strong>This was a one-time, Internet-based survey conducted in English and Spanish.</p><p><strong>Results: </strong>Within the English survey distributed in the USA (<i>n</i> = 173), 58.1% of respondents would be highly likely to agree to passive monitoring of cognition via a smartphone application. Thirty-eight percent of those with a higher degree of experience with technology were likely to agree to monitoring versus 20% of those with less experience with technology (<i>p</i> = 0.003). Sixty-two percent of non-health-care professionals were likely to agree to monitoring versus 45% of health-care workers (<i>p</i> = 0.012). There were significant concerns regarding privacy (<i>p</i> < 0.01). We compared the surveys answered in Spanish in Costa Rica via logistic regression (<i>n</i> = 43, total <i>n</i> = 216), adjusting for age, education level, health-care profession, owning a smartphone, experience with technology, and perception of cognitive decline. Costa Rican/Spanish-speaking respondents were 7 times more likely to select a high probability of agreeing to such a technology (<i>p</i> < 0.01). English-speaking respondents from the USA were 5 times more likely to be concerned about the impact on health insurance (<i>p</i> = 0.001) and life insurance (<i>p</i> = 0.01).</p><p><strong>Conclusions: </strong>Understanding public perception and ethical implications should guide the design of digital biomarkers for cognition. Privacy and the health-care system in which the participants take part are 2 major factors to be considered. It is the responsibility of researchers to convey the ethical and legal implications of cognition monitoring.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"5 1","pages":"9-15"},"PeriodicalIF":0.0,"publicationDate":"2020-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1159/000512207","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"25391023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-12-03eCollection Date: 2020-09-01DOI: 10.1159/000512681
Anna Andoni, Shayann Ramedani, Benjamin I Rosner, Aenor Sawyer
{"title":"NODE. Health Meeting Report and Panel Discussion - The FDA's Changing Regulatory Landscape for Digital Health Technologies and Digital Health Innovation during COVID-19: A Discussion with Eric Topol and Bakul Patel, Moderated by Aenor Sawyer.","authors":"Anna Andoni, Shayann Ramedani, Benjamin I Rosner, Aenor Sawyer","doi":"10.1159/000512681","DOIUrl":"10.1159/000512681","url":null,"abstract":"","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"4 3","pages":"128-133"},"PeriodicalIF":0.0,"publicationDate":"2020-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7772872/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38817166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-12-03eCollection Date: 2020-09-01DOI: 10.1159/000513229
Benjamin I Rosner, Masha Morozov, Anna Andoni
{"title":"Digital Health, Telehealth, and Primary Care Post-COVID: A Discussion with Kim Boyd and Joe Kvedar, Moderated by Benjamin Rosner.","authors":"Benjamin I Rosner, Masha Morozov, Anna Andoni","doi":"10.1159/000513229","DOIUrl":"10.1159/000513229","url":null,"abstract":"","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"4 3","pages":"123-127"},"PeriodicalIF":0.0,"publicationDate":"2020-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7772846/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38816767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-12-02eCollection Date: 2020-09-01DOI: 10.1159/000511671
Gabriela M Stegmann, Shira Hahn, Julie Liss, Jeremy Shefner, Seward B Rutkove, Kan Kawabata, Samarth Bhandari, Kerisa Shelton, Cayla Jessica Duncan, Visar Berisha
Introduction: Changes in speech have the potential to provide important information on the diagnosis and progression of various neurological diseases. Many researchers have relied on open-source speech features to develop algorithms for measuring speech changes in clinical populations as they are convenient and easy to use. However, the repeatability of open-source features in the context of neurological diseases has not been studied.
Methods: We used a longitudinal sample of healthy controls, individuals with amyotrophic lateral sclerosis, and individuals with suspected frontotemporal dementia, and we evaluated the repeatability of acoustic and language features separately on these 3 data sets.
Results: Repeatability was evaluated using intraclass correlation (ICC) and the within-subjects coefficient of variation (WSCV). In 3 sets of tasks, the median ICC were between 0.02 and 0.55, and the median WSCV were between 29 and 79%.
Conclusion: Our results demonstrate that the repeatability of speech features extracted using open-source tool kits is low. Researchers should exercise caution when developing digital health models with open-source speech features. We provide a detailed summary of feature-by-feature repeatability results (ICC, WSCV, SE of measurement, limits of agreement for WSCV, and minimal detectable change) in the online supplementary material so that researchers may incorporate repeatability information into the models they develop.
{"title":"Repeatability of Commonly Used Speech and Language Features for Clinical Applications.","authors":"Gabriela M Stegmann, Shira Hahn, Julie Liss, Jeremy Shefner, Seward B Rutkove, Kan Kawabata, Samarth Bhandari, Kerisa Shelton, Cayla Jessica Duncan, Visar Berisha","doi":"10.1159/000511671","DOIUrl":"https://doi.org/10.1159/000511671","url":null,"abstract":"<p><strong>Introduction: </strong>Changes in speech have the potential to provide important information on the diagnosis and progression of various neurological diseases. Many researchers have relied on open-source speech features to develop algorithms for measuring speech changes in clinical populations as they are convenient and easy to use. However, the repeatability of open-source features in the context of neurological diseases has not been studied.</p><p><strong>Methods: </strong>We used a longitudinal sample of healthy controls, individuals with amyotrophic lateral sclerosis, and individuals with suspected frontotemporal dementia, and we evaluated the repeatability of acoustic and language features separately on these 3 data sets.</p><p><strong>Results: </strong>Repeatability was evaluated using intraclass correlation (ICC) and the within-subjects coefficient of variation (WSCV). In 3 sets of tasks, the median ICC were between 0.02 and 0.55, and the median WSCV were between 29 and 79%.</p><p><strong>Conclusion: </strong>Our results demonstrate that the repeatability of speech features extracted using open-source tool kits is low. Researchers should exercise caution when developing digital health models with open-source speech features. We provide a detailed summary of feature-by-feature repeatability results (ICC, WSCV, SE of measurement, limits of agreement for WSCV, and minimal detectable change) in the online supplementary material so that researchers may incorporate repeatability information into the models they develop.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"4 3","pages":"109-122"},"PeriodicalIF":0.0,"publicationDate":"2020-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1159/000511671","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38816765","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-11-26eCollection Date: 2020-01-01DOI: 10.1159/000511611
Matthias Tietsch, Amir Muaremi, Ieuan Clay, Felix Kluge, Holger Hoefling, Martin Ullrich, Arne Küderle, Bjoern M Eskofier, Arne Müller
Analyzing human gait with inertial sensors provides valuable insights into a wide range of health impairments, including many musculoskeletal and neurological diseases. A representative and reliable assessment of gait requires continuous monitoring over long periods and ideally takes place in the subjects' habitual environment (real-world). An inconsistent sensor wearing position can affect gait characterization and influence clinical study results, thus clinical study protocols are typically highly proscriptive, instructing all participants to wear the sensor in a uniform manner. This restrictive approach improves data quality but reduces overall adherence. In this work, we analyze the impact of altering the sensor wearing position around the waist on sensor signal and step detection. We demonstrate that an asymmetrically worn sensor leads to additional odd-harmonic frequency components in the frequency spectrum. We propose a robust solution for step detection based on autocorrelation to overcome sensor position variation (sensitivity = 0.99, precision = 0.99). The proposed solution reduces the impact of inconsistent sensor positioning on gait characterization in clinical studies, thus providing more flexibility to protocol implementation and more freedom to participants to wear the sensor in the position most comfortable to them. This work is a first step towards truly position-agnostic gait assessment in clinical settings.
{"title":"Robust Step Detection from Different Waist-Worn Sensor Positions: Implications for Clinical Studies.","authors":"Matthias Tietsch, Amir Muaremi, Ieuan Clay, Felix Kluge, Holger Hoefling, Martin Ullrich, Arne Küderle, Bjoern M Eskofier, Arne Müller","doi":"10.1159/000511611","DOIUrl":"10.1159/000511611","url":null,"abstract":"<p><p>Analyzing human gait with inertial sensors provides valuable insights into a wide range of health impairments, including many musculoskeletal and neurological diseases. A representative and reliable assessment of gait requires continuous monitoring over long periods and ideally takes place in the subjects' habitual environment (real-world). An inconsistent sensor wearing position can affect gait characterization and influence clinical study results, thus clinical study protocols are typically highly proscriptive, instructing all participants to wear the sensor in a uniform manner. This restrictive approach improves data quality but reduces overall adherence. In this work, we analyze the impact of altering the sensor wearing position around the waist on sensor signal and step detection. We demonstrate that an asymmetrically worn sensor leads to additional odd-harmonic frequency components in the frequency spectrum. We propose a robust solution for step detection based on autocorrelation to overcome sensor position variation (sensitivity = 0.99, precision = 0.99). The proposed solution reduces the impact of inconsistent sensor positioning on gait characterization in clinical studies, thus providing more flexibility to protocol implementation and more freedom to participants to wear the sensor in the position most comfortable to them. This work is a first step towards truly position-agnostic gait assessment in clinical settings.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"4 Suppl 1","pages":"50-58"},"PeriodicalIF":0.0,"publicationDate":"2020-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7768099/pdf/dib-0004-0050.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38817163","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Introduction: A major challenge in the monitoring of rehabilitation is the lack of long-term individual baseline data which would enable accurate and objective assessment of functional recovery. Consumer-grade wearable devices enable the tracking of individual everyday functioning prior to illness or other medical events which necessitate the monitoring of recovery trajectories.
Methods: For 1,324 individuals who underwent surgery on a lower limb, we collected their Fitbit device data of steps, heart rate, and sleep from 26 weeks before to 26 weeks after the self-reported surgery date. We identified subgroups of individuals who self-reported surgeries for bone fracture repair (n = 355), tendon or ligament repair/reconstruction (n = 773), and knee or hip joint replacement (n = 196). We used linear mixed models to estimate the average effect of time relative to surgery on daily activity measurements while adjusting for gender, age, and the participant-specific activity baseline. We used a sub-cohort of 127 individuals with dense wearable data who underwent tendon/ligament surgery and employed XGBoost to predict the self-reported recovery time.
Results: The 1,324 study individuals were all US residents, predominantly female (84%), white or Caucasian (85%), and young to middle-aged (mean age 36.2 years). We showed that 12 weeks pre- and 26 weeks post-surgery trajectories of daily behavioral measurements (steps sum, heart rate, sleep efficiency score) can capture activity changes relative to an individual's baseline. We demonstrated that the trajectories differ across surgery types, recapitulate the documented effect of age on functional recovery, and highlight differences in relative activity change across self-reported recovery time groups. Finally, using a sub-cohort of 127 individuals, we showed that long-term recovery can be accurately predicted, on an individual level, only 1 month after surgery (AUROC 0.734, AUPRC 0.8). Furthermore, we showed that predictions are most accurate when long-term, individual baseline data are available.
Discussion: Leveraging long-term, passively collected wearable data promises to enable relative assessment of individual recovery and is a first step towards data-driven intervention for individuals.
{"title":"Predicting Subjective Recovery from Lower Limb Surgery Using Consumer Wearables.","authors":"Marta Karas, Nikki Marinsek, Jörg Goldhahn, Luca Foschini, Ernesto Ramirez, Ieuan Clay","doi":"10.1159/000511531","DOIUrl":"https://doi.org/10.1159/000511531","url":null,"abstract":"<p><strong>Introduction: </strong>A major challenge in the monitoring of rehabilitation is the lack of long-term individual baseline data which would enable accurate and objective assessment of functional recovery. Consumer-grade wearable devices enable the tracking of individual everyday functioning prior to illness or other medical events which necessitate the monitoring of recovery trajectories.</p><p><strong>Methods: </strong>For 1,324 individuals who underwent surgery on a lower limb, we collected their Fitbit device data of steps, heart rate, and sleep from 26 weeks before to 26 weeks after the self-reported surgery date. We identified subgroups of individuals who self-reported surgeries for bone fracture repair (<i>n</i> = 355), tendon or ligament repair/reconstruction (<i>n</i> = 773), and knee or hip joint replacement (<i>n</i> = 196). We used linear mixed models to estimate the average effect of time relative to surgery on daily activity measurements while adjusting for gender, age, and the participant-specific activity baseline. We used a sub-cohort of 127 individuals with dense wearable data who underwent tendon/ligament surgery and employed XGBoost to predict the self-reported recovery time.</p><p><strong>Results: </strong>The 1,324 study individuals were all US residents, predominantly female (84%), white or Caucasian (85%), and young to middle-aged (mean age 36.2 years). We showed that 12 weeks pre- and 26 weeks post-surgery trajectories of daily behavioral measurements (steps sum, heart rate, sleep efficiency score) can capture activity changes relative to an individual's baseline. We demonstrated that the trajectories differ across surgery types, recapitulate the documented effect of age on functional recovery, and highlight differences in relative activity change across self-reported recovery time groups. Finally, using a sub-cohort of 127 individuals, we showed that long-term recovery can be accurately predicted, on an individual level, only 1 month after surgery (AUROC 0.734, AUPRC 0.8). Furthermore, we showed that predictions are most accurate when long-term, individual baseline data are available.</p><p><strong>Discussion: </strong>Leveraging long-term, passively collected wearable data promises to enable relative assessment of individual recovery and is a first step towards data-driven intervention for individuals.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"4 Suppl 1","pages":"73-86"},"PeriodicalIF":0.0,"publicationDate":"2020-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1159/000511531","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38817167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-11-26eCollection Date: 2020-01-01DOI: 10.1159/000512044
Alison Keogh, William Johnston, Mitchell Ashton, Niladri Sett, Ronan Mullan, Seamas Donnelly, Jonas F Dorn, Francesc Calvo, Brian Mac Namee, Brian Caulfield
Background: Data derived from wearable activity trackers may provide important clinical insights into disease progression and response to intervention, but only if clinicians can interpret it in a meaningful manner. Longitudinal activity data can be visually presented in multiple ways, but research has failed to explore how clinicians interact with and interpret these visualisations. In response, this study developed a variety of visualisations to understand whether alternative data presentation strategies can provide clinicians with meaningful insights into patient's physical activity patterns.
Objective: To explore clinicians' opinions on different visualisations of actigraphy data.
Methods: Four visualisations (stacked bar chart, clustered bar chart, linear heatmap and radial heatmap) were created using Matplotlib and Seaborn Python libraries. A focus group was conducted with 14 clinicians across 2 hospitals. Focus groups were audio-recorded, transcribed and analysed using inductive thematic analysis.
Results: Three major themes were identified: (1) the importance of context, (2) interpreting the visualisations and (3) applying visualisations to clinical practice. Although clinicians saw the potential value in the visualisations, they expressed a need for further contextual information to gain clinical benefits from them. Allied health professionals preferred more granular, temporal information compared to doctors. Specifically, physiotherapists favoured heatmaps, whereas the remaining members of the team favoured stacked bar charts. Overall, heatmaps were considered more difficult to interpret.
Conclusion: The current lack of contextual data provided by wearables hampers their use in clinical practice. Clinicians favour data presented in a familiar format and yet desire multi-faceted filtering. Future research should implement user-centred design processes to identify ways in which all clinical needs can be met, potentially using an interactive system that caters for multiple levels of granularity. Irrespective of how data is displayed, unless clinicians can apply it in a manner that best supports their role, the potential of this data cannot be fully realised.
{"title":"\"It's Not as Simple as Just Looking at One Chart\": A Qualitative Study Exploring Clinician's Opinions on Various Visualisation Strategies to Represent Longitudinal Actigraphy Data.","authors":"Alison Keogh, William Johnston, Mitchell Ashton, Niladri Sett, Ronan Mullan, Seamas Donnelly, Jonas F Dorn, Francesc Calvo, Brian Mac Namee, Brian Caulfield","doi":"10.1159/000512044","DOIUrl":"https://doi.org/10.1159/000512044","url":null,"abstract":"<p><strong>Background: </strong>Data derived from wearable activity trackers may provide important clinical insights into disease progression and response to intervention, but only if clinicians can interpret it in a meaningful manner. Longitudinal activity data can be visually presented in multiple ways, but research has failed to explore how clinicians interact with and interpret these visualisations. In response, this study developed a variety of visualisations to understand whether alternative data presentation strategies can provide clinicians with meaningful insights into patient's physical activity patterns.</p><p><strong>Objective: </strong>To explore clinicians' opinions on different visualisations of actigraphy data.</p><p><strong>Methods: </strong>Four visualisations (stacked bar chart, clustered bar chart, linear heatmap and radial heatmap) were created using Matplotlib and Seaborn Python libraries. A focus group was conducted with 14 clinicians across 2 hospitals. Focus groups were audio-recorded, transcribed and analysed using inductive thematic analysis.</p><p><strong>Results: </strong>Three major themes were identified: (1) the importance of context, (2) interpreting the visualisations and (3) applying visualisations to clinical practice. Although clinicians saw the potential value in the visualisations, they expressed a need for further contextual information to gain clinical benefits from them. Allied health professionals preferred more granular, temporal information compared to doctors. Specifically, physiotherapists favoured heatmaps, whereas the remaining members of the team favoured stacked bar charts. Overall, heatmaps were considered more difficult to interpret.</p><p><strong>Conclusion: </strong>The current lack of contextual data provided by wearables hampers their use in clinical practice. Clinicians favour data presented in a familiar format and yet desire multi-faceted filtering. Future research should implement user-centred design processes to identify ways in which all clinical needs can be met, potentially using an interactive system that caters for multiple levels of granularity. Irrespective of how data is displayed, unless clinicians can apply it in a manner that best supports their role, the potential of this data cannot be fully realised.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"4 Suppl 1","pages":"87-99"},"PeriodicalIF":0.0,"publicationDate":"2020-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1159/000512044","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38817168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}