首页 > 最新文献

Digital Biomarkers最新文献

英文 中文
Considerations for Analyzing and Interpreting Data from Biometric Monitoring Technologies in Clinical Trials. 临床试验中生物特征监测技术数据分析和解释的考虑。
Q1 Computer Science Pub Date : 2022-08-29 eCollection Date: 2022-09-01 DOI: 10.1159/000525897
Bohdana Ratitch, Isaac R Rodriguez-Chavez, Abhishek Dabral, Adriano Fontanari, Julio Vega, Francesco Onorati, Benjamin Vandendriessche, Stuart Morton, Yasaman Damestani

Background: The proliferation and increasing maturity of biometric monitoring technologies allow clinical investigators to measure the health status of trial participants in a more holistic manner, especially outside of traditional clinical settings. This includes capturing meaningful aspects of health in daily living and a more granular and objective manner compared to traditional tools in clinical settings.

Summary: Within multidisciplinary teams, statisticians and data scientists are increasingly involved in clinical trials that incorporate digital clinical measures. They are called upon to provide input into trial planning, generation of evidence on the clinical validity of novel clinical measures, and evaluation of the adequacy of existing evidence. Analysis objectives related to demonstrating clinical validity of novel clinical measures differ from typical objectives related to demonstrating safety and efficacy of therapeutic interventions using established measures which statisticians are most familiar with.

Key messages: This paper discusses key considerations for generating evidence for clinical validity through the lens of the type and intended use of a clinical measure. This paper also briefly discusses the regulatory pathways through which clinical validity evidence may be reviewed and highlights challenges that investigators may encounter while dealing with data from biometric monitoring technologies.

背景:生物识别监测技术的发展和日益成熟使临床研究人员能够以更全面的方式测量试验参与者的健康状况,特别是在传统临床环境之外。这包括在日常生活中捕捉健康的有意义的方面,以及与临床环境中的传统工具相比,更细致和客观的方式。摘要:在多学科团队中,统计学家和数据科学家越来越多地参与到包含数字临床测量的临床试验中。他们被要求为试验计划、新临床措施的临床有效性证据的产生以及现有证据的充分性评估提供投入。与证明新型临床措施的临床有效性相关的分析目标不同于与使用统计学家最熟悉的既定措施证明治疗干预措施的安全性和有效性相关的典型目标。关键信息:本文通过临床测量的类型和预期用途的镜头讨论了产生临床有效性证据的关键考虑因素。本文还简要讨论了临床有效性证据可能被审查的监管途径,并强调了研究人员在处理生物识别监测技术数据时可能遇到的挑战。
{"title":"Considerations for Analyzing and Interpreting Data from Biometric Monitoring Technologies in Clinical Trials.","authors":"Bohdana Ratitch,&nbsp;Isaac R Rodriguez-Chavez,&nbsp;Abhishek Dabral,&nbsp;Adriano Fontanari,&nbsp;Julio Vega,&nbsp;Francesco Onorati,&nbsp;Benjamin Vandendriessche,&nbsp;Stuart Morton,&nbsp;Yasaman Damestani","doi":"10.1159/000525897","DOIUrl":"https://doi.org/10.1159/000525897","url":null,"abstract":"<p><strong>Background: </strong>The proliferation and increasing maturity of biometric monitoring technologies allow clinical investigators to measure the health status of trial participants in a more holistic manner, especially outside of traditional clinical settings. This includes capturing meaningful aspects of health in daily living and a more granular and objective manner compared to traditional tools in clinical settings.</p><p><strong>Summary: </strong>Within multidisciplinary teams, statisticians and data scientists are increasingly involved in clinical trials that incorporate digital clinical measures. They are called upon to provide input into trial planning, generation of evidence on the clinical validity of novel clinical measures, and evaluation of the adequacy of existing evidence. Analysis objectives related to demonstrating clinical validity of novel clinical measures differ from typical objectives related to demonstrating safety and efficacy of therapeutic interventions using established measures which statisticians are most familiar with.</p><p><strong>Key messages: </strong>This paper discusses key considerations for generating evidence for clinical validity through the lens of the type and intended use of a clinical measure. This paper also briefly discusses the regulatory pathways through which clinical validity evidence may be reviewed and highlights challenges that investigators may encounter while dealing with data from biometric monitoring technologies.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"6 3","pages":"83-97"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/62/9e/dib-0006-0083.PMC9716191.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35345247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Reliability of Automatic Computer Vision-Based Assessment of Orofacial Kinematics for Telehealth Applications. 远程医疗应用中基于计算机视觉的口面部运动学自动评估的可靠性。
Q1 Computer Science Pub Date : 2022-07-21 eCollection Date: 2022-01-01 DOI: 10.1159/000525698
Leif Simmatis, Carolina Barnett, Reeman Marzouqah, Babak Taati, Mark Boulos, Yana Yunusova

Introduction: Telehealth/remote assessment using readily available 2D mobile cameras and deep learning-based analyses is rapidly becoming a viable option for detecting orofacial and speech impairments associated with neurological and neurodegenerative disease during telehealth practice. However, the psychometric properties (e.g., internal consistency and reliability) of kinematics obtained from these systems have not been established, which is a crucial next step before their clinical usability is established.

Methods: Participants were assessed in lab using a 3 dimensional (3D)-capable camera and at home using a readily-available 2D camera in a tablet. Orofacial kinematics was estimated from videos using a deep facial landmark tracking model. Kinematic features quantified the clinically relevant constructs of velocity, range of motion, and lateralization. In lab, all participants performed the same oromotor task. At home, participants were split into two groups that each performed a variant of the in-lab task. We quantified within-assessment consistency (Cronbach's α), reliability (intraclass correlation coefficient [ICC]), and fitted linear mixed-effects models to at-home data to capture individual-/task-dependent longitudinal trajectories.

Results: Both in lab and at home, Cronbach's α was typically high (>0.80) and ICCs were often good (>0.70). The linear mixed-effect models that best fit the longitudinal data were those that accounted for individual- or task-dependent effects.

Discussion: Remotely gathered orofacial kinematics were as internally consistent and reliable as those gathered in a controlled laboratory setting using a high-performance 3D-capable camera and could additionally capture individual- or task-dependent changes over time. These results highlight the potential of remote assessment tools as digital biomarkers of disease status and progression and demonstrate their suitability for novel telehealth applications.

简介:远程医疗/远程评估使用现成的二维移动相机和基于深度学习的分析正在迅速成为一种可行的选择,用于检测远程医疗实践中与神经和神经退行性疾病相关的口面部和语言障碍。然而,从这些系统中获得的运动学的心理测量特性(例如,内部一致性和可靠性)尚未建立,这是建立其临床可用性之前的关键下一步。方法:参与者在实验室使用三维(3D)相机进行评估,在家中使用平板电脑中现成的2D相机进行评估。使用深度面部标记跟踪模型从视频中估计口面部运动学。运动学特征量化了临床相关的速度、活动范围和侧化结构。在实验室里,所有的参与者都完成了相同的运动任务。在家里,参与者被分成两组,每组执行实验室任务的一个变体。我们量化了评估内一致性(Cronbach’s α)、可靠性(类内相关系数[ICC]),并将线性混合效应模型拟合到家庭数据中,以捕捉个体/任务相关的纵向轨迹。结果:在实验室和家中,Cronbach's α通常高(>0.80),ICCs通常好(>0.70)。最适合纵向数据的线性混合效应模型是那些考虑到个体或任务依赖效应的模型。讨论:远程收集的面部运动学数据与使用高性能3d相机在受控实验室环境中收集的数据一样内部一致和可靠,并且可以随着时间的推移额外捕获个体或任务相关的变化。这些结果突出了远程评估工具作为疾病状态和进展的数字生物标志物的潜力,并证明了它们对新型远程医疗应用的适用性。
{"title":"Reliability of Automatic Computer Vision-Based Assessment of Orofacial Kinematics for Telehealth Applications.","authors":"Leif Simmatis,&nbsp;Carolina Barnett,&nbsp;Reeman Marzouqah,&nbsp;Babak Taati,&nbsp;Mark Boulos,&nbsp;Yana Yunusova","doi":"10.1159/000525698","DOIUrl":"https://doi.org/10.1159/000525698","url":null,"abstract":"<p><strong>Introduction: </strong>Telehealth/remote assessment using readily available 2D mobile cameras and deep learning-based analyses is rapidly becoming a viable option for detecting orofacial and speech impairments associated with neurological and neurodegenerative disease during telehealth practice. However, the psychometric properties (e.g., internal consistency and reliability) of kinematics obtained from these systems have not been established, which is a crucial next step before their clinical usability is established.</p><p><strong>Methods: </strong>Participants were assessed in lab using a 3 dimensional (3D)-capable camera and at home using a readily-available 2D camera in a tablet. Orofacial kinematics was estimated from videos using a deep facial landmark tracking model. Kinematic features quantified the clinically relevant constructs of velocity, range of motion, and lateralization. In lab, all participants performed the same oromotor task. At home, participants were split into two groups that each performed a variant of the in-lab task. We quantified within-assessment consistency (Cronbach's α), reliability (intraclass correlation coefficient [ICC]), and fitted linear mixed-effects models to at-home data to capture individual-/task-dependent longitudinal trajectories.</p><p><strong>Results: </strong>Both in lab and at home, Cronbach's α was typically high (>0.80) and ICCs were often good (>0.70). The linear mixed-effect models that best fit the longitudinal data were those that accounted for individual- or task-dependent effects.</p><p><strong>Discussion: </strong>Remotely gathered orofacial kinematics were as internally consistent and reliable as those gathered in a controlled laboratory setting using a high-performance 3D-capable camera and could additionally capture individual- or task-dependent changes over time. These results highlight the potential of remote assessment tools as digital biomarkers of disease status and progression and demonstrate their suitability for novel telehealth applications.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"6 2","pages":"71-82"},"PeriodicalIF":0.0,"publicationDate":"2022-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/c1/96/dib-0006-0071.PMC9574208.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40644965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Considerations for Conducting Bring Your Own "Device" (BYOD) Clinical Studies. 进行自带“设备”(BYOD)临床研究的考虑。
Q1 Computer Science Pub Date : 2022-07-04 eCollection Date: 2022-05-01 DOI: 10.1159/000525080
Charmaine Demanuele, Cynthia Lokker, Krishna Jhaveri, Pirinka Georgiev, Emre Sezgin, Cindy Geoghegan, Kelly H Zou, Elena Izmailova, Marie McCarthy

Background: Digital health technologies are attracting attention as novel tools for data collection in clinical research. They present alternative methods compared to in-clinic data collection, which often yields snapshots of the participants' physiology, behavior, and function that may be prone to biases and artifacts, e.g., white coat hypertension, and not representative of the data in free-living conditions. Modern digital health technologies equipped with multi-modal sensors combine different data streams to derive comprehensive endpoints that are important to study participants and are clinically meaningful. Used for data collection in clinical trials, they can be deployed as provisioned products where technology is given at study start or in a bring your own "device" (BYOD) manner where participants use their technologies to generate study data.

Summary: The BYOD option has the potential to be more user-friendly, allowing participants to use technologies that they are familiar with, ensuring better participant compliance, and potentially reducing the bias that comes with introducing new technologies. However, this approach presents different technical, operational, regulatory, and ethical challenges to study teams. For example, BYOD data can be more heterogeneous, and recruiting historically underrepresented populations with limited access to technology and the internet can be challenging. Despite the rapid increase in digital health technologies for clinical and healthcare research, BYOD use in clinical trials is limited, and regulatory guidance is still evolving.

Key messages: We offer considerations for academic researchers, drug developers, and patient advocacy organizations on the design and deployment of BYOD models in clinical research. These considerations address: (1) early identification and engagement with internal and external stakeholders; (2) study design including informed consent and recruitment strategies; (3) outcome, endpoint, and technology selection; (4) data management including compliance and data monitoring; (5) statistical considerations to meet regulatory requirements. We believe that this article acts as a primer, providing insights into study design and operational requirements to ensure the successful implementation of BYOD clinical studies.

背景:数字健康技术作为临床研究中数据收集的新工具正引起人们的关注。他们提出了与临床数据收集相比的替代方法,临床数据收集通常产生参与者的生理,行为和功能快照,这可能容易产生偏差和人为因素,例如,白大褂高血压,并且不代表自由生活条件下的数据。配备多模态传感器的现代数字卫生技术将不同的数据流结合起来,得出对研究参与者很重要且具有临床意义的综合端点。用于临床试验中的数据收集,它们可以作为预先配置的产品部署,在研究开始时提供技术,或者以自带“设备”(BYOD)的方式部署,参与者使用他们的技术生成研究数据。总结:BYOD选项有可能更加用户友好,允许参与者使用他们熟悉的技术,确保参与者更好地遵守,并有可能减少引入新技术带来的偏见。然而,这种方法对研究团队提出了不同的技术、操作、管理和伦理挑战。例如,BYOD数据可能更加异构,并且招募历史上代表性不足的人口,这些人口使用技术和互联网的机会有限,可能具有挑战性。尽管用于临床和医疗保健研究的数字健康技术快速增长,但BYOD在临床试验中的使用有限,监管指导仍在不断发展。关键信息:我们为学术研究人员、药物开发人员和患者倡导组织提供了在临床研究中设计和部署BYOD模式的考虑。这些考虑涉及:(1)早期识别和参与内部和外部利益相关者;(2)研究设计,包括知情同意和招募策略;(3)结局、终点和技术选择;(4)数据管理,包括合规和数据监控;(5)符合监管要求的统计考虑。我们相信这篇文章可以作为一个引子,为研究设计和操作要求提供见解,以确保BYOD临床研究的成功实施。
{"title":"Considerations for Conducting Bring Your Own \"Device\" (BYOD) Clinical Studies.","authors":"Charmaine Demanuele,&nbsp;Cynthia Lokker,&nbsp;Krishna Jhaveri,&nbsp;Pirinka Georgiev,&nbsp;Emre Sezgin,&nbsp;Cindy Geoghegan,&nbsp;Kelly H Zou,&nbsp;Elena Izmailova,&nbsp;Marie McCarthy","doi":"10.1159/000525080","DOIUrl":"https://doi.org/10.1159/000525080","url":null,"abstract":"<p><strong>Background: </strong>Digital health technologies are attracting attention as novel tools for data collection in clinical research. They present alternative methods compared to in-clinic data collection, which often yields snapshots of the participants' physiology, behavior, and function that may be prone to biases and artifacts, e.g., white coat hypertension, and not representative of the data in free-living conditions. Modern digital health technologies equipped with multi-modal sensors combine different data streams to derive comprehensive endpoints that are important to study participants and are clinically meaningful. Used for data collection in clinical trials, they can be deployed as provisioned products where technology is given at study start or in a bring your own \"device\" (BYOD) manner where participants use their technologies to generate study data.</p><p><strong>Summary: </strong>The BYOD option has the potential to be more user-friendly, allowing participants to use technologies that they are familiar with, ensuring better participant compliance, and potentially reducing the bias that comes with introducing new technologies. However, this approach presents different technical, operational, regulatory, and ethical challenges to study teams. For example, BYOD data can be more heterogeneous, and recruiting historically underrepresented populations with limited access to technology and the internet can be challenging. Despite the rapid increase in digital health technologies for clinical and healthcare research, BYOD use in clinical trials is limited, and regulatory guidance is still evolving.</p><p><strong>Key messages: </strong>We offer considerations for academic researchers, drug developers, and patient advocacy organizations on the design and deployment of BYOD models in clinical research. These considerations address: (1) early identification and engagement with internal and external stakeholders; (2) study design including informed consent and recruitment strategies; (3) outcome, endpoint, and technology selection; (4) data management including compliance and data monitoring; (5) statistical considerations to meet regulatory requirements. We believe that this article acts as a primer, providing insights into study design and operational requirements to ensure the successful implementation of BYOD clinical studies.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":" ","pages":"47-60"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/c6/02/dib-0006-0047.PMC9294934.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40616532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Quantifying the Benefits of Digital Biomarkers and Technology-Based Study Endpoints in Clinical Trials: Project Moneyball. 量化临床试验中数字生物标志物和基于技术的研究终点的益处:Moneyball项目。
Q1 Computer Science Pub Date : 2022-06-29 eCollection Date: 2022-05-01 DOI: 10.1159/000525255
Hiromasa Mori, Stig Johan Wiklund, Jason Yuren Zhang

Introduction: Digital biomarkers have significant potential to transform drug development, but only a few have contributed meaningfully to bring new treatments to market. There are uncertainties in how they will generate quantifiable benefits in clinical trial performance and ultimately to the chances of phase 3 success. Here we have proposed a statistical framework and ran a proof-of-concept model with hypothetical digital biomarkers and visualized them in a familiar manner to study power calculation.

Methods: A Monte Carlo simulation for Parkinson's disease (PD) was performed using the Captario SUM® platform and illustrative study technology impact calculations were generated. We took inspiration from the EMA-qualified wearable-derived digital endpoint stride velocity 95th centile (SV95C) for Duchenne muscular dystrophy, and we imagined a similar measurement for PD would be available in the future. DaTscan enrichment and "SV95C-like" endpoint biomarkers were assumed on a hypothetical disease-modifying drug pivotal trial aiming for an 80% probability of achieving a study p value of less than 0.05.

Results: Four scenarios with different combinations of technologies were illustrated. The model illustrated a way to quantify the magnitude of the contributions that enrichment and endpoint technologies could make to drug development studies.

Discussion/conclusion: Quantitative models could be valuable not only for the study sponsors but also as an interactive and collaborative engagement tool for technology players and multi-stakeholder consortia. Establishing values of digital biomarkers could also facilitate business cases and financial investments.

数字生物标志物具有改变药物开发的巨大潜力,但只有少数生物标志物为将新疗法推向市场做出了有意义的贡献。它们将如何在临床试验中产生可量化的效益,并最终在3期成功的机会方面存在不确定性。在这里,我们提出了一个统计框架,并运行了一个假设的数字生物标志物的概念验证模型,并以一种熟悉的方式将它们可视化,以研究功率计算。方法:使用Captario SUM®平台对帕金森病(PD)进行蒙特卡罗模拟,并生成说明性研究技术影响计算。我们从杜氏肌营养不良症(Duchenne muscular dystrophy)通过ema认证的可穿戴式数字终端跨步速度95百分位(SV95C)中获得灵感,并设想未来可以使用类似的PD测量方法。DaTscan富集和“sv95c样”终点生物标志物是在假设的疾病改善药物关键试验中假设的,目标是实现研究p值小于0.05的80%概率。结果:展示了四种不同技术组合的场景。该模型说明了一种量化富集和终点技术对药物开发研究的贡献程度的方法。讨论/结论:定量模型不仅对研究发起人有价值,而且对技术参与者和多利益相关者联盟来说,它是一种互动和协作的参与工具。建立数字生物标志物的价值也可以促进商业案例和金融投资。
{"title":"Quantifying the Benefits of Digital Biomarkers and Technology-Based Study Endpoints in Clinical Trials: Project Moneyball.","authors":"Hiromasa Mori,&nbsp;Stig Johan Wiklund,&nbsp;Jason Yuren Zhang","doi":"10.1159/000525255","DOIUrl":"https://doi.org/10.1159/000525255","url":null,"abstract":"<p><strong>Introduction: </strong>Digital biomarkers have significant potential to transform drug development, but only a few have contributed meaningfully to bring new treatments to market. There are uncertainties in how they will generate quantifiable benefits in clinical trial performance and ultimately to the chances of phase 3 success. Here we have proposed a statistical framework and ran a proof-of-concept model with hypothetical digital biomarkers and visualized them in a familiar manner to study power calculation.</p><p><strong>Methods: </strong>A Monte Carlo simulation for Parkinson's disease (PD) was performed using the Captario SUM® platform and illustrative study technology impact calculations were generated. We took inspiration from the EMA-qualified wearable-derived digital endpoint stride velocity 95<sup>th</sup> centile (SV95C) for Duchenne muscular dystrophy, and we imagined a similar measurement for PD would be available in the future. DaTscan enrichment and \"SV95C-like\" endpoint biomarkers were assumed on a hypothetical disease-modifying drug pivotal trial aiming for an 80% probability of achieving a study <i>p</i> value of less than 0.05.</p><p><strong>Results: </strong>Four scenarios with different combinations of technologies were illustrated. The model illustrated a way to quantify the magnitude of the contributions that enrichment and endpoint technologies could make to drug development studies.</p><p><strong>Discussion/conclusion: </strong>Quantitative models could be valuable not only for the study sponsors but also as an interactive and collaborative engagement tool for technology players and multi-stakeholder consortia. Establishing values of digital biomarkers could also facilitate business cases and financial investments.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":" ","pages":"36-46"},"PeriodicalIF":0.0,"publicationDate":"2022-06-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/6a/e0/dib-0006-0036.PMC9297703.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40616533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Dorsal Finger Fold Recognition by Convolutional Neural Networks for the Detection and Monitoring of Joint Swelling in Patients with Rheumatoid Arthritis. 基于卷积神经网络的指背识别在类风湿关节炎患者关节肿胀检测与监测中的应用。
Q1 Computer Science Pub Date : 2022-06-08 eCollection Date: 2022-05-01 DOI: 10.1159/000525061
Thomas Hügle, Leo Caratsch, Matteo Caorsi, Jules Maglione, Diana Dan, Alexandre Dumusc, Marc Blanchard, Gabriel Kalweit, Maria Kalweit

Digital biomarkers such as wearables are of increasing interest in monitoring rheumatic diseases, but they usually lack disease specificity. In this study, we apply convolutional neural networks (CNN) to real-world hand photographs in order to automatically detect, extract, and analyse dorsal finger fold lines as a correlate of proximal interphalangeal (PIP) joint swelling in patients with rheumatoid arthritis (RA). Hand photographs of RA patients were taken by a smartphone camera in a standardized manner. Overall, 190 PIP joints were categorized as either swollen or not swollen based on clinical judgement and ultrasound. Images were automatically preprocessed by cropping PIP joints and extracting dorsal finger folds. Subsequently, metrical analysis of dorsal finger folds was performed, and a CNN was trained to classify the dorsal finger lines into swollen versus non-swollen joints. Representative horizontal finger folds were also quantified in a subset of patients before and after resolution of PIP swelling and in patients with disease flares. In swollen joints, the number of automatically extracted deep skinfold imprints was significantly reduced compared to non-swollen joints (1.3, SD 0.8 vs. 3.3, SD 0.49, p < 0.01). The joint diameter/deep skinfold length ratio was significantly higher in swollen (4.1, SD 1.4) versus non-swollen joints (2.1, SD 0.6, p < 0.01). The CNN model successfully differentiated swollen from non-swollen joints based on finger fold patterns with a validation accuracy of 0.84, a sensitivity of 88%, and a specificity of 75%. A heatmap of the original images obtained by an extraction algorithm confirmed finger folds as the region of interest for correct classification. After significant response to disease-modifying antirheumatic drug ± corticosteroid therapy, longitudinal metrical analysis of eight representative deep finger folds showed a decrease in the mean diameter/finger fold length (finger fold index, FFI) from 3.03 (SD 0.68) to 2.08 (SD 0.57). Conversely, the FFI increased in patients with disease flares. In conclusion, automated preprocessing and the application of CNN algorithms in combination with longitudinal metrical analysis of dorsal finger fold patterns extracted from real-world hand photos might serve as a digital biomarker in RA.

可穿戴设备等数字生物标志物在监测风湿病方面越来越受关注,但它们通常缺乏疾病特异性。在这项研究中,我们将卷积神经网络(CNN)应用于现实世界的手部照片,以便自动检测、提取和分析类风湿关节炎(RA)患者近端指间关节肿胀与手指背襞线的相关性。采用智能手机相机对RA患者进行标准化的手拍。总体而言,根据临床判断和超声检查,190个PIP关节分为肿胀或不肿胀。通过裁剪PIP关节和提取手指背襞对图像进行自动预处理。随后,对手指背襞进行测量分析,并训练CNN将手指背线分为肿胀关节和非肿胀关节。在PIP肿胀消退前后和疾病发作患者的一个亚组中,代表性的水平指襞也被量化。在肿胀关节中,与非肿胀关节相比,自动提取的深度皮褶印迹数量显著减少(1.3,SD 0.8 vs. 3.3, SD 0.49, p < 0.01)。肿胀的关节直径/深皮褶长度比(4.1,SD 1.4)明显高于非肿胀的关节(2.1,SD 0.6, p < 0.01)。CNN模型基于手指褶皱模式成功区分了肿胀和非肿胀关节,验证准确率为0.84,灵敏度为88%,特异性为75%。通过提取算法获得的原始图像热图确认手指褶皱是正确分类的兴趣区域。在接受抗风湿药物治疗和皮质类固醇治疗后,8个具有代表性的深指沟纵向测量分析显示,平均直径/指沟长度(指沟指数,FFI)从3.03 (SD 0.68)下降到2.08 (SD 0.57)。相反,疾病发作患者的FFI增加。综上所述,自动预处理和应用CNN算法结合对真实手照中提取的指背褶皱进行纵向测量分析,可能作为RA的数字生物标志物。
{"title":"Dorsal Finger Fold Recognition by Convolutional Neural Networks for the Detection and Monitoring of Joint Swelling in Patients with Rheumatoid Arthritis.","authors":"Thomas Hügle,&nbsp;Leo Caratsch,&nbsp;Matteo Caorsi,&nbsp;Jules Maglione,&nbsp;Diana Dan,&nbsp;Alexandre Dumusc,&nbsp;Marc Blanchard,&nbsp;Gabriel Kalweit,&nbsp;Maria Kalweit","doi":"10.1159/000525061","DOIUrl":"https://doi.org/10.1159/000525061","url":null,"abstract":"<p><p>Digital biomarkers such as wearables are of increasing interest in monitoring rheumatic diseases, but they usually lack disease specificity. In this study, we apply convolutional neural networks (CNN) to real-world hand photographs in order to automatically detect, extract, and analyse dorsal finger fold lines as a correlate of proximal interphalangeal (PIP) joint swelling in patients with rheumatoid arthritis (RA). Hand photographs of RA patients were taken by a smartphone camera in a standardized manner. Overall, 190 PIP joints were categorized as either swollen or not swollen based on clinical judgement and ultrasound. Images were automatically preprocessed by cropping PIP joints and extracting dorsal finger folds. Subsequently, metrical analysis of dorsal finger folds was performed, and a CNN was trained to classify the dorsal finger lines into swollen versus non-swollen joints. Representative horizontal finger folds were also quantified in a subset of patients before and after resolution of PIP swelling and in patients with disease flares. In swollen joints, the number of automatically extracted deep skinfold imprints was significantly reduced compared to non-swollen joints (1.3, SD 0.8 vs. 3.3, SD 0.49, <i>p</i> < 0.01). The joint diameter/deep skinfold length ratio was significantly higher in swollen (4.1, SD 1.4) versus non-swollen joints (2.1, SD 0.6, <i>p</i> < 0.01). The CNN model successfully differentiated swollen from non-swollen joints based on finger fold patterns with a validation accuracy of 0.84, a sensitivity of 88%, and a specificity of 75%. A heatmap of the original images obtained by an extraction algorithm confirmed finger folds as the region of interest for correct classification. After significant response to disease-modifying antirheumatic drug ± corticosteroid therapy, longitudinal metrical analysis of eight representative deep finger folds showed a decrease in the mean diameter/finger fold length (finger fold index, FFI) from 3.03 (SD 0.68) to 2.08 (SD 0.57). Conversely, the FFI increased in patients with disease flares. In conclusion, automated preprocessing and the application of CNN algorithms in combination with longitudinal metrical analysis of dorsal finger fold patterns extracted from real-world hand photos might serve as a digital biomarker in RA.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":" ","pages":"31-35"},"PeriodicalIF":0.0,"publicationDate":"2022-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9247561/pdf/dib-0006-0031.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40616536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Smartphone-Based Gait Cadence to Identify Older Adults with Decreased Functional Capacity. 基于智能手机的步态节奏识别功能下降的老年人。
Q1 Computer Science Pub Date : 2022-05-01 DOI: 10.1159/000525344
Daniel S Rubin, Sylvia L Ranjeva, Jacek K Urbanek, Marta Karas, Maria Lucia L Madariaga, Megan Huisingh-Scheetz

Background: Functional capacity assessment is a critical step in the preoperative evaluation to identify patients at increased risk of cardiac complications and disability after major noncardiac surgery. Smartphones offer the potential to objectively measure functional capacity but are limited by inaccuracy in patients with poor functional capacity. Open-source methods exist to analyze accelerometer data to estimate gait cadence (steps/min), which is directly associated with activity intensity. Here, we used an updated Step Test smartphone application with an open-source method to analyze accelerometer data to estimate gait cadence and functional capacity in older adults.

Methods: We performed a prospective observational cohort study within the Frailty, Activity, Body Composition and Energy Expenditure in Aging study at the University of Chicago. Participants completed the Duke Activity Status Index (DASI) and performed an in-clinic 6-min walk test (6MWT) while using the Step Test application on a study smartphone. Gait cadence was measured from the raw accelerometer data using an adaptive empirical pattern transformation method, which has been previously validated. A 6MWT distance of 370 m was used as an objective threshold to identify patients at high risk. We performed multivariable logistic regression to predict walking distance using a priori explanatory variables.

Results: Sixty patients were enrolled in the study. Thirty-seven patients completed the protocol and were included in the final data analysis. The median (IQR) age of the overall cohort was 71 (69-74) years, with a body mass index of 31 (27-32). There were no differences in any clinical characteristics or functional measures between participants that were able to walk 370 m during the 6MWT and those that could not walk that distance. Median (IQR) gait cadence for the entire cohort was 110 (102-114) steps/min during the 6MWT. Median (IQR) gait cadence was higher in participants that walked more than 370 m during the 6MWT 112 (108-118) versus 106 (96-114) steps/min; p = 0.0157). The final multivariable model to identify participants that could not walk 370 m included only median gait cadence. The Youden's index cut-point was 107 steps/min with a sensitivity of 0.81 (95% CI: 0.77, 0.85) and a specificity of 0.57 (95% CI: 0.55, 0.59) and an AUCROC of 0.69 (95% CI: 0.51, 0.87).

Conclusions: Our pilot study demonstrates the feasibility of using gait cadence as a measure to estimate functional capacity. Our study was limited by a smaller than expected sample size due to COVID-19, and thus, a prospective study with preoperative patients that measures outcomes is necessary to validate our findings.

背景:功能容量评估是术前评估的关键步骤,用于识别重大非心脏手术后心脏并发症和残疾风险增加的患者。智能手机提供了客观测量功能能力的潜力,但由于功能能力差的患者的不准确性而受到限制。已有开源方法分析加速度计数据以估计与活动强度直接相关的步态节奏(步数/分钟)。在这里,我们使用了更新的Step Test智能手机应用程序和开源方法来分析加速度计数据,以估计老年人的步态节奏和功能能力。方法:我们在芝加哥大学的衰老研究中进行了一项前瞻性观察队列研究,包括虚弱、活动、身体组成和能量消耗。参与者完成了杜克活动状态指数(DASI),并在使用研究智能手机上的步骤测试应用程序时进行了临床6分钟步行测试(6MWT)。从原始加速度计数据中使用自适应经验模式变换方法测量步态节奏,该方法先前已得到验证。以6MWT距离370 m作为识别高危患者的客观阈值。我们使用先验解释变量进行多变量逻辑回归来预测步行距离。结果:60例患者入组研究。37例患者完成了方案,并被纳入最终数据分析。整个队列的中位(IQR)年龄为71(69-74)岁,体重指数为31(27-32)。在6MWT期间能够行走370米的参与者和不能行走370米的参与者之间的任何临床特征或功能测量没有差异。在6MWT期间,整个队列的中位步频(IQR)为110(102-114)步/分钟。在6MWT期间,行走超过370米的参与者的中位步频(IQR)更高,为112(108-118)步/分钟,而106(96-114)步/分钟;P = 0.0157)。最后的多变量模型用于识别不能步行370米的参与者,仅包括中位步速。约登指数切割点为107步/分钟,敏感性为0.81 (95% CI: 0.77, 0.85),特异性为0.57 (95% CI: 0.55, 0.59), AUCROC为0.69 (95% CI: 0.51, 0.87)。结论:我们的初步研究证明了使用步态节奏作为评估功能能力的方法的可行性。由于COVID-19的原因,我们的研究样本量小于预期,因此,有必要对术前患者进行前瞻性研究,以测量结果,以验证我们的发现。
{"title":"Smartphone-Based Gait Cadence to Identify Older Adults with Decreased Functional Capacity.","authors":"Daniel S Rubin,&nbsp;Sylvia L Ranjeva,&nbsp;Jacek K Urbanek,&nbsp;Marta Karas,&nbsp;Maria Lucia L Madariaga,&nbsp;Megan Huisingh-Scheetz","doi":"10.1159/000525344","DOIUrl":"https://doi.org/10.1159/000525344","url":null,"abstract":"<p><strong>Background: </strong>Functional capacity assessment is a critical step in the preoperative evaluation to identify patients at increased risk of cardiac complications and disability after major noncardiac surgery. Smartphones offer the potential to objectively measure functional capacity but are limited by inaccuracy in patients with poor functional capacity. Open-source methods exist to analyze accelerometer data to estimate gait cadence (steps/min), which is directly associated with activity intensity. Here, we used an updated Step Test smartphone application with an open-source method to analyze accelerometer data to estimate gait cadence and functional capacity in older adults.</p><p><strong>Methods: </strong>We performed a prospective observational cohort study within the Frailty, Activity, Body Composition and Energy Expenditure in Aging study at the University of Chicago. Participants completed the Duke Activity Status Index (DASI) and performed an in-clinic 6-min walk test (6MWT) while using the Step Test application on a study smartphone. Gait cadence was measured from the raw accelerometer data using an adaptive empirical pattern transformation method, which has been previously validated. A 6MWT distance of 370 m was used as an objective threshold to identify patients at high risk. We performed multivariable logistic regression to predict walking distance using a priori explanatory variables.</p><p><strong>Results: </strong>Sixty patients were enrolled in the study. Thirty-seven patients completed the protocol and were included in the final data analysis. The median (IQR) age of the overall cohort was 71 (69-74) years, with a body mass index of 31 (27-32). There were no differences in any clinical characteristics or functional measures between participants that were able to walk 370 m during the 6MWT and those that could not walk that distance. Median (IQR) gait cadence for the entire cohort was 110 (102-114) steps/min during the 6MWT. Median (IQR) gait cadence was higher in participants that walked more than 370 m during the 6MWT 112 (108-118) versus 106 (96-114) steps/min; <i>p</i> = 0.0157). The final multivariable model to identify participants that could not walk 370 m included only median gait cadence. The Youden's index cut-point was 107 steps/min with a sensitivity of 0.81 (95% CI: 0.77, 0.85) and a specificity of 0.57 (95% CI: 0.55, 0.59) and an AUCROC of 0.69 (95% CI: 0.51, 0.87).</p><p><strong>Conclusions: </strong>Our pilot study demonstrates the feasibility of using gait cadence as a measure to estimate functional capacity. Our study was limited by a smaller than expected sample size due to COVID-19, and thus, a prospective study with preoperative patients that measures outcomes is necessary to validate our findings.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"6 2","pages":"61-70"},"PeriodicalIF":0.0,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/3a/3b/dib-0006-0061.PMC9386413.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10401207","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Objective Home-Monitoring of Physical Activity, Cardiovascular Parameters, and Sleep in Pediatric Obesity. 目的对儿童肥胖患者的身体活动、心血管参数和睡眠进行家庭监测。
Q1 Computer Science Pub Date : 2022-03-31 eCollection Date: 2022-01-01 DOI: 10.1159/000522185
Janine M Knijff, Euphemia C A M Houdijk, Daniëlle C M van der Kaay, Youri van Berkel, Luc Filippini, Frederik E Stuurman, Adam F Cohen, Gertjan J A Driessen, Matthijs D Kruizinga

Introduction: Clinical research and treatment of childhood obesity is challenging, and objective biomarkers obtained in a home-setting are needed. The aim of this study was to determine the potential of novel digital endpoints gathered by a home-monitoring platform in pediatric obesity.

Methods: In this prospective observational study, 28 children with obesity aged 6-16 years were included and monitored for 28 days. Patients wore a smartwatch, which measured physical activity (PA), heart rate (HR), and sleep. Furthermore, daily blood pressure (BP) measurements were performed. Data from 128 healthy children were utilized for comparison. Differences between patients and controls were assessed via linear mixed effect models.

Results: Data from 28 patients (average age 11.6 years, 46% male, average body mass index 30.9) and 128 controls (average age 11.1 years, 46% male, average body mass index 18.0) were analyzed. Patients were recruited between November 2018 and February 2020. For patients, the median compliance for the measurements ranged from 55% to 100% and the highest median compliance was observed for the smartwatch-related measurements (81-100%). Patients had a lower daily PA level (4,597 steps vs. 6,081 steps, 95% confidence interval [CI] 862-2,108) and peak PA level (1,115 steps vs. 1,392 steps, 95% CI 136-417), a higher nighttime HR (81 bpm vs. 71 bpm, 95% CI 6.3-12.3) and daytime HR (98 bpm vs. 88 bpm, 95% CI 7.6-12.6), a higher systolic BP (115 mm Hg vs. 104 mm Hg, 95% CI 8.1-14.5) and diastolic BP (76 mm Hg vs. 65 mm Hg, 95% CI 8.7-12.7), and a shorter sleep duration (difference 0.5 h, 95% CI 0.2-0.7) compared to controls.

Conclusion: Remote monitoring via wearables in pediatric obesity has the potential to objectively measure the disease burden in the home-setting. The novel endpoints demonstrate significant differences in PA level, HR, BP, and sleep duration between patients and controls. Future studies are needed to determine the capacity of the novel digital endpoints to detect effect of interventions.

儿童肥胖的临床研究和治疗具有挑战性,需要在家庭环境中获得客观的生物标志物。本研究的目的是确定由家庭监测平台收集的新型数字终点在儿童肥胖中的潜力。方法:在这项前瞻性观察研究中,纳入了28名6-16岁的肥胖儿童,并对其进行了28天的监测。患者戴着智能手表,测量身体活动(PA)、心率(HR)和睡眠。此外,还进行了每日血压(BP)测量。来自128名健康儿童的数据用于比较。通过线性混合效应模型评估患者和对照组之间的差异。结果:分析了28例患者(平均年龄11.6岁,男性46%,平均体重指数30.9)和128例对照组(平均年龄11.1岁,男性46%,平均体重指数18.0)的资料。患者是在2018年11月至2020年2月期间招募的。对于患者,测量的中位依从性范围为55%至100%,与智能手表相关的测量中位依从性最高(81-100%)。患者每日PA水平较低(vs 6081步、4597步95%可信区间[CI] 862 - 2108年)和峰值PA水平(vs 1392步、1115步95%可信区间136 - 417),一个更高的夜间人力资源(81 bpm vs 71 bpm, 95%可信区间6.3 - -12.3)和白天的人力资源(98 bpm vs 88 bpm, 95%可信区间7.6 - -12.6),较高的收缩压(115毫米汞柱和104毫米汞柱,95%可信区间8.1 - -14.5)和舒张压(76毫米汞柱和65毫米汞柱,95%可信区间8.7 - -12.7),和更短的睡眠时间(差异0.5 h, 95%置信区间0.2 - -0.7)相比,控制。结论:通过可穿戴设备对儿童肥胖进行远程监测,有可能客观地衡量家庭环境中的疾病负担。新的终点表明,患者和对照组之间的PA水平、HR、BP和睡眠时间存在显著差异。未来的研究需要确定新型数字端点检测干预措施效果的能力。
{"title":"Objective Home-Monitoring of Physical Activity, Cardiovascular Parameters, and Sleep in Pediatric Obesity.","authors":"Janine M Knijff,&nbsp;Euphemia C A M Houdijk,&nbsp;Daniëlle C M van der Kaay,&nbsp;Youri van Berkel,&nbsp;Luc Filippini,&nbsp;Frederik E Stuurman,&nbsp;Adam F Cohen,&nbsp;Gertjan J A Driessen,&nbsp;Matthijs D Kruizinga","doi":"10.1159/000522185","DOIUrl":"https://doi.org/10.1159/000522185","url":null,"abstract":"<p><strong>Introduction: </strong>Clinical research and treatment of childhood obesity is challenging, and objective biomarkers obtained in a home-setting are needed. The aim of this study was to determine the potential of novel digital endpoints gathered by a home-monitoring platform in pediatric obesity.</p><p><strong>Methods: </strong>In this prospective observational study, 28 children with obesity aged 6-16 years were included and monitored for 28 days. Patients wore a smartwatch, which measured physical activity (PA), heart rate (HR), and sleep. Furthermore, daily blood pressure (BP) measurements were performed. Data from 128 healthy children were utilized for comparison. Differences between patients and controls were assessed via linear mixed effect models.</p><p><strong>Results: </strong>Data from 28 patients (average age 11.6 years, 46% male, average body mass index 30.9) and 128 controls (average age 11.1 years, 46% male, average body mass index 18.0) were analyzed. Patients were recruited between November 2018 and February 2020. For patients, the median compliance for the measurements ranged from 55% to 100% and the highest median compliance was observed for the smartwatch-related measurements (81-100%). Patients had a lower daily PA level (4,597 steps vs. 6,081 steps, 95% confidence interval [CI] 862-2,108) and peak PA level (1,115 steps vs. 1,392 steps, 95% CI 136-417), a higher nighttime HR (81 bpm vs. 71 bpm, 95% CI 6.3-12.3) and daytime HR (98 bpm vs. 88 bpm, 95% CI 7.6-12.6), a higher systolic BP (115 mm Hg vs. 104 mm Hg, 95% CI 8.1-14.5) and diastolic BP (76 mm Hg vs. 65 mm Hg, 95% CI 8.7-12.7), and a shorter sleep duration (difference 0.5 h, 95% CI 0.2-0.7) compared to controls.</p><p><strong>Conclusion: </strong>Remote monitoring via wearables in pediatric obesity has the potential to objectively measure the disease burden in the home-setting. The novel endpoints demonstrate significant differences in PA level, HR, BP, and sleep duration between patients and controls. Future studies are needed to determine the capacity of the novel digital endpoints to detect effect of interventions.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"6 1","pages":"19-29"},"PeriodicalIF":0.0,"publicationDate":"2022-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9301882/pdf/dib-0006-0019.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"33478861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Video-Based Pose Estimation for Gait Analysis in Stroke Survivors during Clinical Assessments: A Proof-of-Concept Study 基于视频的步态估计在中风幸存者的临床评估:一项概念验证研究
Q1 Computer Science Pub Date : 2022-01-13 DOI: 10.1159/000520732
L. Lonini, Y. Moon, Kyle R. Embry, R. Cotton, K. McKenzie, Sophia Jenz, A. Jayaraman
Recent advancements in deep learning have produced significant progress in markerless human pose estimation, making it possible to estimate human kinematics from single camera videos without the need for reflective markers and specialized labs equipped with motion capture systems. Such algorithms have the potential to enable the quantification of clinical metrics from videos recorded with a handheld camera. Here we used DeepLabCut, an open-source framework for markerless pose estimation, to fine-tune a deep network to track 5 body keypoints (hip, knee, ankle, heel, and toe) in 82 below-waist videos of 8 patients with stroke performing overground walking during clinical assessments. We trained the pose estimation model by labeling the keypoints in 2 frames per video and then trained a convolutional neural network to estimate 5 clinically relevant gait parameters (cadence, double support time, swing time, stance time, and walking speed) from the trajectory of these keypoints. These results were then compared to those obtained from a clinical system for gait analysis (GAITRite®, CIR Systems). Absolute accuracy (mean error) and precision (standard deviation of error) for swing, stance, and double support time were within 0.04 ± 0.11 s; Pearson’s correlation with the reference system was moderate for swing times (r = 0.4–0.66), but stronger for stance and double support time (r = 0.93–0.95). Cadence mean error was −0.25 steps/min ± 3.9 steps/min (r = 0.97), while walking speed mean error was −0.02 ± 0.11 m/s (r = 0.92). These preliminary results suggest that single camera videos and pose estimation models based on deep networks could be used to quantify clinically relevant gait metrics in individuals poststroke, even while using assistive devices in uncontrolled environments. Such development opens the door to applications for gait analysis both inside and outside of clinical settings, without the need of sophisticated equipment.
深度学习的最新进展在无标记人体姿态估计方面取得了重大进展,使从单摄像机视频中估计人体运动学成为可能,而无需反射标记和配备运动捕捉系统的专业实验室。这种算法有可能从手持摄像机记录的视频中量化临床指标。在这里,我们使用DeepLabCut,一个用于无标记姿势估计的开源框架,对一个深度网络进行微调,以跟踪82个腰部以下视频中的5个身体关键点(髋、膝、踝、脚跟和脚趾),这些视频中有8名中风患者在临床评估期间进行地上行走。我们通过标记每个视频2帧中的关键点来训练姿势估计模型,然后训练卷积神经网络,根据这些关键点的轨迹估计5个临床相关的步态参数(节奏、双支撑时间、摆动时间、站立时间和行走速度)。然后将这些结果与步态分析临床系统(GAITRite®,CIR Systems)获得的结果进行比较。摆动、站立和双支撑时间的绝对精度(平均误差)和精度(误差标准偏差)在0.04±0.11s内;Pearson与参考系统的相关性在摆动时间方面中等(r=0.4-0.66),但在站立和双支撑时间方面更强(r=0.93-0.95)。Cadence平均误差为-0.25步/分钟±3.9步/分钟(r=0.97),而步行速度平均误差为-0.02±0.11m/s(r=0.92)。这些初步结果表明,即使在不受控制的环境中使用辅助设备,基于深度网络的单摄像头视频和姿势估计模型也可以用于量化中风后个体的临床相关步态指标。这样的发展为步态分析在临床环境内外的应用打开了大门,而不需要复杂的设备。
{"title":"Video-Based Pose Estimation for Gait Analysis in Stroke Survivors during Clinical Assessments: A Proof-of-Concept Study","authors":"L. Lonini, Y. Moon, Kyle R. Embry, R. Cotton, K. McKenzie, Sophia Jenz, A. Jayaraman","doi":"10.1159/000520732","DOIUrl":"https://doi.org/10.1159/000520732","url":null,"abstract":"Recent advancements in deep learning have produced significant progress in markerless human pose estimation, making it possible to estimate human kinematics from single camera videos without the need for reflective markers and specialized labs equipped with motion capture systems. Such algorithms have the potential to enable the quantification of clinical metrics from videos recorded with a handheld camera. Here we used DeepLabCut, an open-source framework for markerless pose estimation, to fine-tune a deep network to track 5 body keypoints (hip, knee, ankle, heel, and toe) in 82 below-waist videos of 8 patients with stroke performing overground walking during clinical assessments. We trained the pose estimation model by labeling the keypoints in 2 frames per video and then trained a convolutional neural network to estimate 5 clinically relevant gait parameters (cadence, double support time, swing time, stance time, and walking speed) from the trajectory of these keypoints. These results were then compared to those obtained from a clinical system for gait analysis (GAITRite®, CIR Systems). Absolute accuracy (mean error) and precision (standard deviation of error) for swing, stance, and double support time were within 0.04 ± 0.11 s; Pearson’s correlation with the reference system was moderate for swing times (r = 0.4–0.66), but stronger for stance and double support time (r = 0.93–0.95). Cadence mean error was −0.25 steps/min ± 3.9 steps/min (r = 0.97), while walking speed mean error was −0.02 ± 0.11 m/s (r = 0.92). These preliminary results suggest that single camera videos and pose estimation models based on deep networks could be used to quantify clinically relevant gait metrics in individuals poststroke, even while using assistive devices in uncontrolled environments. Such development opens the door to applications for gait analysis both inside and outside of clinical settings, without the need of sophisticated equipment.","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"6 1","pages":"9 - 18"},"PeriodicalIF":0.0,"publicationDate":"2022-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48700761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
A Smartphone Application as an Exploratory Endpoint in a Phase 3 Parkinson’s Disease Clinical Trial: A Pilot Study 智能手机应用程序作为帕金森病3期临床试验的探索性终点:一项试点研究
Q1 Computer Science Pub Date : 2022-01-10 DOI: 10.1159/000521232
A. Page, Norman C W Yung, P. Auinger, C. Venuto, Alistair Glidden, E. Macklin, L. Omberg, M. Schwarzschild, E. Dorsey
Background: Smartphones can generate objective measures of Parkinson’s disease (PD) and supplement traditional in-person rating scales. However, smartphone use in clinical trials has been limited. Objective: This study aimed to determine the feasibility of introducing a smartphone research application into a PD clinical trial and to evaluate the resulting measures. Methods: A smartphone application was introduced part-way into a phase 3 randomized clinical trial of inosine. The application included finger tapping, gait, and cognition tests, and participants were asked to complete an assessment battery at home and in clinic alongside the Movement Disorder Society-Unified Parkinson’s Disease Rating Scale (MDS-UPDRS). Results: Of 236 eligible participants in the parent study, 88 (37%) consented to participate, and 59 (27 randomized to inosine and 32 to placebo) completed a baseline smartphone assessment. These 59 participants collectively completed 1,292 batteries of assessments. The proportion of participants who completed at least one smartphone assessment was 61% at 3, 54% at 6, and 35% at 12 months. Finger tapping speed correlated weakly with the part III motor portion (r = −0.16, left hand; r = −0.04, right hand) and total (r = −0.14) MDS-UPDRS. Gait speed correlated better with the same measures (r = −0.25, part III motor; r = −0.34, total). Over 6 months, finger tapping speed, gait speed, and memory scores did not differ between those randomized to active drug or placebo. Conclusions: Introducing a smartphone application midway into a phase 3 clinical trial was challenging. Measures of bradykinesia and gait speed correlated modestly with traditional outcomes and were consistent with the study’s overall findings, which found no benefit of the active drug.
背景:智能手机可以生成帕金森病(PD)的客观指标,并补充传统的面对面评分量表。然而,智能手机在临床试验中的使用受到了限制。目的:本研究旨在确定将智能手机研究应用引入帕金森病临床试验的可行性,并评估由此产生的措施。方法:将智能手机应用程序部分引入肌苷的3期随机临床试验。该应用程序包括手指敲击、步态和认知测试,参与者被要求在家中和诊所完成一组评估,并使用运动障碍协会统一帕金森病评定量表(MDS-UPDRS)。结果:在236名符合条件的父母研究参与者中,88人(37%)同意参与,59人(27人随机接受肌苷治疗,32人接受安慰剂治疗)完成了智能手机基线评估。这59名参与者共完成了1292组评估。参与者在3个月时完成了至少一次智能手机评估的比例为61%,在6个月时为54%,在12个月时则为35%。手指敲击速度与第三部分电机部分(r=−0.16,左手;r=−0.04,右手)和总MDS-UPDRS(r=–0.14)的相关性较弱。步态速度与相同测量值的相关性更好(r=−0.25,第三部分运动;r=−0.34,总计)。在6个月的时间里,随机接受活性药物或安慰剂治疗的患者的手指敲击速度、步态速度和记忆得分没有差异。结论:在3期临床试验的中途引入智能手机应用程序具有挑战性。运动迟缓和步态速度的测量与传统结果适度相关,并与该研究的总体结果一致,该研究没有发现活性药物的益处。
{"title":"A Smartphone Application as an Exploratory Endpoint in a Phase 3 Parkinson’s Disease Clinical Trial: A Pilot Study","authors":"A. Page, Norman C W Yung, P. Auinger, C. Venuto, Alistair Glidden, E. Macklin, L. Omberg, M. Schwarzschild, E. Dorsey","doi":"10.1159/000521232","DOIUrl":"https://doi.org/10.1159/000521232","url":null,"abstract":"Background: Smartphones can generate objective measures of Parkinson’s disease (PD) and supplement traditional in-person rating scales. However, smartphone use in clinical trials has been limited. Objective: This study aimed to determine the feasibility of introducing a smartphone research application into a PD clinical trial and to evaluate the resulting measures. Methods: A smartphone application was introduced part-way into a phase 3 randomized clinical trial of inosine. The application included finger tapping, gait, and cognition tests, and participants were asked to complete an assessment battery at home and in clinic alongside the Movement Disorder Society-Unified Parkinson’s Disease Rating Scale (MDS-UPDRS). Results: Of 236 eligible participants in the parent study, 88 (37%) consented to participate, and 59 (27 randomized to inosine and 32 to placebo) completed a baseline smartphone assessment. These 59 participants collectively completed 1,292 batteries of assessments. The proportion of participants who completed at least one smartphone assessment was 61% at 3, 54% at 6, and 35% at 12 months. Finger tapping speed correlated weakly with the part III motor portion (r = −0.16, left hand; r = −0.04, right hand) and total (r = −0.14) MDS-UPDRS. Gait speed correlated better with the same measures (r = −0.25, part III motor; r = −0.34, total). Over 6 months, finger tapping speed, gait speed, and memory scores did not differ between those randomized to active drug or placebo. Conclusions: Introducing a smartphone application midway into a phase 3 clinical trial was challenging. Measures of bradykinesia and gait speed correlated modestly with traditional outcomes and were consistent with the study’s overall findings, which found no benefit of the active drug.","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"6 1","pages":"1 - 8"},"PeriodicalIF":0.0,"publicationDate":"2022-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44824532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Digital Endpoints: Definition, Benefits, and Current Barriers in Accelerating Development and Adoption. 数字端点:加速发展和采用的定义、好处和当前障碍。
Q1 Computer Science Pub Date : 2021-09-13 eCollection Date: 2021-09-01 DOI: 10.1159/000517885
Matthew Landers, Ray Dorsey, Suchi Saria

The assessment of health and disease requires a set of criteria to define health status and progression. These health measures are referred to as "endpoints." A "digital endpoint" is defined by its use of sensor-generated data often collected outside of a clinical setting such as in a patient's free-living environment. Applicable sensors exist in an array of devices and can be applied in a diverse set of contexts. For example, a smartphone's microphone might be used to diagnose or predict mild cognitive impairment due to Alzheimer's disease or a wrist-worn activity monitor (such as those found in smartwatches) may be used to measure a drug's effect on the nocturnal activity of patients with sickle cell disease. Digital endpoints are generating considerable excitement because they permit a more authentic assessment of the patient's experience, reveal formerly untold realities of disease burden, and can cut drug discovery costs in half. However, before these benefits can be realized, effort must be applied not only to the technical creation of digital endpoints but also to the environment that allows for their development and application. The future of digital endpoints rests on meaningful interdisciplinary collaboration, sufficient evidence that digital endpoints can realize their promise, and the development of an ecosystem in which the vast quantities of data that digital endpoints generate can be analyzed. The fundamental nature of health care is changing. With coronavirus disease 2019 serving as a catalyst, there has been a rapid expansion of home care models, telehealth, and remote patient monitoring. The increasing adoption of these health-care innovations will expedite the requirement for a digital characterization of clinical status as current assessment tools often rely upon direct interaction with patients and thus are not fit for purpose to be administered remotely. With the ubiquity of relatively inexpensive sensors, digital endpoints are positioned to drive this consequential change. It is therefore not surprising that regulators, physicians, researchers, and consultants have each offered their assessment of these novel tools. However, as we further describe later, the broad adoption of digital endpoints will require a cooperative effort. In this article, we present an analysis of the current state of digital endpoints. We also attempt to unify the perspectives of the parties involved in the development and deployment of these tools. We conclude with an interdependent list of challenges that must be collaboratively addressed before these endpoints are widely adopted.

对健康和疾病的评估需要一套标准来确定健康状况和进展。这些健康措施被称为“端点”。“数字端点”是通过使用传感器生成的数据来定义的,这些数据通常是在临床环境之外收集的,例如在患者的自由生活环境中。适用的传感器存在于一系列设备中,可以应用于不同的环境中。例如,智能手机的麦克风可以用来诊断或预测由阿尔茨海默病引起的轻度认知障碍,手腕上佩戴的活动监测器(比如智能手表上的那些)可以用来测量药物对镰状细胞病患者夜间活动的影响。数字终端正在引起相当大的兴奋,因为它们允许对患者的经历进行更真实的评估,揭示以前不为人知的疾病负担的现实,并且可以将药物发现成本降低一半。然而,在实现这些好处之前,不仅必须在数字端点的技术创建上付出努力,还必须在允许其开发和应用的环境上付出努力。数字端点的未来取决于有意义的跨学科合作,数字端点能够实现其承诺的充分证据,以及数字端点产生的大量数据可以分析的生态系统的发展。医疗保健的基本性质正在发生变化。以2019年冠状病毒病为催化剂,家庭护理模式、远程医疗和远程患者监测迅速扩大。越来越多地采用这些医疗保健创新将加快对临床状态数字化特征的需求,因为目前的评估工具往往依赖于与患者的直接互动,因此不适合远程管理。随着相对便宜的传感器无处不在,数字端点被定位为推动这一重大变化。因此,监管机构、医生、研究人员和顾问都对这些新工具提出了自己的评估,这并不奇怪。然而,正如我们后面进一步描述的那样,数字端点的广泛采用将需要合作的努力。在本文中,我们对数字端点的现状进行了分析。我们还试图统一参与开发和部署这些工具的各方的观点。最后,我们列出了一系列相互依存的挑战,在这些端点被广泛采用之前,必须协作解决这些挑战。
{"title":"Digital Endpoints: Definition, Benefits, and Current Barriers in Accelerating Development and Adoption.","authors":"Matthew Landers,&nbsp;Ray Dorsey,&nbsp;Suchi Saria","doi":"10.1159/000517885","DOIUrl":"https://doi.org/10.1159/000517885","url":null,"abstract":"<p><p>The assessment of health and disease requires a set of criteria to define health status and progression. These health measures are referred to as \"endpoints.\" A \"digital endpoint\" is defined by its use of sensor-generated data often collected outside of a clinical setting such as in a patient's free-living environment. Applicable sensors exist in an array of devices and can be applied in a diverse set of contexts. For example, a smartphone's microphone might be used to diagnose or predict mild cognitive impairment due to Alzheimer's disease or a wrist-worn activity monitor (such as those found in smartwatches) may be used to measure a drug's effect on the nocturnal activity of patients with sickle cell disease. Digital endpoints are generating considerable excitement because they permit a more authentic assessment of the patient's experience, reveal formerly untold realities of disease burden, and can cut drug discovery costs in half. However, before these benefits can be realized, effort must be applied not only to the technical creation of digital endpoints but also to the environment that allows for their development and application. The future of digital endpoints rests on meaningful interdisciplinary collaboration, sufficient evidence that digital endpoints can realize their promise, and the development of an ecosystem in which the vast quantities of data that digital endpoints generate can be analyzed. The fundamental nature of health care is changing. With coronavirus disease 2019 serving as a catalyst, there has been a rapid expansion of home care models, telehealth, and remote patient monitoring. The increasing adoption of these health-care innovations will expedite the requirement for a digital characterization of clinical status as current assessment tools often rely upon direct interaction with patients and thus are not fit for purpose to be administered remotely. With the ubiquity of relatively inexpensive sensors, digital endpoints are positioned to drive this consequential change. It is therefore not surprising that regulators, physicians, researchers, and consultants have each offered their assessment of these novel tools. However, as we further describe later, the broad adoption of digital endpoints will require a cooperative effort. In this article, we present an analysis of the current state of digital endpoints. We also attempt to unify the perspectives of the parties involved in the development and deployment of these tools. We conclude with an interdependent list of challenges that must be collaboratively addressed before these endpoints are widely adopted.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"5 3","pages":"216-223"},"PeriodicalIF":0.0,"publicationDate":"2021-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8490914/pdf/dib-0005-0216.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39570045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
期刊
Digital Biomarkers
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1