首页 > 最新文献

2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)最新文献

英文 中文
SixthSense: Smart Integrated Extreme Environment Health Monitor with Sensory Feedback for Enhanced Situation Awareness 第六感:智能集成极端环境健康监测器与感官反馈增强的情况意识
G. Bijelic, Nerea Briz Iceta, Č. Stefanović, A. Morschhauser, Ana Belén Carballo Leyenda, L. Paletta, Andreas Falk, M. Kostic, Matija Štrbac, N. Jorgovanovic, Gerhard Jobst, R. Paradiso, G. Magenes, Pablo Fanjul-Bolado, Aleksandar Vujić, Philip Eschenbacher
Natural disasters occurring in inaccessible rural areas are on the rise, leading to the multiplication of first responders’ missions. However, engagement in fighting wildfires or participating in rescue missions includes risks for the well-being of the engaged first responders. Consequently, a system that monitors their actions and provides real-time and actionable information without obstructing their operational capacity is needed. The EU-funded SIXTHSENSE project aims to improve the efficiency and safety of first responders’ engagement in difficult environments by optimizing on-site team coordination and mission implementation. The project proposes an innovative wearable health monitoring system based on multimodal biosensor data that enables first responders to detect risk factors early on and allows real-time monitoring of all deployed responders. This paper is an introduction to the overall concept of the project, to the methodology and the system architecture, moreover details on Alpha version of SixthSense prototype are presented.
在交通不便的农村地区发生的自然灾害正在增加,导致急救人员的任务成倍增加。然而,参与扑灭野火或参与救援任务会给参与的第一响应者的福祉带来风险。因此,需要一个监测其行动并在不妨碍其行动能力的情况下提供实时和可操作信息的系统。欧盟资助的SIXTHSENSE项目旨在通过优化现场团队协调和任务执行,提高急救人员在困难环境中参与的效率和安全性。该项目提出了一种基于多模态生物传感器数据的创新可穿戴健康监测系统,使急救人员能够及早发现风险因素,并允许对所有部署的急救人员进行实时监测。本文介绍了该项目的总体概念、方法和系统架构,并详细介绍了第六感原型的Alpha版本。
{"title":"SixthSense: Smart Integrated Extreme Environment Health Monitor with Sensory Feedback for Enhanced Situation Awareness","authors":"G. Bijelic, Nerea Briz Iceta, Č. Stefanović, A. Morschhauser, Ana Belén Carballo Leyenda, L. Paletta, Andreas Falk, M. Kostic, Matija Štrbac, N. Jorgovanovic, Gerhard Jobst, R. Paradiso, G. Magenes, Pablo Fanjul-Bolado, Aleksandar Vujić, Philip Eschenbacher","doi":"10.1109/BSN56160.2022.9928493","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928493","url":null,"abstract":"Natural disasters occurring in inaccessible rural areas are on the rise, leading to the multiplication of first responders’ missions. However, engagement in fighting wildfires or participating in rescue missions includes risks for the well-being of the engaged first responders. Consequently, a system that monitors their actions and provides real-time and actionable information without obstructing their operational capacity is needed. The EU-funded SIXTHSENSE project aims to improve the efficiency and safety of first responders’ engagement in difficult environments by optimizing on-site team coordination and mission implementation. The project proposes an innovative wearable health monitoring system based on multimodal biosensor data that enables first responders to detect risk factors early on and allows real-time monitoring of all deployed responders. This paper is an introduction to the overall concept of the project, to the methodology and the system architecture, moreover details on Alpha version of SixthSense prototype are presented.","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114683980","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An End-to-end Posture Perception Method for Soft Bending Actuators Based on Kirigami-inspired Piezoresistive Sensors 基于kirigami型压阻传感器的软弯曲执行器端到端姿态感知方法
Jing Shu, Junming Wang, Yujie Su, Honghai Liu, Zheng Li, Raymond K. Tong
Posture sensing of soft actuators is critical for performing closed-loop control of soft robots. This paper presents a novel end-to-end posture perception method for soft actuators by developing long short-term memory (LSTM) neural networks. A novel flexible bending sensor developed from off-the-shelf conductive silicon material was proposed and used for posture sensing. In the proposed method, the hysteresis of the soft robot and non-linear sensing signals from the flexible bending sensors have also been considered. With one-step calibration from the sensor output, the posture of the soft actuator could be captured by the LSTM network. The method was validated on a finger-size one DOF pneumatic fiber-reinforced bending actuator. Four kirigami-inspired flexible piezoresistive transducers were placed on the top surface of the actuator. Results show that the transducers could sense the posture of the actuator with acceptable accuracy. We believe our work could benefit soft robot dynamic posture perception and closed-loop control.
软执行器的姿态感知是实现软机器人闭环控制的关键。提出了一种基于长短期记忆神经网络的软执行器端到端姿态感知方法。提出了一种基于导电硅材料的柔性弯曲传感器,并将其用于姿态传感。该方法还考虑了柔性机器人的磁滞和柔性弯曲传感器的非线性传感信号。通过对传感器输出的一步校正,LSTM网络可以捕获软执行器的姿态。在一个手指大小的单自由度气动纤维增强弯曲驱动器上进行了验证。在致动器的上表面放置了四个基里伽米式柔性压阻式换能器。结果表明,该传感器能够以可接受的精度感知驱动器的姿态。我们相信我们的工作将有助于软机器人的动态姿态感知和闭环控制。
{"title":"An End-to-end Posture Perception Method for Soft Bending Actuators Based on Kirigami-inspired Piezoresistive Sensors","authors":"Jing Shu, Junming Wang, Yujie Su, Honghai Liu, Zheng Li, Raymond K. Tong","doi":"10.1109/BSN56160.2022.9928494","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928494","url":null,"abstract":"Posture sensing of soft actuators is critical for performing closed-loop control of soft robots. This paper presents a novel end-to-end posture perception method for soft actuators by developing long short-term memory (LSTM) neural networks. A novel flexible bending sensor developed from off-the-shelf conductive silicon material was proposed and used for posture sensing. In the proposed method, the hysteresis of the soft robot and non-linear sensing signals from the flexible bending sensors have also been considered. With one-step calibration from the sensor output, the posture of the soft actuator could be captured by the LSTM network. The method was validated on a finger-size one DOF pneumatic fiber-reinforced bending actuator. Four kirigami-inspired flexible piezoresistive transducers were placed on the top surface of the actuator. Results show that the transducers could sense the posture of the actuator with acceptable accuracy. We believe our work could benefit soft robot dynamic posture perception and closed-loop control.","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133203705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Deep learning semantic segmentation for indoor terrain extraction: Toward better informing free-living wearable gait assessment 用于室内地形提取的深度学习语义分割:为自由生活可穿戴步态评估提供更好的信息
Jason Moore, S. Stuart, R. Walker, Peter McMeekin, F. Young, A. Godfrey
Contemporary approaches to gait assessment use wearable within free-living environments to capture habitual information, which is more informative compared to data capture in the lab. Wearables range from inertial to camera-based technologies but pragmatic challenges such as analysis of big data from heterogenous environments exist. For example, wearable camera data often requires manual time-consuming subjective contextualization, such as labelling of terrain type. There is a need for the application of automated approaches such as those suggested by artificial intelligence (AI) based methods. This pilot study investigates multiple segmentation models and proposes use of the PSPNet deep learning network to automate a binary indoor floor segmentation mask for use with wearable camera-based data (i.e., video frames). To inform the development of the AI method, a unique approach of mining heterogenous data from a video sharing platform (YouTube) was adopted to provide independent training data. The dataset contains 1973 image frames and accompanying segmentation masks. When trained on the dataset the proposed model achieved an Instance over Union score of 0.73 over 25 epochs in complex environments. The proposed method will inform future work within the field of habitual free-living gait assessment to provide automated contextual information when used in conjunction with wearable inertial derived gait characteristics.Clinical Relevance—Processes developed here will aid automated video-based free-living gait assessment
现代步态评估方法使用自由生活环境中的可穿戴设备来捕获习惯信息,与实验室中的数据捕获相比,这更具信息性。可穿戴设备的范围从惯性到基于摄像头的技术,但实际的挑战,如分析来自异质环境的大数据存在。例如,可穿戴相机数据通常需要人工耗时的主观情境化,例如标记地形类型。需要应用自动化方法,例如基于人工智能(AI)的方法所建议的方法。这项试点研究调查了多个分割模型,并提出使用PSPNet深度学习网络来自动实现基于可穿戴摄像头的数据(即视频帧)的二进制室内地板分割掩码。为了为AI方法的发展提供信息,采用了一种独特的方法,从视频共享平台(YouTube)中挖掘异构数据,以提供独立的训练数据。该数据集包含1973个图像帧和相应的分割掩码。当在数据集上进行训练时,所提出的模型在复杂环境中在25个epoch中获得了0.73的Instance over Union分数。所提出的方法将为习惯性自由生活步态评估领域的未来工作提供信息,当与可穿戴惯性衍生步态特征结合使用时,提供自动上下文信息。临床相关性-这里开发的程序将有助于基于视频的自动自由生活步态评估
{"title":"Deep learning semantic segmentation for indoor terrain extraction: Toward better informing free-living wearable gait assessment","authors":"Jason Moore, S. Stuart, R. Walker, Peter McMeekin, F. Young, A. Godfrey","doi":"10.1109/BSN56160.2022.9928505","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928505","url":null,"abstract":"Contemporary approaches to gait assessment use wearable within free-living environments to capture habitual information, which is more informative compared to data capture in the lab. Wearables range from inertial to camera-based technologies but pragmatic challenges such as analysis of big data from heterogenous environments exist. For example, wearable camera data often requires manual time-consuming subjective contextualization, such as labelling of terrain type. There is a need for the application of automated approaches such as those suggested by artificial intelligence (AI) based methods. This pilot study investigates multiple segmentation models and proposes use of the PSPNet deep learning network to automate a binary indoor floor segmentation mask for use with wearable camera-based data (i.e., video frames). To inform the development of the AI method, a unique approach of mining heterogenous data from a video sharing platform (YouTube) was adopted to provide independent training data. The dataset contains 1973 image frames and accompanying segmentation masks. When trained on the dataset the proposed model achieved an Instance over Union score of 0.73 over 25 epochs in complex environments. The proposed method will inform future work within the field of habitual free-living gait assessment to provide automated contextual information when used in conjunction with wearable inertial derived gait characteristics.Clinical Relevance—Processes developed here will aid automated video-based free-living gait assessment","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128346594","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Contactless SpO2 Detection from Face Using Consumer Camera 基于消费者相机的非接触式面部SpO2检测
Li Zhu, K. Vatanparvar, Migyeong Gwak, Jilong Kuang, A. Gao
We describe a novel computational framework for contactless oxygen saturation (SpO2) detection using videos recorded from human faces using smartphone cameras with ambient light. For contact pulse oximeter, a ratio of ratios (RoR) metric derived from selected regions of interest (ROI) combined with linear regression modeling is the standard approach. However, when used upon contactless remote PPG (rPPG), the assumptions of this standard approach do not hold automatically: 1) the rPPG signal is usually derived from the face area where the light reflection may not be uniform due to variation in skin tissue composition and/or lighting conditions (moles, hairs, beard, partial shadowing, etc.), 2) for most consumer-level cameras under ambient light, the rPPG signal is converted from light reflection associated with wide-band spectra, which creates complicated nonlinearity for SpO2 mappings. We propose a computational framework to overcome these challenges by 1) determining and dynamically tracking the ROIs according to both spatial and color proximity, and calculating the RoR based on selected individual ROIs which have homogeneous skin reflections, and 2) using a nonlinear machine learning model to mapping the SpO2 levels from RoRs derived from two different color combinations. We validated the framework with 30 healthy participants during various breathing tasks and achieved 1.24% Root Mean Square Error for across-subjects model and 1.06% for within-subject models, which surpassed the FDA-recognized ISO 81060-2-61:2017 standard.
我们描述了一种新的计算框架,用于非接触式氧饱和度(SpO2)检测,使用智能手机相机在环境光下记录人脸视频。对于接触式脉搏血氧计,从选定的感兴趣区域(ROI)衍生的比率(RoR)度量结合线性回归建模是标准方法。然而,当用于非接触式远程PPG (rPPG)时,这种标准方法的假设并不自动成立:1) rPPG信号通常来自面部区域,由于皮肤组织组成和/或光照条件(痣、毛发、胡须、部分阴影等)的变化,该区域的光反射可能不均匀;2)对于大多数环境光下的消费级相机,rPPG信号是从与宽带光谱相关的光反射转换而来,这造成了SpO2映射的复杂非线性。我们提出了一个计算框架来克服这些挑战:1)根据空间和颜色接近度确定和动态跟踪roi,并根据具有均匀皮肤反射的选定单个roi计算RoR; 2)使用非线性机器学习模型从两种不同颜色组合的RoRs中映射SpO2水平。我们用30名健康参与者在各种呼吸任务中验证了该框架,跨受试者模型的均方根误差为1.24%,受试者模型的均方根误差为1.06%,超过了fda认可的ISO 81060-2-61:2017标准。
{"title":"Contactless SpO2 Detection from Face Using Consumer Camera","authors":"Li Zhu, K. Vatanparvar, Migyeong Gwak, Jilong Kuang, A. Gao","doi":"10.1109/BSN56160.2022.9928509","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928509","url":null,"abstract":"We describe a novel computational framework for contactless oxygen saturation (SpO2) detection using videos recorded from human faces using smartphone cameras with ambient light. For contact pulse oximeter, a ratio of ratios (RoR) metric derived from selected regions of interest (ROI) combined with linear regression modeling is the standard approach. However, when used upon contactless remote PPG (rPPG), the assumptions of this standard approach do not hold automatically: 1) the rPPG signal is usually derived from the face area where the light reflection may not be uniform due to variation in skin tissue composition and/or lighting conditions (moles, hairs, beard, partial shadowing, etc.), 2) for most consumer-level cameras under ambient light, the rPPG signal is converted from light reflection associated with wide-band spectra, which creates complicated nonlinearity for SpO2 mappings. We propose a computational framework to overcome these challenges by 1) determining and dynamically tracking the ROIs according to both spatial and color proximity, and calculating the RoR based on selected individual ROIs which have homogeneous skin reflections, and 2) using a nonlinear machine learning model to mapping the SpO2 levels from RoRs derived from two different color combinations. We validated the framework with 30 healthy participants during various breathing tasks and achieved 1.24% Root Mean Square Error for across-subjects model and 1.06% for within-subject models, which surpassed the FDA-recognized ISO 81060-2-61:2017 standard.","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132264314","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Prototype smartwatch device for prolonged physiological monitoring in remote environments 用于远程环境中长时间生理监测的原型智能手表设备
B. Rosa, Benny P. L. Lo, E. Yeatman
Wearable technology in the form of wristwatches, armbands, or fit monitors has fast widespread lately among technology enthusiasts that are eager for a quick hands-on experience with their own body parameters. Nonetheless, the accuracy, replicability and reproducibility of the measurements collected by these monitors is still highly debatable outside laboratory settings, thus resulting in their nonacceptance as valid medical diagnostic tools. Furthermore, the inability to collect temporally detailed physiological variables like heartrate, pulse plethysmography, skin temperature and galvanic skin response for extended periods of time has also been appointed as a factor contributing to wearables’ nonacceptance within the biomedical research community. Even more so if the monitoring is to be performed in remote places, usually involving prolonged and arduous physical tasks performed by the participant. In this paper, we propose an inexpensive prototype smartwatch for prolonged physiological monitoring in remote environments. Equipped with sensing channels that monitor the aforementioned body variables, the device can also be instructed to operate in an asynchronous recording mode, thereby saving battery life and memory while recording some ambient variables (humidity, temperature, luminescence, and atmospheric pressure) in order to provide descriptive context awareness to the physiological processes taking place inside the human body at the same time.
最近,手表、臂带或健康监测器等形式的可穿戴技术在渴望快速体验自己身体参数的技术爱好者中迅速普及。尽管如此,这些监测仪收集的测量数据的准确性、可重复性和再现性在实验室环境之外仍然存在很大的争议,因此,它们不被接受为有效的医疗诊断工具。此外,无法长时间收集心率、脉搏脉搏、皮肤温度和皮肤电反应等临时详细的生理变量,也被认为是导致可穿戴设备不被生物医学研究界接受的一个因素。如果监测是在偏远的地方进行的,通常涉及参与者执行的长时间和艰巨的体力任务,则更是如此。在本文中,我们提出了一种廉价的原型智能手表,用于远程环境中长时间的生理监测。该设备配备了监测上述身体变量的传感通道,还可以指示以异步记录模式运行,从而节省电池寿命和内存,同时记录一些环境变量(湿度、温度、发光和大气压力),以便为同时发生在人体内部的生理过程提供描述性上下文感知。
{"title":"Prototype smartwatch device for prolonged physiological monitoring in remote environments","authors":"B. Rosa, Benny P. L. Lo, E. Yeatman","doi":"10.1109/BSN56160.2022.9928459","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928459","url":null,"abstract":"Wearable technology in the form of wristwatches, armbands, or fit monitors has fast widespread lately among technology enthusiasts that are eager for a quick hands-on experience with their own body parameters. Nonetheless, the accuracy, replicability and reproducibility of the measurements collected by these monitors is still highly debatable outside laboratory settings, thus resulting in their nonacceptance as valid medical diagnostic tools. Furthermore, the inability to collect temporally detailed physiological variables like heartrate, pulse plethysmography, skin temperature and galvanic skin response for extended periods of time has also been appointed as a factor contributing to wearables’ nonacceptance within the biomedical research community. Even more so if the monitoring is to be performed in remote places, usually involving prolonged and arduous physical tasks performed by the participant. In this paper, we propose an inexpensive prototype smartwatch for prolonged physiological monitoring in remote environments. Equipped with sensing channels that monitor the aforementioned body variables, the device can also be instructed to operate in an asynchronous recording mode, thereby saving battery life and memory while recording some ambient variables (humidity, temperature, luminescence, and atmospheric pressure) in order to provide descriptive context awareness to the physiological processes taking place inside the human body at the same time.","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115303141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A CNN Model with Discretized Mobile Features for Depression Detection 基于离散化移动特征的CNN抑郁检测模型
Yueru Yan, Mei Tu, Hongbo Wen
Depression has been a serious mental illness for a long time, which significantly influences people’s life quality. Meanwhile, as the smartphone becomes an integral part of people’s lives, it creates the opportunity to analyze users’ feelings through their phone usage and sensor data. However, previous studies mainly adopt machine-learning methods for depression detection, ignoring the sequential patterns hidden in them. In this study, we aim to monitor the symptoms of depression through sequential mobile data collected from phones and their sensors. First, we establish a deep-learning model called Dep-caser to fully utilize the sequential information in mobile data. Next, we introduce a discretization method based on Information Value to deal with data sparsity and outliers. In total, we recruited 257 people to join the study and extracted five-day longitudinal data from their smartphones and electronic bands. We conduct two experiments to examine the effectiveness of the Dep-caser and discretization method respectively. The results demonstrate that Dep-caser outperforms most of the machine learning methods and the discretization further improves the performance of the deep-learning model to achieve an overall accuracy of 0.83. Our study shows the promising future to adopt deep-learning models with sequential phone usage and sensing data to detect depression.
长期以来,抑郁症一直是一种严重的精神疾病,严重影响着人们的生活质量。与此同时,随着智能手机成为人们生活中不可或缺的一部分,它创造了通过用户使用手机和传感器数据分析用户感受的机会。然而,以往的研究主要采用机器学习方法进行抑郁检测,忽略了其中隐藏的序列模式。在这项研究中,我们的目标是通过从手机及其传感器收集的连续移动数据来监测抑郁症的症状。首先,我们建立了深度学习模型deep- caser,充分利用移动数据中的顺序信息。其次,我们引入了一种基于信息值的离散化方法来处理数据稀疏性和异常值。我们总共招募了257人加入这项研究,并从他们的智能手机和电子手环中提取了为期五天的纵向数据。我们分别进行了两个实验来检验deep -caser和离散化方法的有效性。结果表明,deep- caser优于大多数机器学习方法,离散化进一步提高了深度学习模型的性能,达到了0.83的整体精度。我们的研究表明,采用具有连续电话使用和传感数据的深度学习模型来检测抑郁症是有希望的。
{"title":"A CNN Model with Discretized Mobile Features for Depression Detection","authors":"Yueru Yan, Mei Tu, Hongbo Wen","doi":"10.1109/BSN56160.2022.9928499","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928499","url":null,"abstract":"Depression has been a serious mental illness for a long time, which significantly influences people’s life quality. Meanwhile, as the smartphone becomes an integral part of people’s lives, it creates the opportunity to analyze users’ feelings through their phone usage and sensor data. However, previous studies mainly adopt machine-learning methods for depression detection, ignoring the sequential patterns hidden in them. In this study, we aim to monitor the symptoms of depression through sequential mobile data collected from phones and their sensors. First, we establish a deep-learning model called Dep-caser to fully utilize the sequential information in mobile data. Next, we introduce a discretization method based on Information Value to deal with data sparsity and outliers. In total, we recruited 257 people to join the study and extracted five-day longitudinal data from their smartphones and electronic bands. We conduct two experiments to examine the effectiveness of the Dep-caser and discretization method respectively. The results demonstrate that Dep-caser outperforms most of the machine learning methods and the discretization further improves the performance of the deep-learning model to achieve an overall accuracy of 0.83. Our study shows the promising future to adopt deep-learning models with sequential phone usage and sensing data to detect depression.","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128316129","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On-Device Machine Learning for Diagnosis of Parkinson’s Disease from Hand Drawn Artifacts 设备上的机器学习诊断帕金森病从手绘文物
Sai Vaibhav Polisetti Venkata, Shubhankar Sabat, C. Deshpande, Asiful Arefeen, Daniel Peterson, H. Ghasemzadeh
Effective diagnosis of neuro-degenerative diseases is critical to providing early treatments, which in turn can lead to substantial savings in medical costs. Machine learning models can help with the diagnosis of such diseases like Parkinson’s and aid in assessing disease symptoms. This work introduces a novel system that integrates pervasive computing, mobile sensing, and machine learning to classify hand-drawn images and provide diagnostic insights for the screening of Parkinson’s disease patients. We designed a computational framework that combines data augmentation techniques with optimized convolutional neural network design for on-device and real-time image classification. We assess the performance of the proposed system using two datasets of images of Archimedean spirals drawn by hand and demonstrate that our approach achieves 76% and 83% accuracy respectively. Thanks to 4x memory reduction via integer quantization, our system can run fast on an Android smartphone. Our study demonstrates that pervasive computing may offer an inexpensive and effective tool for early diagnosis of Parkinson’s disease1.
神经退行性疾病的有效诊断对于提供早期治疗至关重要,这反过来又可以大大节省医疗费用。机器学习模型可以帮助诊断帕金森病等疾病,并帮助评估疾病症状。这项工作介绍了一种集成了普然计算、移动传感和机器学习的新系统,用于对手绘图像进行分类,并为帕金森病患者的筛查提供诊断见解。我们设计了一个计算框架,将数据增强技术与优化的卷积神经网络设计相结合,用于设备上和实时图像分类。我们使用两个手工绘制的阿基米德螺旋图像数据集来评估所提出系统的性能,并证明我们的方法分别达到76%和83%的准确率。由于通过整数量化减少了4倍的内存,我们的系统可以在Android智能手机上快速运行。我们的研究表明,普适计算可能为帕金森病的早期诊断提供一种廉价而有效的工具。
{"title":"On-Device Machine Learning for Diagnosis of Parkinson’s Disease from Hand Drawn Artifacts","authors":"Sai Vaibhav Polisetti Venkata, Shubhankar Sabat, C. Deshpande, Asiful Arefeen, Daniel Peterson, H. Ghasemzadeh","doi":"10.1109/BSN56160.2022.9928465","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928465","url":null,"abstract":"Effective diagnosis of neuro-degenerative diseases is critical to providing early treatments, which in turn can lead to substantial savings in medical costs. Machine learning models can help with the diagnosis of such diseases like Parkinson’s and aid in assessing disease symptoms. This work introduces a novel system that integrates pervasive computing, mobile sensing, and machine learning to classify hand-drawn images and provide diagnostic insights for the screening of Parkinson’s disease patients. We designed a computational framework that combines data augmentation techniques with optimized convolutional neural network design for on-device and real-time image classification. We assess the performance of the proposed system using two datasets of images of Archimedean spirals drawn by hand and demonstrate that our approach achieves 76% and 83% accuracy respectively. Thanks to 4x memory reduction via integer quantization, our system can run fast on an Android smartphone. Our study demonstrates that pervasive computing may offer an inexpensive and effective tool for early diagnosis of Parkinson’s disease1.","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126791612","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Wearable Vital Signal Monitoring Prototype Based on Capacitive Body Channel Communication 基于电容式身体通道通信的可穿戴生命信号监测样机
Qi Huang, Waseem Alkhayer, M. Fouda, Abdulkadir Celik, A. Eltawil
Wireless body area network (WBAN) provides a means for seamless individual health monitoring without imposing restrictive limitations on normal daily routines. To date, Radio Frequency (RF) transceivers have been the technology of choice, however, drawbacks such as vulnerability to body shadowing effects, higher power consumption due to omnidirectional radiation and security concerns, have prompted the adoption of transceivers that use the human body channel for communication. In this paper, a vital signal monitoring transceiver prototype based on the human body channel communication (HBC), using commercially available chipsets is presented. RF and HBC communications are briefly reviewed and compared, and different schemes of HBC are introduced. A circuit model that represents the human body channel is then discussed and simulations are presented to illustrate the influence of the return path capacitance and receiver terminations on the path loss. The architecture of the transceiver prototype is then introduced where it is designed at a 21 MHz IEEE 802.15.6 standard-compliant carrier frequency. Finally, the performance of the transceiver, including the bit error rate (BER) and power efficiency, are characterized. Path loss is measured for two different scenarios, where variations of up to 5 dB were observed due to environmental effects. Energy efficiency measured at a maximum data-rate of 1.3 Mbps was found to be 8.3 nJ/b.
无线体域网络(WBAN)提供了一种不受日常生活限制的无缝个人健康监测手段。迄今为止,射频(RF)收发器一直是首选技术,然而,诸如易受人体阴影效应的影响,由于全向辐射和安全问题导致的更高功耗等缺点促使采用使用人体信道进行通信的收发器。本文介绍了一种基于人体信道通信(HBC)的生命信号监测收发器原型,该收发器采用市售芯片组。对射频通信和HBC通信进行了简要的回顾和比较,并介绍了不同的HBC通信方案。然后讨论了一个代表人体通道的电路模型,并给出了仿真来说明返回路径电容和接收器终端对路径损耗的影响。然后介绍了收发器原型的架构,其中它被设计为符合21 MHz IEEE 802.15.6标准的载波频率。最后,对收发器的误码率和功率效率等性能进行了分析。在两种不同的情况下测量了路径损耗,其中由于环境影响观察到高达5db的变化。在1.3 Mbps的最大数据速率下测量的能源效率为8.3 nJ/b。
{"title":"Wearable Vital Signal Monitoring Prototype Based on Capacitive Body Channel Communication","authors":"Qi Huang, Waseem Alkhayer, M. Fouda, Abdulkadir Celik, A. Eltawil","doi":"10.1109/BSN56160.2022.9928512","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928512","url":null,"abstract":"Wireless body area network (WBAN) provides a means for seamless individual health monitoring without imposing restrictive limitations on normal daily routines. To date, Radio Frequency (RF) transceivers have been the technology of choice, however, drawbacks such as vulnerability to body shadowing effects, higher power consumption due to omnidirectional radiation and security concerns, have prompted the adoption of transceivers that use the human body channel for communication. In this paper, a vital signal monitoring transceiver prototype based on the human body channel communication (HBC), using commercially available chipsets is presented. RF and HBC communications are briefly reviewed and compared, and different schemes of HBC are introduced. A circuit model that represents the human body channel is then discussed and simulations are presented to illustrate the influence of the return path capacitance and receiver terminations on the path loss. The architecture of the transceiver prototype is then introduced where it is designed at a 21 MHz IEEE 802.15.6 standard-compliant carrier frequency. Finally, the performance of the transceiver, including the bit error rate (BER) and power efficiency, are characterized. Path loss is measured for two different scenarios, where variations of up to 5 dB were observed due to environmental effects. Energy efficiency measured at a maximum data-rate of 1.3 Mbps was found to be 8.3 nJ/b.","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122075323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Deep Audio Spectral Processing for Respiration Rate Estimation from Smart Commodity Earbuds 基于智能耳机呼吸频率估计的深度音频频谱处理
M. Y. Ahmed, Tousif Ahmed, Md. Mahbubur Rahman, Zihan Wang, Jilong Kuang, A. Gao
Respiration rate is an important health biomarker and a vital indicator for health and fitness. With smart earbuds gaining popularity as a commodity device, recent works have demonstrated the potential for monitoring breathing rate using such earable devices. In this work, for the first time we utilize deep image recognition techniques to infer respiration rate from earbud audio. We use image spectrograms from breathing cycle audio signals captured using Samsung earbuds as a spectral feature to train a deep convolutional neural network. Using novel earbud audio data collected from 30 subjects with both controlled breathing at a wide range (from 5 upto 45 breaths per minute), and uncontrolled natural breathing from 7-day home deployment, experimental results demonstrate that our model outperforms existing methods using earbuds for inferring respiration rates from regular intensity breathing and heavy breathing sounds with 0.77 aggregated MAE for controlled breathing and with 0.99 aggregated MAE for at-home natural breathing.
呼吸速率是一种重要的健康生物标志物,是健康体质的重要指标。随着智能耳塞作为一种商品设备越来越受欢迎,最近的研究表明,使用这种耳塞设备监测呼吸频率的潜力很大。在这项工作中,我们首次利用深度图像识别技术从耳塞音频中推断呼吸速率。我们使用三星耳塞捕捉的呼吸周期音频信号的图像频谱图作为频谱特征来训练深度卷积神经网络。使用从30名受试者中收集的新型耳塞音频数据,这些受试者在大范围内控制呼吸(从每分钟5次到45次),以及从7天的家庭生活中不受控制的自然呼吸,实验结果表明,我们的模型优于现有的使用耳塞从常规强度呼吸和重呼吸声音推断呼吸速率的方法,控制呼吸的聚合MAE为0.77,家庭自然呼吸的聚合MAE为0.99。
{"title":"Deep Audio Spectral Processing for Respiration Rate Estimation from Smart Commodity Earbuds","authors":"M. Y. Ahmed, Tousif Ahmed, Md. Mahbubur Rahman, Zihan Wang, Jilong Kuang, A. Gao","doi":"10.1109/BSN56160.2022.9928461","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928461","url":null,"abstract":"Respiration rate is an important health biomarker and a vital indicator for health and fitness. With smart earbuds gaining popularity as a commodity device, recent works have demonstrated the potential for monitoring breathing rate using such earable devices. In this work, for the first time we utilize deep image recognition techniques to infer respiration rate from earbud audio. We use image spectrograms from breathing cycle audio signals captured using Samsung earbuds as a spectral feature to train a deep convolutional neural network. Using novel earbud audio data collected from 30 subjects with both controlled breathing at a wide range (from 5 upto 45 breaths per minute), and uncontrolled natural breathing from 7-day home deployment, experimental results demonstrate that our model outperforms existing methods using earbuds for inferring respiration rates from regular intensity breathing and heavy breathing sounds with 0.77 aggregated MAE for controlled breathing and with 0.99 aggregated MAE for at-home natural breathing.","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128684050","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A Novel Active Human Echolocation Device 一种新型主动人体回声定位装置
Saeed Akbarzadeh, Xiao Gu, Zhipeng Wu, Benny P. L. Lo
Some animals, like bats and dolphins, can echolocate themselves and navigate through complete darkness. They can generate ultrasonic signals and locate themselves based on the echo bounced back from the surrounding objects/structures. As human, we lack such abilities to echolocate ourselves, and we mainly rely on our vision to guide and navigate. However, recently, some visually impaired people have trained and learned the skills to echo locate themselves demonstrating that we can too echo locate ourselves with our own hearing. Based on this principal, we propose a novel wearable device that can aid both sighted and visually impaired people in acquiring the echolocation skills. As our hearing is tuned to filter out echos, the proposed device is designed with an ultrasound transmitter with a carrier frequency of 40 kHz and modulated with a signal with 2kHz frequency to generate a click sound that could be heard by the user for echolocation. Hence, the brain experienced far less confusion while attempting to comprehend the surrounding world and isolate the aspects necessary to acquire the abilities. To assess the ability of user to acquiring the echolocation skills, a healthy subject study was conducted where six training sessions that we conducted, and EEG (electroencephalogram) signal of the subjects were collected while they were blindfolded and using the proposed device to echolocate. From the results, we have shown that there was a significant correlation between their echolocation training and the intensified activations of the visual cortex area demonstrating the subjects were able to use the echoed signal to ’visualize’ the surrounding environment. It also shows the subjects’ ability to learn and echolocate themselves quickly in a room fitted with a random objects.
一些动物,如蝙蝠和海豚,可以通过回声定位自己,并在完全黑暗中导航。它们可以产生超声波信号,并根据从周围物体/结构反射回来的回声来定位自己。作为人类,我们缺乏这样的回声定位能力,我们主要依靠我们的视觉来引导和导航。然而,最近,一些视力受损的人已经训练并学会了回声定位自己的技能,这表明我们也可以用自己的听觉来回声定位自己。基于这一原理,我们提出了一种新型的可穿戴设备,可以帮助视力正常和视障人士获得回声定位技能。由于我们的听觉被调整为滤除回声,因此该装置设计了一个载波频率为40 kHz的超声波发射器,并与频率为2kHz的信号调制,产生用户可以听到的咔哒声,用于回声定位。因此,大脑在试图理解周围世界和隔离获得能力所必需的方面时,经历的混乱要少得多。为了评估使用者获得回声定位技能的能力,我们进行了一项健康受试者研究,其中我们进行了六次训练,并收集了受试者在蒙眼并使用所提出的设备进行回声定位时的脑电图(EEG)信号。从结果来看,我们已经证明了回声定位训练与视觉皮层区域的强化激活之间存在显著的相关性,这表明受试者能够使用回声信号来“可视化”周围的环境。它还显示了受试者在一个装有随机物体的房间里快速学习和定位自己的能力。
{"title":"A Novel Active Human Echolocation Device","authors":"Saeed Akbarzadeh, Xiao Gu, Zhipeng Wu, Benny P. L. Lo","doi":"10.1109/BSN56160.2022.9928448","DOIUrl":"https://doi.org/10.1109/BSN56160.2022.9928448","url":null,"abstract":"Some animals, like bats and dolphins, can echolocate themselves and navigate through complete darkness. They can generate ultrasonic signals and locate themselves based on the echo bounced back from the surrounding objects/structures. As human, we lack such abilities to echolocate ourselves, and we mainly rely on our vision to guide and navigate. However, recently, some visually impaired people have trained and learned the skills to echo locate themselves demonstrating that we can too echo locate ourselves with our own hearing. Based on this principal, we propose a novel wearable device that can aid both sighted and visually impaired people in acquiring the echolocation skills. As our hearing is tuned to filter out echos, the proposed device is designed with an ultrasound transmitter with a carrier frequency of 40 kHz and modulated with a signal with 2kHz frequency to generate a click sound that could be heard by the user for echolocation. Hence, the brain experienced far less confusion while attempting to comprehend the surrounding world and isolate the aspects necessary to acquire the abilities. To assess the ability of user to acquiring the echolocation skills, a healthy subject study was conducted where six training sessions that we conducted, and EEG (electroencephalogram) signal of the subjects were collected while they were blindfolded and using the proposed device to echolocate. From the results, we have shown that there was a significant correlation between their echolocation training and the intensified activations of the visual cortex area demonstrating the subjects were able to use the echoed signal to ’visualize’ the surrounding environment. It also shows the subjects’ ability to learn and echolocate themselves quickly in a room fitted with a random objects.","PeriodicalId":150990,"journal":{"name":"2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129737056","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1