首页 > 最新文献

Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction最新文献

英文 中文
Theodor: A Step Towards Smart Home Applications with Electronic Noses Theodor:迈向电子鼻智能家居应用的一步
C. Dang, A. Seiderer, E. André
This paper presents preliminary results of the ongoing project TheOdor which explores the potential of electronic noses that make use of commodity gas sensors (MOS, MEMS) for applications in the smarthome, for example, to classify human activities based on the odors generated by activities. We describe the system and its components and report on classification results from first validation experiments.
本文介绍了正在进行的TheOdor项目的初步结果,该项目探索了电子鼻的潜力,利用商品气体传感器(MOS, MEMS)在智能家居中的应用,例如,根据活动产生的气味对人类活动进行分类。我们描述了该系统及其组成部分,并报告了首次验证实验的分类结果。
{"title":"Theodor: A Step Towards Smart Home Applications with Electronic Noses","authors":"C. Dang, A. Seiderer, E. André","doi":"10.1145/3266157.3266215","DOIUrl":"https://doi.org/10.1145/3266157.3266215","url":null,"abstract":"This paper presents preliminary results of the ongoing project TheOdor which explores the potential of electronic noses that make use of commodity gas sensors (MOS, MEMS) for applications in the smarthome, for example, to classify human activities based on the odors generated by activities. We describe the system and its components and report on classification results from first validation experiments.","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122809345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Activity Recognition using Head Worn Inertial Sensors 使用头戴式惯性传感器的活动识别
Johann-Peter Wolff, Florian Grützmacher, A. Wellnitz, C. Haubelt
Human activity recognition using inertial sensors is an increasingly used feature in smartphones or smartwatches, providing information on sports and physical activities of each individual. But while the position a smartphone is worn in varies between persons and circumstances, a smartwatch moves constantly, in rhythm with its user's arms. Both problems make activity recognition less reliable. Attaching an inertial sensor to the head provides reliable information on the movements of the whole body while not being superimposed by many additional movements. This can be achieved by fixing sensors to glasses, helmets, or headphones. In this paper, we present a system using head-mounted inertial sensors for human activity recognition. We compare it to existing research work and show possible advantages or disadvantages of positioning a single sensor on the head to recognize physical activities. Furthermore we evaluate the benefits of using different sensor configurations on activity recognition.
使用惯性传感器的人体活动识别功能在智能手机或智能手表上的应用越来越多,它可以提供每个人的运动和身体活动信息。不过,尽管不同的人、不同的环境佩戴智能手机的姿势不同,但智能手表会随着用户的手臂不断移动。这两个问题都降低了活动识别的可靠性。在头部安装惯性传感器可以提供关于整个身体运动的可靠信息,而不会被许多额外的运动所叠加。这可以通过将传感器固定在眼镜、头盔或耳机上来实现。本文提出了一种利用头戴式惯性传感器进行人体活动识别的系统。我们将其与现有的研究工作进行了比较,并展示了将单个传感器定位在头部以识别身体活动的可能优点或缺点。此外,我们评估了使用不同传感器配置对活动识别的好处。
{"title":"Activity Recognition using Head Worn Inertial Sensors","authors":"Johann-Peter Wolff, Florian Grützmacher, A. Wellnitz, C. Haubelt","doi":"10.1145/3266157.3266218","DOIUrl":"https://doi.org/10.1145/3266157.3266218","url":null,"abstract":"Human activity recognition using inertial sensors is an increasingly used feature in smartphones or smartwatches, providing information on sports and physical activities of each individual. But while the position a smartphone is worn in varies between persons and circumstances, a smartwatch moves constantly, in rhythm with its user's arms. Both problems make activity recognition less reliable. Attaching an inertial sensor to the head provides reliable information on the movements of the whole body while not being superimposed by many additional movements. This can be achieved by fixing sensors to glasses, helmets, or headphones. In this paper, we present a system using head-mounted inertial sensors for human activity recognition. We compare it to existing research work and show possible advantages or disadvantages of positioning a single sensor on the head to recognize physical activities. Furthermore we evaluate the benefits of using different sensor configurations on activity recognition.","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114098304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Combining off-the-shelf Image Classifiers with Transfer Learning for Activity Recognition 结合现成的图像分类器和活动识别的迁移学习
Amit Kumar, Kristina Yordanova, T. Kirste, Mohit Kumar
Human Activity Recognition (HAR) plays an important role in many real world applications. Currently, various techniques have been proposed for sensor-based "HAR" in daily health monitoring, rehabilitative training and disease prevention. However, non-visual sensors in general and wearable sensors in specific have several limitations: acceptability and willingness to use wearable sensors; battery life; ease of use; size and effectiveness of the sensors. Therefore, adopting vision-based human activity recognition approach is more viable option since its diversity would enable the application to be deployed in wide range of domains. The most popular technique of vision based activity recognition, Deep Learning, however, requires huge domain-specific datasets for training which, is time consuming and expensive. To address this problem this paper proposes a Transfer Learning technique by adopting vision-based approach to "HAR" by using already trained Deep Learning models. A new stochastic model is developed by borrowing the concept of "Dirichlet Alloaction" from Latent Dirichlet Allocation (LDA) for an inference of the posterior distribution of the variables relating the deep learning classifiers predicted labels with the corresponding activities. Results show that an average accuracy of 95.43% is achieved during training the model as compared to 74.88 and 61.4% of Decision Tree and SVM respectively.
人类活动识别(HAR)在许多现实世界的应用中起着重要的作用。目前,在日常健康监测、康复训练和疾病预防方面,已经提出了各种基于传感器的“HAR”技术。然而,一般的非视觉传感器和具体的可穿戴传感器有几个限制:可穿戴传感器的可接受性和使用意愿;电池寿命;易用性;传感器的大小和有效性。因此,采用基于视觉的人类活动识别方法是更可行的选择,因为它的多样性将使应用程序部署在更广泛的领域。然而,最流行的基于视觉的活动识别技术深度学习需要大量的特定领域数据集进行训练,这既耗时又昂贵。为了解决这个问题,本文提出了一种迁移学习技术,通过使用已经训练好的深度学习模型,采用基于视觉的方法来“HAR”。借鉴潜在狄利克雷分配(Latent Dirichlet Allocation, LDA)中的“狄利克雷分配”概念,建立了一种新的随机模型,用于推断深度学习分类器预测标签与相应活动相关变量的后验分布。结果表明,与Decision Tree和SVM的平均准确率分别为74.88和61.4%相比,该模型在训练过程中平均准确率达到95.43%。
{"title":"Combining off-the-shelf Image Classifiers with Transfer Learning for Activity Recognition","authors":"Amit Kumar, Kristina Yordanova, T. Kirste, Mohit Kumar","doi":"10.1145/3266157.3266219","DOIUrl":"https://doi.org/10.1145/3266157.3266219","url":null,"abstract":"Human Activity Recognition (HAR) plays an important role in many real world applications. Currently, various techniques have been proposed for sensor-based \"HAR\" in daily health monitoring, rehabilitative training and disease prevention. However, non-visual sensors in general and wearable sensors in specific have several limitations: acceptability and willingness to use wearable sensors; battery life; ease of use; size and effectiveness of the sensors. Therefore, adopting vision-based human activity recognition approach is more viable option since its diversity would enable the application to be deployed in wide range of domains. The most popular technique of vision based activity recognition, Deep Learning, however, requires huge domain-specific datasets for training which, is time consuming and expensive. To address this problem this paper proposes a Transfer Learning technique by adopting vision-based approach to \"HAR\" by using already trained Deep Learning models. A new stochastic model is developed by borrowing the concept of \"Dirichlet Alloaction\" from Latent Dirichlet Allocation (LDA) for an inference of the posterior distribution of the variables relating the deep learning classifiers predicted labels with the corresponding activities. Results show that an average accuracy of 95.43% is achieved during training the model as compared to 74.88 and 61.4% of Decision Tree and SVM respectively.","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124911195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Fewer Samples for a Longer Life Span: Towards Long-Term Wearable PPG Analysis 更少的样品,更长的寿命:迈向长期可穿戴的PPG分析
Florian Wolling, Kristof Van Laerhoven
Photoplethysmography (PPG) sensors have become a prevalent feature included in current wearables, as the cost and size of current PPG modules have dropped significantly. Research in the analysis of PPG data has recently expanded beyond the fast and accurate characterization of heart rate, into the adaptive handling of artifacts within the signal and even the capturing of respiration rate. In this paper, we instead explore using state-of-the-art PPG sensor modules for long-term wearable deployment and the observation of trends over minutes, rather than seconds. By focusing specifically on lowering the sampling rate and via analysis of the spectrum of frequencies alone, our approach minimizes the costly illumination-based sensing and can be used to detect the dominant frequencies of heart rate and respiration rate, but also enables to infer on activity of the sympathetic nervous system. We show in two experiments that such detections and measurements can still be achieved at low sampling rates down to 10 Hz, within a power-efficient platform. This approach enables miniature sensor designs that monitor average heart rate, respiration rate, and sympathetic nerve activity over longer stretches of time.
随着当前PPG模块的成本和尺寸显著下降,光电体积脉搏描记(PPG)传感器已成为当前可穿戴设备中普遍存在的功能。最近,对PPG数据分析的研究已经超越了对心率的快速准确表征,扩展到了对信号中伪影的自适应处理,甚至是呼吸速率的捕捉。在本文中,我们探索使用最先进的PPG传感器模块进行长期可穿戴部署,并在几分钟内观察趋势,而不是几秒钟。通过专注于降低采样率,并通过单独分析频率频谱,我们的方法最大限度地减少了昂贵的基于照明的传感,可用于检测心率和呼吸频率的主导频率,但也能够推断交感神经系统的活动。我们在两个实验中表明,在节能平台内,这种检测和测量仍然可以在低采样率(低至10 Hz)下实现。这种方法使微型传感器设计能够在较长时间内监测平均心率、呼吸率和交感神经活动。
{"title":"Fewer Samples for a Longer Life Span: Towards Long-Term Wearable PPG Analysis","authors":"Florian Wolling, Kristof Van Laerhoven","doi":"10.1145/3266157.3266209","DOIUrl":"https://doi.org/10.1145/3266157.3266209","url":null,"abstract":"Photoplethysmography (PPG) sensors have become a prevalent feature included in current wearables, as the cost and size of current PPG modules have dropped significantly. Research in the analysis of PPG data has recently expanded beyond the fast and accurate characterization of heart rate, into the adaptive handling of artifacts within the signal and even the capturing of respiration rate. In this paper, we instead explore using state-of-the-art PPG sensor modules for long-term wearable deployment and the observation of trends over minutes, rather than seconds. By focusing specifically on lowering the sampling rate and via analysis of the spectrum of frequencies alone, our approach minimizes the costly illumination-based sensing and can be used to detect the dominant frequencies of heart rate and respiration rate, but also enables to infer on activity of the sympathetic nervous system. We show in two experiments that such detections and measurements can still be achieved at low sampling rates down to 10 Hz, within a power-efficient platform. This approach enables miniature sensor designs that monitor average heart rate, respiration rate, and sympathetic nerve activity over longer stretches of time.","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122145697","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Real-Time Joint Axes Estimation of the Hip and Knee Joint during Gait using Inertial Sensors 基于惯性传感器的步态中髋关节和膝关节关节轴的实时估计
Markus Nordén, Philipp Müller, T. Schauer
Inertial Measurement Units (IMUs) have proven to be a promising candidate for joint kinematics assessment during human locomotion. The benefits associated with IMU-based joint angle measurements are ease of handling, flexibility and low cost. However, a known limitation is that the joint axes in terms of the attached IMUs need to be identified in order to decompose IMU measurements into joint angles. Conventionally, careful alignment of the IMUs with respect to the body segments and/or calibration motions are required. In this paper, a novel approach is proposed to estimate the joint axes of the hip and knee joint during gait. Our method is easy to use, self-calibrating and real-time capable using the obtained IMU data during gait. In addition to prior methods, the algorithm profits from the periodicity during gait in order to deal with three (rotational) degrees of freedom (3-DoF) motions. Experiments with 8 healthy subjects walking on a motor-driven treadmill have been conducted. The joint axes converged onto the expected axes in all trials and the convergence times averaged less than 15 seconds.
惯性测量单元(imu)已被证明是人体运动过程中关节运动学评估的一个有前途的候选者。基于imu的关节角度测量的优点是易于操作,灵活性和低成本。然而,一个已知的限制是,为了将IMU的测量分解为关节角,需要根据所附IMU来识别关节轴。通常,需要对imu进行相对于身体部分和/或校准运动的仔细校准。本文提出了一种新的估计步态中髋关节和膝关节关节轴的方法。我们的方法易于使用,可自校准,并且能够实时使用步态中获得的IMU数据。除了先前的方法外,该算法还利用步态的周期性来处理三(旋转)自由度(3-DoF)运动。对8名健康受试者在电动跑步机上进行了实验。在所有试验中,关节轴都收敛到预期轴上,收敛时间平均小于15秒。
{"title":"Real-Time Joint Axes Estimation of the Hip and Knee Joint during Gait using Inertial Sensors","authors":"Markus Nordén, Philipp Müller, T. Schauer","doi":"10.1145/3266157.3266213","DOIUrl":"https://doi.org/10.1145/3266157.3266213","url":null,"abstract":"Inertial Measurement Units (IMUs) have proven to be a promising candidate for joint kinematics assessment during human locomotion. The benefits associated with IMU-based joint angle measurements are ease of handling, flexibility and low cost. However, a known limitation is that the joint axes in terms of the attached IMUs need to be identified in order to decompose IMU measurements into joint angles. Conventionally, careful alignment of the IMUs with respect to the body segments and/or calibration motions are required. In this paper, a novel approach is proposed to estimate the joint axes of the hip and knee joint during gait. Our method is easy to use, self-calibrating and real-time capable using the obtained IMU data during gait. In addition to prior methods, the algorithm profits from the periodicity during gait in order to deal with three (rotational) degrees of freedom (3-DoF) motions. Experiments with 8 healthy subjects walking on a motor-driven treadmill have been conducted. The joint axes converged onto the expected axes in all trials and the convergence times averaged less than 15 seconds.","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128949517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
A Machine Learning Approach to Violin Bow Technique Classification: a Comparison Between IMU and MOCAP systems 小提琴琴弓技术分类的机器学习方法:IMU和MOCAP系统的比较
D. Dalmazzo, S. Tassani, R. Ramírez
Motion Capture (MOCAP) Systems have been used to analyze body motion and postures in biomedicine, sports, rehabilitation, and music. With the aim to compare the precision of low-cost devices for motion tracking (e.g. Myo) with the precision of MOCAP systems in the context of music performance, we recorded MOCAP and Myo data of a top professional violinist executing four fundamental bowing techniques (i.e. Détaché, Martelé, Spiccato and Ricochet). Using the recorded data we applied machine learning techniques to train models to classify the four bowing techniques. Despite intrinsic differences between the MOCAP and low-cost data, the Myo-based classifier resulted in slightly higher accuracy than the MOCAP-based classifier. This result shows that it is possible to develop music-gesture learning applications based on low-cost technology which can be used in home environments for self-learning practitioners.
动作捕捉(MOCAP)系统已被用于分析生物医学、运动、康复和音乐领域的身体运动和姿势。为了比较低成本的运动跟踪设备(例如Myo)与MOCAP系统在音乐表演中的精度,我们记录了一位顶级专业小提琴家执行四种基本弓弦技术(即dsamactach、martel、Spiccato和Ricochet)的MOCAP和Myo数据。使用记录的数据,我们应用机器学习技术来训练模型来分类四种弯曲技术。尽管MOCAP和低成本数据之间存在内在差异,但基于myo的分类器的准确率略高于基于MOCAP的分类器。这一结果表明,基于低成本技术开发音乐手势学习应用程序是可能的,可以在家庭环境中用于自学从业者。
{"title":"A Machine Learning Approach to Violin Bow Technique Classification: a Comparison Between IMU and MOCAP systems","authors":"D. Dalmazzo, S. Tassani, R. Ramírez","doi":"10.1145/3266157.3266216","DOIUrl":"https://doi.org/10.1145/3266157.3266216","url":null,"abstract":"Motion Capture (MOCAP) Systems have been used to analyze body motion and postures in biomedicine, sports, rehabilitation, and music. With the aim to compare the precision of low-cost devices for motion tracking (e.g. Myo) with the precision of MOCAP systems in the context of music performance, we recorded MOCAP and Myo data of a top professional violinist executing four fundamental bowing techniques (i.e. Détaché, Martelé, Spiccato and Ricochet). Using the recorded data we applied machine learning techniques to train models to classify the four bowing techniques. Despite intrinsic differences between the MOCAP and low-cost data, the Myo-based classifier resulted in slightly higher accuracy than the MOCAP-based classifier. This result shows that it is possible to develop music-gesture learning applications based on low-cost technology which can be used in home environments for self-learning practitioners.","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114248878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Respiration Rate Estimation with Depth Cameras: An Evaluation of Parameters 呼吸速率估计与深度相机:参数的评估
Jochen Kempfle, Kristof Van Laerhoven
Depth cameras have been known to be capable of picking up the small changes in distance from users' torsos, to estimate respiration rate. Several studies have shown that under certain conditions, the respiration rate from a non-mobile user facing the camera can be accurately estimated from parts of the depth data. It is however to date not clear, what factors might hinder the application of this technology in any setting, what areas of the torso need to be observed, and how readings are affected for persons at larger distances from the RGB-D camera. In this paper, we present a benchmark dataset that consists of the point cloud data from a depth camera, which monitors 7 volunteers at variable distances, for variable methods to pin-point the person's torso, and at variable breathing rates. Our findings show that the respiration signal's signal-to-noise ratio becomes debilitating as the distance to the person approaches 4 metres, and that bigger windows over the person's chest work particularly well. The sampling rate of the depth camera was also found to impact the signal's quality significantly.
众所周知,深度相机能够捕捉到用户身体距离的微小变化,从而估计呼吸速率。几项研究表明,在某些条件下,面对相机的非移动用户的呼吸速率可以从部分深度数据中准确估计出来。然而,迄今为止尚不清楚,哪些因素可能会阻碍这项技术在任何环境中的应用,需要观察躯干的哪些区域,以及距离RGB-D相机较远的人的读数如何受到影响。在本文中,我们提出了一个基准数据集,该数据集由来自深度相机的点云数据组成,该相机监测7名志愿者在不同距离,不同方法来精确定位人的躯干,以及不同的呼吸频率。我们的研究结果表明,呼吸信号的信噪比随着与人的距离接近4米而减弱,而在人的胸部上开更大的窗户效果特别好。深度相机的采样率对信号质量也有显著影响。
{"title":"Respiration Rate Estimation with Depth Cameras: An Evaluation of Parameters","authors":"Jochen Kempfle, Kristof Van Laerhoven","doi":"10.1145/3266157.3266208","DOIUrl":"https://doi.org/10.1145/3266157.3266208","url":null,"abstract":"Depth cameras have been known to be capable of picking up the small changes in distance from users' torsos, to estimate respiration rate. Several studies have shown that under certain conditions, the respiration rate from a non-mobile user facing the camera can be accurately estimated from parts of the depth data. It is however to date not clear, what factors might hinder the application of this technology in any setting, what areas of the torso need to be observed, and how readings are affected for persons at larger distances from the RGB-D camera. In this paper, we present a benchmark dataset that consists of the point cloud data from a depth camera, which monitors 7 volunteers at variable distances, for variable methods to pin-point the person's torso, and at variable breathing rates. Our findings show that the respiration signal's signal-to-noise ratio becomes debilitating as the distance to the person approaches 4 metres, and that bigger windows over the person's chest work particularly well. The sampling rate of the depth camera was also found to impact the signal's quality significantly.","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129421910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Dense 3D Optical Flow Co-occurrence Matrices for Human Activity Recognition 用于人体活动识别的密集三维光流共现矩阵
Rawya Al-Akam, D. Paulus
In this paper, a new activity recognition technique is introduced based on the gray level co-occurrence matrices (GLCM) from a 3D dense optical flow of the input RGB and Depth videos. These matrices are one of the earliest techniques used for image texture analysis which are representing the distribution of the intensities and information about relative positions of neighboring pixels of an image. In this work, we propose a new method to extract feature vector values using the well-known Haralick features from GLCM matrices to describe the flow pattern by measuring meaningful properties such as energy, contrast, homogeneity, entropy, correlation and sum average to capture local spatial and temporal characteristics of the motion through the neighboring optical flow orientation and magnitude. To evaluate the proposed method and improve the activity recognition problem, we apply a recognition pipeline that involves the bag of local spatial and temporal features and three types of machine learning classifiers are used for comparing the recognition accuracy rate of our method. These classifiers are random forest, support vector machine and K-nearest neighbor. The experimental results carried on two well-known datasets (Gaming datasets (G3D) and Cornell Activity Datasets (CAD-60)), which demonstrate that our method outperforms the results achieved by several widely employed spatial and temporal feature descriptors methods.
本文介绍了一种基于灰度共生矩阵(GLCM)的三维密集光流图像的活动识别技术。这些矩阵是最早用于图像纹理分析的技术之一,它表示图像中相邻像素的相对位置的强度分布和信息。在这项工作中,我们提出了一种新的方法,利用著名的Haralick特征从GLCM矩阵中提取特征向量值,通过测量能量、对比度、均匀性、熵、相关性和和平均等有意义的特性来描述流型,通过邻近的光流方向和大小捕获运动的局部时空特征。为了评估所提出的方法并改进活动识别问题,我们应用了一个包含局部时空特征包的识别管道,并使用三种类型的机器学习分类器来比较我们的方法的识别准确率。这些分类器是随机森林、支持向量机和k近邻。在两个著名的数据集(游戏数据集(G3D)和康奈尔活动数据集(CAD-60))上进行的实验结果表明,我们的方法优于几种广泛使用的时空特征描述符方法。
{"title":"Dense 3D Optical Flow Co-occurrence Matrices for Human Activity Recognition","authors":"Rawya Al-Akam, D. Paulus","doi":"10.1145/3266157.3266220","DOIUrl":"https://doi.org/10.1145/3266157.3266220","url":null,"abstract":"In this paper, a new activity recognition technique is introduced based on the gray level co-occurrence matrices (GLCM) from a 3D dense optical flow of the input RGB and Depth videos. These matrices are one of the earliest techniques used for image texture analysis which are representing the distribution of the intensities and information about relative positions of neighboring pixels of an image. In this work, we propose a new method to extract feature vector values using the well-known Haralick features from GLCM matrices to describe the flow pattern by measuring meaningful properties such as energy, contrast, homogeneity, entropy, correlation and sum average to capture local spatial and temporal characteristics of the motion through the neighboring optical flow orientation and magnitude. To evaluate the proposed method and improve the activity recognition problem, we apply a recognition pipeline that involves the bag of local spatial and temporal features and three types of machine learning classifiers are used for comparing the recognition accuracy rate of our method. These classifiers are random forest, support vector machine and K-nearest neighbor. The experimental results carried on two well-known datasets (Gaming datasets (G3D) and Cornell Activity Datasets (CAD-60)), which demonstrate that our method outperforms the results achieved by several widely employed spatial and temporal feature descriptors methods.","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132077285","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Exploring Accelerometer-based Step Detection by using a Wheeled Walking Frame 基于轮式行走架的加速度计步长检测研究
G. Bieber, Marian Haescher, Paul Hanschmann, Denys J. C. Matthies
Step detection with accelerometers is a very common feature that smart wearables already include. However, when using a wheeled walking frame / rollator, current algorithms may be of limited use, since a different type of motion is being excreted. In this paper, we uncover these limitations of current wearables by a pilot study. Furthermore, we investigated an accelerometer-based step detection for using a wheeled walking frame, when mounting an accelerometer to the frame and at the user's wrist. Our findings include knowledge on signal propagation of each axis, knowledge on the required sensor quality and knowledge on the impact of different surfaces and floor types. In conclusion, we outline a new step detection algorithm based on accelerometer input data. Our algorithm can significantly empower future off-the-shelf wearables with the capability to sufficiently detect steps with elderly people using a wheeled walking frame. This can help to evaluate the state of health with regard to the human behavior and motor system and even to determine the progress of certain diseases.
加速度计的步长检测是智能可穿戴设备中非常常见的功能。然而,当使用轮式行走框架/滚动器时,当前的算法可能用途有限,因为正在排出不同类型的运动。在本文中,我们通过一项试点研究揭示了当前可穿戴设备的这些局限性。此外,我们研究了一种基于加速度计的步长检测方法,该方法可以在轮式行走框架和用户手腕上安装加速度计。我们的发现包括对每个轴的信号传播的了解,对所需传感器质量的了解以及对不同表面和地板类型的影响的了解。最后,我们提出了一种新的基于加速度计输入数据的阶跃检测算法。我们的算法可以极大地增强未来现成的可穿戴设备的能力,使其能够充分检测使用轮式步行架的老年人的步伐。这有助于评估人类行为和运动系统的健康状况,甚至可以确定某些疾病的进展。
{"title":"Exploring Accelerometer-based Step Detection by using a Wheeled Walking Frame","authors":"G. Bieber, Marian Haescher, Paul Hanschmann, Denys J. C. Matthies","doi":"10.1145/3266157.3266212","DOIUrl":"https://doi.org/10.1145/3266157.3266212","url":null,"abstract":"Step detection with accelerometers is a very common feature that smart wearables already include. However, when using a wheeled walking frame / rollator, current algorithms may be of limited use, since a different type of motion is being excreted. In this paper, we uncover these limitations of current wearables by a pilot study. Furthermore, we investigated an accelerometer-based step detection for using a wheeled walking frame, when mounting an accelerometer to the frame and at the user's wrist. Our findings include knowledge on signal propagation of each axis, knowledge on the required sensor quality and knowledge on the impact of different surfaces and floor types. In conclusion, we outline a new step detection algorithm based on accelerometer input data. Our algorithm can significantly empower future off-the-shelf wearables with the capability to sufficiently detect steps with elderly people using a wheeled walking frame. This can help to evaluate the state of health with regard to the human behavior and motor system and even to determine the progress of certain diseases.","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121771892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Towards a task-driven framework for multimodal fatigue analysis during physical and cognitive tasks 在物理和认知任务过程中对多模态疲劳分析的任务驱动框架
K. Tsiakas, Michalis Papakostas, J. Ford, F. Makedon
This paper outlines the development of a task-driven framework for multimodal fatigue analysis during physical and cognitive tasks. While fatigue is a common symptom across several neurological chronic diseases, such as multiple sclerosis (MS), traumatic brain injury (TBI), cerebral palsy (CP) and others, it remains poorly understood, due to various reasons, including subjectivity and variability amongst individuals. Towards this end, we propose a task-driven data collection framework for multimodal fatigue analysis, in the domain of MS, combining behavioral, sensory and subjective measures, while users perform a set of both physical and cognitive tasks, including assessment tests and Activities of Daily Living (ADLs).
本文概述了在物理和认知任务期间进行多模态疲劳分析的任务驱动框架的发展。虽然疲劳是几种神经系统慢性疾病的常见症状,如多发性硬化症(MS)、创伤性脑损伤(TBI)、脑瘫(CP)等,但由于各种原因,包括个人的主观性和可变性,对疲劳的了解仍然很少。为此,我们提出了一个任务驱动的数据收集框架,用于MS领域的多模态疲劳分析,结合行为、感官和主观测量,同时用户执行一组物理和认知任务,包括评估测试和日常生活活动(adl)。
{"title":"Towards a task-driven framework for multimodal fatigue analysis during physical and cognitive tasks","authors":"K. Tsiakas, Michalis Papakostas, J. Ford, F. Makedon","doi":"10.1145/3266157.3266222","DOIUrl":"https://doi.org/10.1145/3266157.3266222","url":null,"abstract":"This paper outlines the development of a task-driven framework for multimodal fatigue analysis during physical and cognitive tasks. While fatigue is a common symptom across several neurological chronic diseases, such as multiple sclerosis (MS), traumatic brain injury (TBI), cerebral palsy (CP) and others, it remains poorly understood, due to various reasons, including subjectivity and variability amongst individuals. Towards this end, we propose a task-driven data collection framework for multimodal fatigue analysis, in the domain of MS, combining behavioral, sensory and subjective measures, while users perform a set of both physical and cognitive tasks, including assessment tests and Activities of Daily Living (ADLs).","PeriodicalId":151070,"journal":{"name":"Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117266617","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1