首页 > 最新文献

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.最新文献

英文 中文
Multi-Subject 3D Human Mesh Construction Using Commodity WiFi 利用商品 WiFi 构建多主体 3D 人体网格
Pub Date : 2024-03-06 DOI: 10.1145/3643504
Yichao Wang, Yili Ren, Jie Yang
This paper introduces MultiMesh, a multi-subject 3D human mesh construction system based on commodity WiFi. Our system can reuse commodity WiFi devices in the environment and is capable of working in non-line-of-sight (NLoS) conditions compared with the traditional computer vision-based approach. Specifically, we leverage an L-shaped antenna array to generate the two-dimensional angle of arrival (2D AoA) of reflected signals for subject separation in the physical space. We further leverage the angle of departure and time of flight of the signal to enhance the resolvability for precise separation of close subjects. Then we exploit information from various signal dimensions to mitigate the interference of indirect reflections according to different signal propagation paths. Moreover, we employ the continuity of human movement in the spatial-temporal domain to track weak reflected signals of faraway subjects. Finally, we utilize a deep learning model to digitize 2D AoA images of each subject into the 3D human mesh. We conducted extensive experiments in real-world multi-subject scenarios under various environments to evaluate the performance of our system. For example, we conduct experiments with occlusion and perform human mesh construction for different distances between two subjects and different distances between subjects and WiFi devices. The results show that MultiMesh can accurately construct 3D human meshes for multiple users with an average vertex error of 4cm. The evaluations also demonstrate that our system could achieve comparable performance for unseen environments and people. Moreover, we also evaluate the accuracy of spatial information extraction and the performance of subject detection. These evaluations demonstrate the robustness and effectiveness of our system.
本文介绍了基于商用 WiFi 的多主体 3D 人体网格构建系统 MultiMesh。与传统的基于计算机视觉的方法相比,我们的系统可以重复使用环境中的商用 WiFi 设备,并且能够在非视线(NLoS)条件下工作。具体来说,我们利用 L 型天线阵列生成反射信号的二维到达角(2D AoA),以便在物理空间中进行主体分离。我们进一步利用信号的离去角和飞行时间来提高精确分离近距离物体的分辨率。然后,我们利用各种信号维度的信息,根据不同的信号传播路径来减轻间接反射的干扰。此外,我们还利用时空域中人体运动的连续性来跟踪远处主体的微弱反射信号。最后,我们利用深度学习模型将每个受试者的 2D AoA 图像数字化为 3D 人体网格。我们在各种环境下的真实世界多主体场景中进行了大量实验,以评估我们系统的性能。例如,我们进行了遮挡实验,并在两个受试者之间的不同距离以及受试者与 WiFi 设备之间的不同距离下进行了人体网格构建。结果表明,MultiMesh 可以为多个用户准确构建三维人体网格,平均顶点误差为 4 厘米。评估结果还表明,我们的系统可以在不可见的环境和人物中实现相当的性能。此外,我们还评估了空间信息提取的准确性和主体检测的性能。这些评估证明了我们系统的鲁棒性和有效性。
{"title":"Multi-Subject 3D Human Mesh Construction Using Commodity WiFi","authors":"Yichao Wang, Yili Ren, Jie Yang","doi":"10.1145/3643504","DOIUrl":"https://doi.org/10.1145/3643504","url":null,"abstract":"This paper introduces MultiMesh, a multi-subject 3D human mesh construction system based on commodity WiFi. Our system can reuse commodity WiFi devices in the environment and is capable of working in non-line-of-sight (NLoS) conditions compared with the traditional computer vision-based approach. Specifically, we leverage an L-shaped antenna array to generate the two-dimensional angle of arrival (2D AoA) of reflected signals for subject separation in the physical space. We further leverage the angle of departure and time of flight of the signal to enhance the resolvability for precise separation of close subjects. Then we exploit information from various signal dimensions to mitigate the interference of indirect reflections according to different signal propagation paths. Moreover, we employ the continuity of human movement in the spatial-temporal domain to track weak reflected signals of faraway subjects. Finally, we utilize a deep learning model to digitize 2D AoA images of each subject into the 3D human mesh. We conducted extensive experiments in real-world multi-subject scenarios under various environments to evaluate the performance of our system. For example, we conduct experiments with occlusion and perform human mesh construction for different distances between two subjects and different distances between subjects and WiFi devices. The results show that MultiMesh can accurately construct 3D human meshes for multiple users with an average vertex error of 4cm. The evaluations also demonstrate that our system could achieve comparable performance for unseen environments and people. Moreover, we also evaluate the accuracy of spatial information extraction and the performance of subject detection. These evaluations demonstrate the robustness and effectiveness of our system.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"14 3","pages":"23:1-23:25"},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140260952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ViObject: Harness Passive Vibrations for Daily Object Recognition with Commodity Smartwatches ViObject:利用商品智能手表的被动振动进行日常物体识别
Pub Date : 2024-03-06 DOI: 10.1145/3643547
Wenqiang Chen, Shupei Lin, Zhencan Peng, Farshid Salemi Parizi, Seongkook Heo, Shwetak Patel, Wojciech Matusik, Wei Zhao, Jack Stankovic
Knowing the object grabbed by a hand can offer essential contextual information for interaction between the human and the physical world. This paper presents a novel system, ViObject, for passive object recognition that uses accelerometer and gyroscope sensor data from commodity smartwatches to identify untagged everyday objects. The system relies on the vibrations caused by grabbing objects and does not require additional hardware or human effort. ViObject's ability to recognize objects passively can have important implications for a wide range of applications, from smart home automation to healthcare and assistive technologies. In this paper, we present the design and implementation of ViObject, to address challenges such as motion interference, different object-touching positions, different grasp speeds/pressure, and model customization to new users and new objects. We evaluate the system's performance using a dataset of 20 objects from 20 participants and show that ViObject achieves an average accuracy of 86.4%. We also customize models for new users and new objects, achieving an average accuracy of 90.1%. Overall, ViObject demonstrates a novel technology concept of passive object recognition using commodity smartwatches and opens up new avenues for research and innovation in this area.
了解手抓住的物体可以为人与物理世界的交互提供重要的上下文信息。本文介绍了一种用于被动物体识别的新型系统 ViObject,该系统利用来自商品智能手表的加速计和陀螺仪传感器数据来识别未标记的日常物体。该系统依赖于抓取物体时产生的振动,不需要额外的硬件或人力。ViObject 能够被动地识别物体,这对从智能家居自动化到医疗保健和辅助技术的广泛应用具有重要意义。在本文中,我们介绍了 ViObject 的设计和实现,以应对运动干扰、不同的物体触摸位置、不同的抓取速度/压力以及针对新用户和新物体的模型定制等挑战。我们使用来自 20 位参与者的 20 个对象的数据集对该系统的性能进行了评估,结果表明 ViObject 的平均准确率达到了 86.4%。我们还为新用户和新对象定制了模型,平均准确率达到 90.1%。总之,ViObject 展示了利用商品智能手表进行被动物体识别的新技术概念,并为该领域的研究和创新开辟了新途径。
{"title":"ViObject: Harness Passive Vibrations for Daily Object Recognition with Commodity Smartwatches","authors":"Wenqiang Chen, Shupei Lin, Zhencan Peng, Farshid Salemi Parizi, Seongkook Heo, Shwetak Patel, Wojciech Matusik, Wei Zhao, Jack Stankovic","doi":"10.1145/3643547","DOIUrl":"https://doi.org/10.1145/3643547","url":null,"abstract":"Knowing the object grabbed by a hand can offer essential contextual information for interaction between the human and the physical world. This paper presents a novel system, ViObject, for passive object recognition that uses accelerometer and gyroscope sensor data from commodity smartwatches to identify untagged everyday objects. The system relies on the vibrations caused by grabbing objects and does not require additional hardware or human effort. ViObject's ability to recognize objects passively can have important implications for a wide range of applications, from smart home automation to healthcare and assistive technologies. In this paper, we present the design and implementation of ViObject, to address challenges such as motion interference, different object-touching positions, different grasp speeds/pressure, and model customization to new users and new objects. We evaluate the system's performance using a dataset of 20 objects from 20 participants and show that ViObject achieves an average accuracy of 86.4%. We also customize models for new users and new objects, achieving an average accuracy of 90.1%. Overall, ViObject demonstrates a novel technology concept of passive object recognition using commodity smartwatches and opens up new avenues for research and innovation in this area.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"42 8","pages":"5:1-5:26"},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140261661","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Lateralization Effects in Electrodermal Activity Data Collected Using Wearable Devices 使用可穿戴设备收集的皮电活动数据的侧化效应
Pub Date : 2024-03-06 DOI: 10.1145/3643541
Leonardo Alchieri, Nouran Abdalazim, Lidia Alecci, Shkurta Gashi, M. Gjoreski, Silvia Santini
Electrodermal activity (EDA) is a physiological signal that can be used to infer humans' affective states and stress levels. EDA can nowadays be monitored using unobtrusive wearable devices, such as smartwatches, and leveraged in personal informatics systems. A still largely uncharted issue concerning EDA is the impact on real applications of potential differences observable on signals measured concurrently on the left and right side of the human body. This phenomenon, called lateralization, originates from the distinct functions that the brain's left and right hemispheres exert on EDA. In this work, we address this issue by examining the impact of EDA lateralization in two classification tasks: a cognitive load recognition task executed in the lab and a sleep monitoring task in a real-world setting. We implement a machine learning pipeline to compare the performance obtained on both classification tasks using EDA data collected from the left and right sides of the body. Our results show that using EDA from the side that is not associated with the specific hemisphere activation leads to a significant decline in performance for the considered classification tasks. This finding highlights that researchers and practitioners relying on EDA data should consider possible EDA lateralization effects when deciding on sensor placement.
皮电活动(EDA)是一种生理信号,可用于推断人类的情感状态和压力水平。如今,EDA 可通过智能手表等不显眼的可穿戴设备进行监测,并可在个人信息系统中加以利用。有关 EDA 的一个仍未解决的问题是,在人体左右两侧同时测量的信号所观察到的潜在差异对实际应用的影响。这种现象被称为 "侧化",源于大脑左右半球对 EDA 的不同功能。在这项工作中,我们通过研究 EDA 侧向化在两个分类任务中的影响来解决这个问题:一个是在实验室中执行的认知负荷识别任务,另一个是在真实世界环境中执行的睡眠监测任务。我们实施了一个机器学习管道,使用从身体左右两侧收集的 EDA 数据来比较这两项分类任务的性能。我们的结果表明,使用与特定半球激活无关的一侧的 EDA 会导致所考虑的分类任务的性能显著下降。这一发现突出表明,研究人员和从业人员在决定传感器位置时,应考虑使用 EDA 数据可能产生的 EDA 侧化效应。
{"title":"Lateralization Effects in Electrodermal Activity Data Collected Using Wearable Devices","authors":"Leonardo Alchieri, Nouran Abdalazim, Lidia Alecci, Shkurta Gashi, M. Gjoreski, Silvia Santini","doi":"10.1145/3643541","DOIUrl":"https://doi.org/10.1145/3643541","url":null,"abstract":"Electrodermal activity (EDA) is a physiological signal that can be used to infer humans' affective states and stress levels. EDA can nowadays be monitored using unobtrusive wearable devices, such as smartwatches, and leveraged in personal informatics systems. A still largely uncharted issue concerning EDA is the impact on real applications of potential differences observable on signals measured concurrently on the left and right side of the human body. This phenomenon, called lateralization, originates from the distinct functions that the brain's left and right hemispheres exert on EDA. In this work, we address this issue by examining the impact of EDA lateralization in two classification tasks: a cognitive load recognition task executed in the lab and a sleep monitoring task in a real-world setting. We implement a machine learning pipeline to compare the performance obtained on both classification tasks using EDA data collected from the left and right sides of the body. Our results show that using EDA from the side that is not associated with the specific hemisphere activation leads to a significant decline in performance for the considered classification tasks. This finding highlights that researchers and practitioners relying on EDA data should consider possible EDA lateralization effects when deciding on sensor placement.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"65 3","pages":"2:1-2:30"},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140261501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Embracing Distributed Acoustic Sensing in Car Cabin for Children Presence Detection 在车厢内采用分布式声学传感技术检测儿童是否存在
Pub Date : 2024-03-06 DOI: 10.1145/3643548
Yuqi Su, Fusang Zhang, Kai Niu, Tianben Wang, Beihong Jin, Zhi Wang, Yalan Jiang, Daqing Zhang, Lili Qiu, Jie Xiong
Contactless acoustic sensing has been actively exploited in the past few years to enable a large range of applications, ranging from fine-grained vital sign monitoring to coarse-grained human tracking. However, existing acoustic sensing systems mainly work on smartphone or smart speaker platforms. In this paper, we envision an exciting new acoustic sensing platform, i.e., car cabin which is inherently embedded with a large number of speakers and microphones. We propose the new concept of distributed acoustic sensing and develop novel designs leveraging the unique characteristics of rich multi-path in car cabin to enable fine-grained sensing even when the primary reflection is totally blocked. By using child presence detection as the application example, we show that child presence can be detected through body motions or even subtle breath (when the child is sleeping or in coma) at all locations in the cabin without any blind spots. We further show that the proposed system can robustly work in different car cabins, achieving an average detection accuracy of 97% and a false alarm rate always below 2% under different scenarios including those challenging ones such as rear-facing seat blockage. We believe the proposed distributed sensing modality in car cabin pushes acoustic sensing one big step towards real-life adoption.
在过去几年中,非接触式声学传感技术得到了积极开发,实现了从细粒度生命体征监测到粗粒度人体追踪等多种应用。然而,现有的声学传感系统主要工作在智能手机或智能扬声器平台上。在本文中,我们设想了一个令人兴奋的新声学传感平台,即本身就嵌入了大量扬声器和麦克风的汽车座舱。我们提出了分布式声学传感的新概念,并利用汽车舱内丰富的多路径的独特特性开发了新颖的设计,即使在主反射完全被阻挡的情况下也能实现细粒度传感。通过使用儿童存在检测作为应用实例,我们展示了可以通过车厢内所有位置的身体运动甚至细微呼吸(当儿童熟睡或昏迷时)来检测儿童的存在,而不会出现任何盲点。我们还进一步证明,所提出的系统可以在不同的车厢内稳定工作,在不同的场景下,包括那些具有挑战性的场景,如后排座椅堵塞,平均检测准确率达到 97%,误报率始终低于 2%。我们相信,所提出的汽车座舱分布式传感模式将声学传感向现实生活中的应用推进了一大步。
{"title":"Embracing Distributed Acoustic Sensing in Car Cabin for Children Presence Detection","authors":"Yuqi Su, Fusang Zhang, Kai Niu, Tianben Wang, Beihong Jin, Zhi Wang, Yalan Jiang, Daqing Zhang, Lili Qiu, Jie Xiong","doi":"10.1145/3643548","DOIUrl":"https://doi.org/10.1145/3643548","url":null,"abstract":"Contactless acoustic sensing has been actively exploited in the past few years to enable a large range of applications, ranging from fine-grained vital sign monitoring to coarse-grained human tracking. However, existing acoustic sensing systems mainly work on smartphone or smart speaker platforms. In this paper, we envision an exciting new acoustic sensing platform, i.e., car cabin which is inherently embedded with a large number of speakers and microphones. We propose the new concept of distributed acoustic sensing and develop novel designs leveraging the unique characteristics of rich multi-path in car cabin to enable fine-grained sensing even when the primary reflection is totally blocked. By using child presence detection as the application example, we show that child presence can be detected through body motions or even subtle breath (when the child is sleeping or in coma) at all locations in the cabin without any blind spots. We further show that the proposed system can robustly work in different car cabins, achieving an average detection accuracy of 97% and a false alarm rate always below 2% under different scenarios including those challenging ones such as rear-facing seat blockage. We believe the proposed distributed sensing modality in car cabin pushes acoustic sensing one big step towards real-life adoption.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"14 3","pages":"16:1-16:28"},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140262283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AquaKey: Exploiting the Randomness of the Underwater Visible Light Communication Channel for Key Extraction AquaKey:利用水下可见光通信信道的随机性提取密钥
Pub Date : 2024-03-06 DOI: 10.1145/3643557
Lupeng Zhang, Pingchuan Wang, Minhao Cui, Jingwen Wei, Yu Tian, Jingchi Zhang, Jie Xiong, Lei Wang
Underwater Visible Light Communication (UVLC) is promising due to its relatively strong penetration capability in water and large frequency bandwidth. Visible Light Communication (VLC) is also considered a safer wireless communication paradigm as light signals can be constrained within the area of interest with obstacles such as walls, reducing the chance of potential attack. However, this intuitional security assumption is not true anymore in underwater environment. Recent research shows that the eavesdropping risk of UVLC is more severe than we thought, attributed to the divergence and scattering effects of light beams in water. In this paper, we harness the dynamic nature of underwater environments as a true random resource to extract symmetric keys for UVLC. Specifically, the proposed AquaKey system incorporates instantaneous bidirectional channel probing, computation of relative channel characteristics, and an environment-adaptive quantization algorithm. The above design addresses unique challenges caused by the dynamic underwater environment, including self-interference, high-frequency disturbance, and mismatch, ensuring the practicality and applicability of AquaKey. Additionally, AquaKey has negligible impact on communication and has no effect on the illumination function. Through extensive real-world experiments, we show that AquaKey can achieve reliable key extraction with cheap hardware, generating a 512-bit key in just 0.5-1 seconds.
水下可见光通信(UVLC)因其在水中相对较强的穿透能力和较大的频率带宽而前景广阔。可见光通信(VLC)也被认为是一种更安全的无线通信模式,因为光信号可以通过墙壁等障碍物限制在感兴趣的区域内,从而减少潜在攻击的机会。然而,这种直观的安全假设在水下环境中不再适用。最新研究表明,由于光束在水中的发散和散射效应,UVLC 的窃听风险比我们想象的要严重得多。在本文中,我们利用水下环境的动态特性作为真正的随机资源,为 UVLC 提取对称密钥。具体来说,所提出的 AquaKey 系统包含瞬时双向信道探测、相对信道特性计算和环境适应量化算法。上述设计解决了动态水下环境带来的独特挑战,包括自干扰、高频干扰和不匹配,确保了 AquaKey 的实用性和适用性。此外,AquaKey 对通信的影响可以忽略不计,对照明功能也没有影响。通过大量实际实验,我们证明 AquaKey 可以用廉价的硬件实现可靠的密钥提取,只需 0.5-1 秒即可生成 512 位密钥。
{"title":"AquaKey: Exploiting the Randomness of the Underwater Visible Light Communication Channel for Key Extraction","authors":"Lupeng Zhang, Pingchuan Wang, Minhao Cui, Jingwen Wei, Yu Tian, Jingchi Zhang, Jie Xiong, Lei Wang","doi":"10.1145/3643557","DOIUrl":"https://doi.org/10.1145/3643557","url":null,"abstract":"Underwater Visible Light Communication (UVLC) is promising due to its relatively strong penetration capability in water and large frequency bandwidth. Visible Light Communication (VLC) is also considered a safer wireless communication paradigm as light signals can be constrained within the area of interest with obstacles such as walls, reducing the chance of potential attack. However, this intuitional security assumption is not true anymore in underwater environment. Recent research shows that the eavesdropping risk of UVLC is more severe than we thought, attributed to the divergence and scattering effects of light beams in water. In this paper, we harness the dynamic nature of underwater environments as a true random resource to extract symmetric keys for UVLC. Specifically, the proposed AquaKey system incorporates instantaneous bidirectional channel probing, computation of relative channel characteristics, and an environment-adaptive quantization algorithm. The above design addresses unique challenges caused by the dynamic underwater environment, including self-interference, high-frequency disturbance, and mismatch, ensuring the practicality and applicability of AquaKey. Additionally, AquaKey has negligible impact on communication and has no effect on the illumination function. Through extensive real-world experiments, we show that AquaKey can achieve reliable key extraction with cheap hardware, generating a 512-bit key in just 0.5-1 seconds.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"22 S2","pages":"28:1-28:25"},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140262503","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
EarSlide: a Secure Ear Wearables Biometric Authentication Based on Acoustic Fingerprint EarSlide:基于声学指纹的安全耳戴式生物识别认证技术
Pub Date : 2024-03-06 DOI: 10.1145/3643515
Zi Wang, Yilin Wang, Jie Yang
Ear wearables (earables) are emerging platforms that are broadly adopted in various applications. There is an increasing demand for robust earables authentication because of the growing amount of sensitive information and the IoT devices that the earable could access. Traditional authentication methods become less feasible due to the limited input interface of earables. Nevertheless, the rich head-related sensing capabilities of earables can be exploited to capture human biometrics. In this paper, we propose EarSlide, an earable biometric authentication system utilizing the advanced sensing capacities of earables and the distinctive features of acoustic fingerprints when users slide their fingers on the face. It utilizes the inward-facing microphone of the earables and the face-ear channel of the ear canal to reliably capture the acoustic fingerprint. In particular, we study the theory of friction sound and categorize the characteristics of the acoustic fingerprints into three representative classes, pattern-class, ridge-groove-class, and coupling-class. Different from traditional fingerprint authentication only utilizes 2D patterns, we incorporate the 3D information in acoustic fingerprint and indirectly sense the fingerprint for authentication. We then design representative sliding gestures that carry rich information about the acoustic fingerprint while being easy to perform. It then extracts multi-class acoustic fingerprint features to reflect the inherent acoustic fingerprint characteristic for authentication. We also adopt an adaptable authentication model and a user behavior mitigation strategy to effectively authenticate legit users from adversaries. The key advantages of EarSlide are that it is resistant to spoofing attacks and its wide acceptability. Our evaluation of EarSlide in diverse real-world environments with intervals over one year shows that EarSlide achieves an average balanced accuracy rate of 98.37% with only one sliding gesture.
耳戴式设备(耳可穿戴设备)是一种新兴平台,在各种应用中被广泛采用。由于耳戴式设备可以访问越来越多的敏感信息和物联网设备,因此对强大的耳戴式设备身份验证的需求日益增长。由于耳机的输入接口有限,传统的身份验证方法变得不那么可行。然而,我们可以利用耳机丰富的头部相关传感能力来捕捉人体生物特征。在本文中,我们提出了耳滑式生物识别身份验证系统(EarSlide),它利用了耳机先进的传感能力和用户手指在面部滑动时声学指纹的独特特征。它利用耳机朝内的麦克风和耳道的面耳通道来可靠地捕捉声学指纹。我们特别研究了摩擦音理论,并将声学指纹的特征分为三个具有代表性的类别:花纹类、脊沟类和耦合类。与传统的指纹认证仅利用二维图案不同,我们在声学指纹中加入了三维信息,间接感知指纹进行认证。然后,我们设计了具有代表性的滑动手势,这些手势既包含丰富的声学指纹信息,又易于操作。然后提取多类声学指纹特征,以反映声学指纹的固有特性,用于身份验证。我们还采用了一种适应性强的认证模型和一种用户行为缓解策略,以有效地认证合法用户,防止被对手利用。EarSlide 的主要优势在于它能抵御欺骗攻击,并具有广泛的可接受性。我们在不同的真实环境中对 EarSlide 进行了为期一年的评估,结果表明,EarSlide 只需一个滑动手势即可达到 98.37% 的平均平衡准确率。
{"title":"EarSlide: a Secure Ear Wearables Biometric Authentication Based on Acoustic Fingerprint","authors":"Zi Wang, Yilin Wang, Jie Yang","doi":"10.1145/3643515","DOIUrl":"https://doi.org/10.1145/3643515","url":null,"abstract":"Ear wearables (earables) are emerging platforms that are broadly adopted in various applications. There is an increasing demand for robust earables authentication because of the growing amount of sensitive information and the IoT devices that the earable could access. Traditional authentication methods become less feasible due to the limited input interface of earables. Nevertheless, the rich head-related sensing capabilities of earables can be exploited to capture human biometrics. In this paper, we propose EarSlide, an earable biometric authentication system utilizing the advanced sensing capacities of earables and the distinctive features of acoustic fingerprints when users slide their fingers on the face. It utilizes the inward-facing microphone of the earables and the face-ear channel of the ear canal to reliably capture the acoustic fingerprint. In particular, we study the theory of friction sound and categorize the characteristics of the acoustic fingerprints into three representative classes, pattern-class, ridge-groove-class, and coupling-class. Different from traditional fingerprint authentication only utilizes 2D patterns, we incorporate the 3D information in acoustic fingerprint and indirectly sense the fingerprint for authentication. We then design representative sliding gestures that carry rich information about the acoustic fingerprint while being easy to perform. It then extracts multi-class acoustic fingerprint features to reflect the inherent acoustic fingerprint characteristic for authentication. We also adopt an adaptable authentication model and a user behavior mitigation strategy to effectively authenticate legit users from adversaries. The key advantages of EarSlide are that it is resistant to spoofing attacks and its wide acceptability. Our evaluation of EarSlide in diverse real-world environments with intervals over one year shows that EarSlide achieves an average balanced accuracy rate of 98.37% with only one sliding gesture.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"27 19","pages":"24:1-24:29"},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140262691","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Light and Dark Mode: A Comparison Between Android and iOS App UI Modes and Interviews with App Designers and Developers 明暗模式:安卓和 iOS 应用程序 UI 模式比较以及对应用程序设计师和开发人员的访谈
Pub Date : 2024-03-06 DOI: 10.1145/3643539
Sarah Andrew, Chelsea Bishop, Garreth W. Tigwell
Mobile app light and dark modes offer improved usability within different contexts (e.g., dark mode for easier night reading). Yet, little research has investigated the prevalence of light and dark modes across platforms, the intricacies of UI color changes, and challenges in the design and development process. Our investigation focused on comparing light and dark mode designs. We carried out a manual inspection of 120 popular Android and iOS apps to find that only 55% (Android) and 48% (iOS) of the apps included any modes. We also found significant variability in how many UI elements changed between modes. We interviewed 15 designers and developers to understand the creative process, motivations for design decisions, and what challenges exist in the processes that affect alternative mode implementation. We identified several issues that HCI researchers are equipped to solve, ultimately improving support for mobile app creators looking to implement dark modes (and beyond) for increased mobile usability in different contexts.
移动应用程序的明暗模式可在不同环境下提高可用性(例如,暗模式便于夜间阅读)。然而,关于明暗模式在不同平台上的流行程度、用户界面颜色变化的复杂性以及设计和开发过程中的挑战等方面的研究却很少。我们的调查重点是比较明暗模式设计。我们对 120 个流行的安卓和 iOS 应用程序进行了人工检查,发现只有 55% (安卓)和 48% (iOS)的应用程序包含任何模式。我们还发现,在不同模式下,用户界面元素的变化也存在很大差异。我们采访了 15 位设计师和开发人员,以了解创意过程、设计决策的动机以及影响替代模式实施的过程中存在的挑战。我们发现了人机交互研究人员有能力解决的几个问题,最终改善了对移动应用程序创建者的支持,这些创建者希望实施暗模式(以及其他模式)以提高不同环境下的移动可用性。
{"title":"Light and Dark Mode: A Comparison Between Android and iOS App UI Modes and Interviews with App Designers and Developers","authors":"Sarah Andrew, Chelsea Bishop, Garreth W. Tigwell","doi":"10.1145/3643539","DOIUrl":"https://doi.org/10.1145/3643539","url":null,"abstract":"Mobile app light and dark modes offer improved usability within different contexts (e.g., dark mode for easier night reading). Yet, little research has investigated the prevalence of light and dark modes across platforms, the intricacies of UI color changes, and challenges in the design and development process. Our investigation focused on comparing light and dark mode designs. We carried out a manual inspection of 120 popular Android and iOS apps to find that only 55% (Android) and 48% (iOS) of the apps included any modes. We also found significant variability in how many UI elements changed between modes. We interviewed 15 designers and developers to understand the creative process, motivations for design decisions, and what challenges exist in the processes that affect alternative mode implementation. We identified several issues that HCI researchers are equipped to solve, ultimately improving support for mobile app creators looking to implement dark modes (and beyond) for increased mobile usability in different contexts.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"30 12","pages":"32:1-32:23"},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140262811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Investigating Technology Adoption Soon After Sustaining a Spinal Cord Injury 调查脊髓损伤后不久的技术采用情况
Pub Date : 2024-03-06 DOI: 10.1145/3643507
Tamanna Motahar, Jason Wiese
A spinal cord injury (SCI) typically results in a sudden change to an individual's motor function. People's adoption of technology soon after a severe SCI is crucial, since they must relearn most technology interactions to adjust to their new physical abilities and regain independence. This study examines how individuals adopt technologies soon after sustaining a severe SCI. By qualitatively analyzing the perspectives of ten rehabilitation clinicians, three individuals who recently sustained an SCI, and two of those participants' family members, we surfaced a spectrum of individuals' motivations to adopt technology post-injury and highlight the challenges they face to adopt technology. Our findings highlight the need to incorporate the holistic experience---including technology literacy, perception of support, and acceptance of the "new-normal"---in technology design for individuals who have a sudden change to motor functions. Our findings show that technology adoption is a critical component for the overall adjustment of post-SCI life. Finally, we use the extended version of the Technology Acceptance Model (TAM) to make recommendations for more inclusive assistive design.
脊髓损伤(SCI)通常会导致个人运动功能的突然改变。严重脊髓损伤后不久,人们就必须重新学习大多数技术互动,以适应新的身体能力并重新获得独立,因此采用技术至关重要。本研究探讨了个人在遭受严重 SCI 后不久是如何采用技术的。通过定性分析十位康复临床医生、三位刚患 SCI 的患者以及其中两位患者家属的观点,我们揭示了患者在受伤后采用技术的动机,并强调了他们在采用技术时所面临的挑战。我们的研究结果突出表明,在为运动功能突然发生变化的人设计技术时,需要考虑到整体体验,包括技术素养、对支持的感知以及对 "新常态 "的接受程度。我们的研究结果表明,技术的采用是SCI后生活整体适应的关键组成部分。最后,我们使用扩展版技术接受模型(TAM)为更具包容性的辅助设计提出建议。
{"title":"Investigating Technology Adoption Soon After Sustaining a Spinal Cord Injury","authors":"Tamanna Motahar, Jason Wiese","doi":"10.1145/3643507","DOIUrl":"https://doi.org/10.1145/3643507","url":null,"abstract":"A spinal cord injury (SCI) typically results in a sudden change to an individual's motor function. People's adoption of technology soon after a severe SCI is crucial, since they must relearn most technology interactions to adjust to their new physical abilities and regain independence. This study examines how individuals adopt technologies soon after sustaining a severe SCI. By qualitatively analyzing the perspectives of ten rehabilitation clinicians, three individuals who recently sustained an SCI, and two of those participants' family members, we surfaced a spectrum of individuals' motivations to adopt technology post-injury and highlight the challenges they face to adopt technology. Our findings highlight the need to incorporate the holistic experience---including technology literacy, perception of support, and acceptance of the \"new-normal\"---in technology design for individuals who have a sudden change to motor functions. Our findings show that technology adoption is a critical component for the overall adjustment of post-SCI life. Finally, we use the extended version of the Technology Acceptance Model (TAM) to make recommendations for more inclusive assistive design.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"15 1","pages":"14:1-14:24"},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140263236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
TouchKey: Touch to Generate Symmetric Keys by Skin Electric Potentials Induced by Powerline Radiation 触控键:通过触控产生由电力线辐射引起的皮肤电势的对称键
Pub Date : 2023-06-12 DOI: 10.1145/3596264
Y. Miao, Zhenyu Yan, HU Wen, Chaojie Gu, Yiu Chau, Rui Tan, Qi Lin
Secure device pairing is important to wearables. Existing solutions either degrade usability due to the need of specific actions like shaking, or they lack universality due to the need of dedicated hardware like electrocardiogram sensors. This paper proposes TouchKey, a symmetric key generation scheme that exploits the skin electric potential (SEP) induced by powerline electromagnetic radiation. The SEP is ubiquitously accessible indoors with analog-to-digital converters widely available on Internet of Things devices. Our measurements show that the SEP has high randomness and the SEPs measured at two close locations on the same human body are similar. Extensive experiments show that TouchKey achieves a high key generation rate of 345 bit/s and an average success rate of 99.29%. Under a range of adversary models including active and passive attacks, TouchKey shows a low false acceptance rate of 0.86%, which outperforms existing solutions. Besides, the overall execution time and energy usage are 0.44 s and 2.716 mJ, which make it suitable for resource-constrained devices.
安全的设备配对对可穿戴设备很重要。现有的解决方案要么因为需要特定的动作(如摇动)而降低可用性
{"title":"TouchKey: Touch to Generate Symmetric Keys by Skin Electric Potentials Induced by Powerline Radiation","authors":"Y. Miao, Zhenyu Yan, HU Wen, Chaojie Gu, Yiu Chau, Rui Tan, Qi Lin","doi":"10.1145/3596264","DOIUrl":"https://doi.org/10.1145/3596264","url":null,"abstract":"Secure device pairing is important to wearables. Existing solutions either degrade usability due to the need of specific actions like shaking, or they lack universality due to the need of dedicated hardware like electrocardiogram sensors. This paper proposes TouchKey, a symmetric key generation scheme that exploits the skin electric potential (SEP) induced by powerline electromagnetic radiation. The SEP is ubiquitously accessible indoors with analog-to-digital converters widely available on Internet of Things devices. Our measurements show that the SEP has high randomness and the SEPs measured at two close locations on the same human body are similar. Extensive experiments show that TouchKey achieves a high key generation rate of 345 bit/s and an average success rate of 99.29%. Under a range of adversary models including active and passive attacks, TouchKey shows a low false acceptance rate of 0.86%, which outperforms existing solutions. Besides, the overall execution time and energy usage are 0.44 s and 2.716 mJ, which make it suitable for resource-constrained devices.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"40 1","pages":"1 - 21"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81731458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DisPad: Flexible On-Body Displacement of Fabric Sensors for Robust Joint-Motion Tracking DisPad:用于强健关节运动跟踪的柔性体上位移织物传感器
Pub Date : 2023-01-16 DOI: 10.48550/arXiv.2301.06249
Xiaowei Chen, Xiao Jiang, Jia-Qi Fang, Shihui Guo, Juncong Lin, Minghong Liao, Guoliang Luo, Hongbo Fu
The last few decades have witnessed an emerging trend of wearable soft sensors; however, there are important signal-processing challenges for soft sensors that still limit their practical deployment. They are error-prone when displaced, resulting in significant deviations from their ideal sensor output. In this work, we propose a novel prototype that integrates an elbow pad with a sparse network of soft sensors. Our prototype is fully bio-compatible, stretchable, and wearable. We develop a learning-based method to predict the elbow orientation angle and achieve an average tracking error of 9.82 degrees for single-user multi-motion experiments. With transfer learning, our method achieves the average tracking errors of 10.98 degrees and 11.81 degrees across different motion types and users, respectively. Our core contributions lie in a solution that realizes robust and stable human joint motion tracking across different device displacements.
过去几十年见证了可穿戴软传感器的新兴趋势;然而,软传感器在信号处理方面仍存在重要挑战,这限制了它们的实际应用。当位移时,它们容易出错,导致与理想传感器输出的显著偏差。在这项工作中,我们提出了一种新颖的原型,将肘部垫与稀疏的软传感器网络集成在一起。我们的原型是完全生物兼容的,可拉伸的,可穿戴的。我们开发了一种基于学习的方法来预测肘关节方向角,在单用户多动作实验中实现了平均9.82度的跟踪误差。通过迁移学习,我们的方法在不同运动类型和不同用户上的平均跟踪误差分别为10.98度和11.81度。我们的核心贡献在于实现跨不同设备位移的鲁棒和稳定的人体关节运动跟踪的解决方案。
{"title":"DisPad: Flexible On-Body Displacement of Fabric Sensors for Robust Joint-Motion Tracking","authors":"Xiaowei Chen, Xiao Jiang, Jia-Qi Fang, Shihui Guo, Juncong Lin, Minghong Liao, Guoliang Luo, Hongbo Fu","doi":"10.48550/arXiv.2301.06249","DOIUrl":"https://doi.org/10.48550/arXiv.2301.06249","url":null,"abstract":"The last few decades have witnessed an emerging trend of wearable soft sensors; however, there are important signal-processing challenges for soft sensors that still limit their practical deployment. They are error-prone when displaced, resulting in significant deviations from their ideal sensor output. In this work, we propose a novel prototype that integrates an elbow pad with a sparse network of soft sensors. Our prototype is fully bio-compatible, stretchable, and wearable. We develop a learning-based method to predict the elbow orientation angle and achieve an average tracking error of 9.82 degrees for single-user multi-motion experiments. With transfer learning, our method achieves the average tracking errors of 10.98 degrees and 11.81 degrees across different motion types and users, respectively. Our core contributions lie in a solution that realizes robust and stable human joint motion tracking across different device displacements.","PeriodicalId":20463,"journal":{"name":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.","volume":"8 1","pages":"5:1-5:27"},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74434407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1