首页 > 最新文献

Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems最新文献

英文 中文
Autonomous Energy Status Sharing and Synchronization for Batteryless Sensor Networks 无电池传感器网络的自主能量状态共享与同步
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3493360
A. Torrisi, K. Yıldırım, D. Brunelli
Reliable communication and synchronization for transiently-powered batteryless sensors are still open challenges. This paper presents a method to synchronize and ensure reliable communication over batteryless sensors with zero energy cost requirements. Our preliminary design combines visible light communication (VLC) and radio-frequency (RF) backscatter into a self-powered autonomous circuit. We enable energy status sharing and communication scheduling services, which provide the fundamental building blocks for future batteryless communication protocols.
对于瞬态供电的无电池传感器来说,可靠的通信和同步仍然是一个开放的挑战。本文提出了一种零能耗要求的无电池传感器同步和可靠通信的方法。我们的初步设计将可见光通信(VLC)和射频(RF)反向散射结合到一个自供电的自主电路中。我们支持能源状态共享和通信调度服务,为未来的无电池通信协议提供基础构建模块。
{"title":"Autonomous Energy Status Sharing and Synchronization for Batteryless Sensor Networks","authors":"A. Torrisi, K. Yıldırım, D. Brunelli","doi":"10.1145/3485730.3493360","DOIUrl":"https://doi.org/10.1145/3485730.3493360","url":null,"abstract":"Reliable communication and synchronization for transiently-powered batteryless sensors are still open challenges. This paper presents a method to synchronize and ensure reliable communication over batteryless sensors with zero energy cost requirements. Our preliminary design combines visible light communication (VLC) and radio-frequency (RF) backscatter into a self-powered autonomous circuit. We enable energy status sharing and communication scheduling services, which provide the fundamental building blocks for future batteryless communication protocols.","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114970803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Algorithm for Distributed Duty Cycle Adherence in Multi-Hop RPL Networks 多跳RPL网络中分布式占空比保持算法
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3492874
Dries Van Leemput, Armand Naessens, Robbe Elsas, J. Hoebeke, E. D. Poorter
Wireless Sensor Networks (WSNs) operating in unlicensed frequency bands or employing battery-less devices, require a Duty Cycle (DC) limit to ensure fair spectrum access or limit energy consumption. However, in multi-hop networks, it is up to the network protocol to ensure that all devices comply with such DC restrictions. We therefore developed a distributed DC adherence algorithm that limits the DC of all devices without introducing any additional packet overhead. This paper presents a brief description of the algorithm and evaluates its performance through simulation. Our results show that the algorithm can limit the DC of all devices to ensure no devices must switch off. Our algorithm therefore provides a solution for WSNs where nodes must operate below a DC limit.
无线传感器网络(wsn)在未经许可的频段上运行或使用无电池设备,需要一个占空比(DC)限制,以确保公平的频谱访问或限制能耗。然而,在多跳网络中,由网络协议来确保所有设备都符合这些DC限制。因此,我们开发了一种分布式DC遵守算法,该算法限制了所有设备的DC,而不会引入任何额外的数据包开销。本文简要介绍了该算法,并通过仿真对其性能进行了评价。结果表明,该算法可以限制所有设备的直流电流,以确保没有设备必须关闭。因此,我们的算法为wsn提供了一个解决方案,其中节点必须在DC限制下运行。
{"title":"Algorithm for Distributed Duty Cycle Adherence in Multi-Hop RPL Networks","authors":"Dries Van Leemput, Armand Naessens, Robbe Elsas, J. Hoebeke, E. D. Poorter","doi":"10.1145/3485730.3492874","DOIUrl":"https://doi.org/10.1145/3485730.3492874","url":null,"abstract":"Wireless Sensor Networks (WSNs) operating in unlicensed frequency bands or employing battery-less devices, require a Duty Cycle (DC) limit to ensure fair spectrum access or limit energy consumption. However, in multi-hop networks, it is up to the network protocol to ensure that all devices comply with such DC restrictions. We therefore developed a distributed DC adherence algorithm that limits the DC of all devices without introducing any additional packet overhead. This paper presents a brief description of the algorithm and evaluates its performance through simulation. Our results show that the algorithm can limit the DC of all devices to ensure no devices must switch off. Our algorithm therefore provides a solution for WSNs where nodes must operate below a DC limit.","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116643867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Pushing the Limits of Respiration Sensing with Reconfigurable Metasurface 用可重构的超表面推动呼吸传感的极限
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3492873
Yangfan Zhang, Xiaojing Wang, Chao Feng, Xinyi Li, Yuanming Cai, Yuhui Ren, Fuwei Wang, Ke Li
Human respiration monitoring acts as a crucial role to indicate people's daily health. Compared with traditional respiration monitoring methods, device-free wireless respiration sensing technology is emerging as a promising modality due to the less privacy intrusive and without on-body sensors. However, due to the intrinsic nature of relying on weak reflection signals for sensing, the sensing range is limited. Meanwhile, reliable sensing performance only can be achieved when the environment with little or even no interference. In this work, we propose a WiFi-based respiration system to simultaneously enlarge the sensing range and mitigate the interference. The basic idea is to employ a reconfigurable metasurface to dynamically manipulate electromagnetic waves in the environment to achieve beamforming and beam steering. Our system thus enhances the sensing range and reduces the energy of reflected signals from interferers to ensure reliable performance. Proof-of-concept experiments demonstrate the effectiveness of our scheme.
人体呼吸监测对指示人们的日常健康状况起着至关重要的作用。与传统的呼吸监测方法相比,无设备无线呼吸传感技术因其对隐私的侵犯少、不需要身体传感器而成为一种很有前途的模式。然而,由于依赖弱反射信号进行传感的固有特性,使得传感范围受到限制。同时,只有在环境很少甚至没有干扰的情况下,才能实现可靠的传感性能。在这项工作中,我们提出了一种基于wifi的呼吸系统,以同时扩大传感范围并减轻干扰。其基本思想是利用可重构的超表面对环境中的电磁波进行动态操纵,实现波束形成和波束转向。因此,我们的系统提高了传感范围,减少了来自干扰的反射信号的能量,以确保可靠的性能。概念验证实验证明了该方案的有效性。
{"title":"Pushing the Limits of Respiration Sensing with Reconfigurable Metasurface","authors":"Yangfan Zhang, Xiaojing Wang, Chao Feng, Xinyi Li, Yuanming Cai, Yuhui Ren, Fuwei Wang, Ke Li","doi":"10.1145/3485730.3492873","DOIUrl":"https://doi.org/10.1145/3485730.3492873","url":null,"abstract":"Human respiration monitoring acts as a crucial role to indicate people's daily health. Compared with traditional respiration monitoring methods, device-free wireless respiration sensing technology is emerging as a promising modality due to the less privacy intrusive and without on-body sensors. However, due to the intrinsic nature of relying on weak reflection signals for sensing, the sensing range is limited. Meanwhile, reliable sensing performance only can be achieved when the environment with little or even no interference. In this work, we propose a WiFi-based respiration system to simultaneously enlarge the sensing range and mitigate the interference. The basic idea is to employ a reconfigurable metasurface to dynamically manipulate electromagnetic waves in the environment to achieve beamforming and beam steering. Our system thus enhances the sensing range and reduces the energy of reflected signals from interferers to ensure reliable performance. Proof-of-concept experiments demonstrate the effectiveness of our scheme.","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"107 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117178640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Mercury
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3485930
Xiao Zeng, M. Yan, Mi Zhang
A new type of atomic absorption spectrometer - one that detects trace mercury in host material, based on hyperfine-structure lines in a magnetic field - was developed and tested on various sub-stances. This devl:ce can detect trace mercury to about 0;04 ppm (40 ppb) in about 1 minute. No chemical separation from the host material is necessary ..
一种新型的原子吸收光谱仪——一种基于磁场中的超精细结构线检测宿主材料中痕量汞的光谱仪——被开发出来并在各种物质上进行了测试。该仪器可以在大约1分钟内检测到0.04 ppm (40 ppb)的微量汞。不需要与宿主材料进行化学分离。
{"title":"Mercury","authors":"Xiao Zeng, M. Yan, Mi Zhang","doi":"10.1145/3485730.3485930","DOIUrl":"https://doi.org/10.1145/3485730.3485930","url":null,"abstract":"A new type of atomic absorption spectrometer - one that detects trace mercury in host material, based on hyperfine-structure lines in a magnetic field - was developed and tested on various sub-stances. This devl:ce can detect trace mercury to about 0;04 ppm (40 ppb) in about 1 minute. No chemical separation from the host material is necessary ..","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"61 5","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120975780","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 19
Deep Contextualized Compressive Offloading for Images 图像的深度上下文化压缩卸载
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3493452
Bo Chen, Zhisheng Yan, Hongpeng Guo, Zhe Yang, A. Ali-Eldin, P. Shenoy, K. Nahrstedt
Recent years have witnessed sensors becoming an indispensable part of our life with the camera being one of the most popular and widely deployed sensors. The camera gives rise to numerous vision-based IoT applications that generate high-level understandings of a live video stream by performing analysis on end devices like mobile or embedded devices. Typically, these applications are built with deep learning (DL) models to conduct complex vision tasks, e.g., image classification and object detection. Due to the prohibitive cost of running DL models on end devices close to the camera and with limited computation capabilities, it is widely adopted to offload the computation to a nearby powerful edge server. However, there is a gap between the restricted offloading bandwidth of the end device and the large volume of image data incurred by the live video stream. In this paper, we present Deep Contextualized Compressive Offloading for Images (DCCOI), a lightweight, context-aware, and bandwidth-efficient offloading framework for images. DCCOI consists of the spatial-adaptive encoder, a lightweight neural network, to spatial-adaptively compress the image, and the generative decoder for reconstructing the image from the compressed data. In contrast to existing DL-based encoders, the spatial-adaptive encoder allows an image region to be encoded into different numbers of feature values based on the information in it. This offers a variable-length coding method for image compression, which is a more optimal way for compression than the fix-length coding method took by existing DL-based compression approaches and demonstrates superior accuracy-compression rate trade-offs. We evaluate DCCOI against several baseline compression techniques while serving an object detection-based application. The results show that DCCOI roughly reduces the offloading size of JPEG by a factor of 9 and DeepCOD, the state-of-the-art offloading approach, by 20% with similar accuracy and a compression overhead less than 50ms.
近年来,传感器已成为我们生活中不可或缺的一部分,相机是最受欢迎和广泛部署的传感器之一。摄像头产生了许多基于视觉的物联网应用,通过在移动或嵌入式设备等终端设备上执行分析,生成对实时视频流的高级理解。通常,这些应用程序是用深度学习(DL)模型构建的,以执行复杂的视觉任务,例如图像分类和目标检测。由于在靠近相机的终端设备上运行DL模型的成本过高,并且计算能力有限,因此广泛采用将计算卸载到附近功能强大的边缘服务器上。但是,终端设备有限的卸载带宽与实时视频流产生的大量图像数据之间存在差距。在本文中,我们提出了深度上下文化图像压缩卸载(DCCOI),这是一个轻量级,上下文感知和带宽高效的图像卸载框架。DCCOI由空间自适应编码器和生成解码器组成,前者是一种轻量级的神经网络,用于对图像进行空间自适应压缩,后者用于从压缩后的数据中重建图像。与现有的基于dl的编码器相比,空间自适应编码器允许根据图像区域中的信息将图像区域编码为不同数量的特征值。这为图像压缩提供了一种变长编码方法,与现有基于dl的压缩方法采用的固定长度编码方法相比,这是一种更优的压缩方法,并且在精度和压缩率之间进行了更好的权衡。在服务于基于对象检测的应用程序时,我们针对几种基线压缩技术评估DCCOI。结果表明,DCCOI大致将JPEG的卸载大小减少了9倍,DeepCOD(最先进的卸载方法)减少了20%,精度相似,压缩开销小于50ms。
{"title":"Deep Contextualized Compressive Offloading for Images","authors":"Bo Chen, Zhisheng Yan, Hongpeng Guo, Zhe Yang, A. Ali-Eldin, P. Shenoy, K. Nahrstedt","doi":"10.1145/3485730.3493452","DOIUrl":"https://doi.org/10.1145/3485730.3493452","url":null,"abstract":"Recent years have witnessed sensors becoming an indispensable part of our life with the camera being one of the most popular and widely deployed sensors. The camera gives rise to numerous vision-based IoT applications that generate high-level understandings of a live video stream by performing analysis on end devices like mobile or embedded devices. Typically, these applications are built with deep learning (DL) models to conduct complex vision tasks, e.g., image classification and object detection. Due to the prohibitive cost of running DL models on end devices close to the camera and with limited computation capabilities, it is widely adopted to offload the computation to a nearby powerful edge server. However, there is a gap between the restricted offloading bandwidth of the end device and the large volume of image data incurred by the live video stream. In this paper, we present Deep Contextualized Compressive Offloading for Images (DCCOI), a lightweight, context-aware, and bandwidth-efficient offloading framework for images. DCCOI consists of the spatial-adaptive encoder, a lightweight neural network, to spatial-adaptively compress the image, and the generative decoder for reconstructing the image from the compressed data. In contrast to existing DL-based encoders, the spatial-adaptive encoder allows an image region to be encoded into different numbers of feature values based on the information in it. This offers a variable-length coding method for image compression, which is a more optimal way for compression than the fix-length coding method took by existing DL-based compression approaches and demonstrates superior accuracy-compression rate trade-offs. We evaluate DCCOI against several baseline compression techniques while serving an object detection-based application. The results show that DCCOI roughly reduces the offloading size of JPEG by a factor of 9 and DeepCOD, the state-of-the-art offloading approach, by 20% with similar accuracy and a compression overhead less than 50ms.","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125352635","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Diagnosing Cardiovascular Diseases with Machine Learning on Body Surface Potential Mapping Data 基于体表电位映射数据的机器学习诊断心血管疾病
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3492883
D. Wójcik, T. Rymarczyk, M. Oleszek, Lukasz Maciura, P. Bednarczuk
This research aimed to develop a high accuracy machine learning algorithm that can diagnose cardiovascular diseases from the stream of data from multiple body surface potential mapping devices equipped with 102 textile electrodes. The algorithm is based on the 1D convolutional neural network, trained on the comparable real-life data gathered from the FLUKE ECG simulator connected to the resistance-based human phantom. The developed neural network achieved an accuracy of 99.91% on the test data. Additionally, an additional algorithm was developed that can use the neural network to analyse the data streamed from the medical device and notice the medical staff about dangerous heart rhythms detected by the system.
本研究旨在开发一种高精度的机器学习算法,该算法可以从配备102个纺织电极的多个体表电位测绘设备的数据流中诊断心血管疾病。该算法基于一维卷积神经网络,并根据连接到基于电阻的人体幻影的FLUKE ECG模拟器收集的可比现实数据进行训练。所开发的神经网络在测试数据上的准确率达到99.91%。此外,还开发了一种额外的算法,可以使用神经网络分析来自医疗设备的数据流,并通知医务人员系统检测到的危险心律。
{"title":"Diagnosing Cardiovascular Diseases with Machine Learning on Body Surface Potential Mapping Data","authors":"D. Wójcik, T. Rymarczyk, M. Oleszek, Lukasz Maciura, P. Bednarczuk","doi":"10.1145/3485730.3492883","DOIUrl":"https://doi.org/10.1145/3485730.3492883","url":null,"abstract":"This research aimed to develop a high accuracy machine learning algorithm that can diagnose cardiovascular diseases from the stream of data from multiple body surface potential mapping devices equipped with 102 textile electrodes. The algorithm is based on the 1D convolutional neural network, trained on the comparable real-life data gathered from the FLUKE ECG simulator connected to the resistance-based human phantom. The developed neural network achieved an accuracy of 99.91% on the test data. Additionally, an additional algorithm was developed that can use the neural network to analyse the data streamed from the medical device and notice the medical staff about dangerous heart rhythms detected by the system.","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"649 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123346711","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
FedMask FedMask
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3485929
Ang Li, Jingwei Sun, Xiao Zeng, Mi Zhang, H. Li, Yiran Chen
Recent advancements in deep neural networks (DNN) enabled various mobile deep learning applications. However, it is technically challenging to locally train a DNN model due to limited data on devices like mobile phones. Federated learning (FL) is a distributed machine learning paradigm which allows for model training on decentralized data residing on devices without breaching data privacy. Hence, FL becomes a natural choice for deploying on-device deep learning applications. However, the data residing across devices is intrinsically statistically heterogeneous (i.e., non-IID data distribution) and mobile devices usually have limited communication bandwidth to transfer local updates. Such statistical heterogeneity and communication bandwidth limit are two major bottlenecks that hinder applying FL in practice. In addition, considering mobile devices usually have limited computational resources, improving computation efficiency of training and running DNNs is critical to developing on-device deep learning applications. In this paper, we present FedMask - a communication and computation efficient FL framework. By applying FedMask, each device can learn a personalized and structured sparse DNN, which can run efficiently on devices. To achieve this, each device learns a sparse binary mask (i.e., 1 bit per network parameter) while keeping the parameters of each local model unchanged; only these binary masks will be communicated between the server and the devices. Instead of learning a shared global model in classic FL, each device obtains a personalized and structured sparse model that is composed by applying the learned binary mask to the fixed parameters of the local model. Our experiments show that compared with status quo approaches, FedMask improves the inference accuracy by 28.47% and reduces the communication cost and the computation cost by 34.48X and 2.44X. FedMask also achieves 1.56X inference speedup and reduces the energy consumption by 1.78X.
{"title":"FedMask","authors":"Ang Li, Jingwei Sun, Xiao Zeng, Mi Zhang, H. Li, Yiran Chen","doi":"10.1145/3485730.3485929","DOIUrl":"https://doi.org/10.1145/3485730.3485929","url":null,"abstract":"Recent advancements in deep neural networks (DNN) enabled various mobile deep learning applications. However, it is technically challenging to locally train a DNN model due to limited data on devices like mobile phones. Federated learning (FL) is a distributed machine learning paradigm which allows for model training on decentralized data residing on devices without breaching data privacy. Hence, FL becomes a natural choice for deploying on-device deep learning applications. However, the data residing across devices is intrinsically statistically heterogeneous (i.e., non-IID data distribution) and mobile devices usually have limited communication bandwidth to transfer local updates. Such statistical heterogeneity and communication bandwidth limit are two major bottlenecks that hinder applying FL in practice. In addition, considering mobile devices usually have limited computational resources, improving computation efficiency of training and running DNNs is critical to developing on-device deep learning applications. In this paper, we present FedMask - a communication and computation efficient FL framework. By applying FedMask, each device can learn a personalized and structured sparse DNN, which can run efficiently on devices. To achieve this, each device learns a sparse binary mask (i.e., 1 bit per network parameter) while keeping the parameters of each local model unchanged; only these binary masks will be communicated between the server and the devices. Instead of learning a shared global model in classic FL, each device obtains a personalized and structured sparse model that is composed by applying the learned binary mask to the fixed parameters of the local model. Our experiments show that compared with status quo approaches, FedMask improves the inference accuracy by 28.47% and reduces the communication cost and the computation cost by 34.48X and 2.44X. FedMask also achieves 1.56X inference speedup and reduces the energy consumption by 1.78X.","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114218313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 68
Wavoice: A Noise-resistant Multi-modal Speech Recognition System Fusing mmWave and Audio Signals 融合毫米波和音频信号的抗噪声多模态语音识别系统
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3485945
Tiantian Liu, Ming Gao, Feng Lin, Chao Wang, Zhongjie Ba, Jinsong Han, Wenyao Xu, K. Ren
With the advance in automatic speech recognition, voice user interface has gained popularity recently. Since the COVID-19 pandemic, VUI is increasingly preferred in online communication due to its non-contact. Additionally, various ambient noise impedes the public applications of voice user interfaces due to the requirement of audio-only speech recognition methods for a high signal-to-noise ratio. In this paper, we present Wavoice, the first noise-resistant multi-modal speech recognition system that fuses two distinct voice sensing modalities, i.e., millimeter-wave (mmWave) signals and audio signals from a microphone, together. One key contribution is that we model the inherent correlation between mmWave and audio signals. Based on it, Wavoice facilitates the real-time noise-resistant voice activity detection and user targeting from multiple speakers. Furthermore, we elaborate on two novel modules into the neural attention mechanism for multi-modal signals fusion, and result in accurate speech recognition. Extensive experiments verify Wavoice's effectiveness under various conditions with the character recognition error rate below 1% in a range of 7 meters. Wavoice outperforms existing audio-only speech recognition methods with lower character error rate and word error rate. The evaluation in complex scenes validates the robustness of Wavoice.
随着自动语音识别技术的发展,语音用户界面得到了广泛的应用。自新冠肺炎疫情以来,虚拟用户界面因其非接触性而日益成为在线交流的首选。此外,由于纯音频语音识别方法对高信噪比的要求,各种环境噪声阻碍了语音用户界面的公共应用。在本文中,我们介绍了Wavoice,这是第一个抗噪声多模态语音识别系统,它融合了两种不同的语音感知模式,即毫米波(mmWave)信号和来自麦克风的音频信号。一个关键的贡献是,我们建立了毫米波和音频信号之间的内在相关性模型。基于此,Wavoice实现了实时的抗噪语音活动检测和多个扬声器的用户定位。在此基础上,我们详细介绍了两个新的多模态信号融合神经注意机制模块,从而实现准确的语音识别。大量的实验验证了Wavoice在各种条件下的有效性,在7米范围内的字符识别错误率低于1%。Wavoice比现有的纯音频语音识别方法具有更低的字符错误率和单词错误率。在复杂场景下的评估验证了Wavoice的鲁棒性。
{"title":"Wavoice: A Noise-resistant Multi-modal Speech Recognition System Fusing mmWave and Audio Signals","authors":"Tiantian Liu, Ming Gao, Feng Lin, Chao Wang, Zhongjie Ba, Jinsong Han, Wenyao Xu, K. Ren","doi":"10.1145/3485730.3485945","DOIUrl":"https://doi.org/10.1145/3485730.3485945","url":null,"abstract":"With the advance in automatic speech recognition, voice user interface has gained popularity recently. Since the COVID-19 pandemic, VUI is increasingly preferred in online communication due to its non-contact. Additionally, various ambient noise impedes the public applications of voice user interfaces due to the requirement of audio-only speech recognition methods for a high signal-to-noise ratio. In this paper, we present Wavoice, the first noise-resistant multi-modal speech recognition system that fuses two distinct voice sensing modalities, i.e., millimeter-wave (mmWave) signals and audio signals from a microphone, together. One key contribution is that we model the inherent correlation between mmWave and audio signals. Based on it, Wavoice facilitates the real-time noise-resistant voice activity detection and user targeting from multiple speakers. Furthermore, we elaborate on two novel modules into the neural attention mechanism for multi-modal signals fusion, and result in accurate speech recognition. Extensive experiments verify Wavoice's effectiveness under various conditions with the character recognition error rate below 1% in a range of 7 meters. Wavoice outperforms existing audio-only speech recognition methods with lower character error rate and word error rate. The evaluation in complex scenes validates the robustness of Wavoice.","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"28 7","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113970497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 32
Adversarial Attacks against LiDAR Semantic Segmentation in Autonomous Driving 针对自动驾驶激光雷达语义分割的对抗性攻击
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3485935
Yi Zhu, Chenglin Miao, Foad Hajiaghajani, Mengdi Huai, Lu Su, Chunming Qiao
Today, most autonomous vehicles (AVs) rely on LiDAR (Light Detection and Ranging) perception to acquire accurate information about their immediate surroundings. In LiDAR-based perception systems, semantic segmentation plays a critical role as it can divide LiDAR point clouds into meaningful regions according to human perception and provide AVs with semantic understanding of the driving environments. However, an implicit assumption for existing semantic segmentation models is that they are performed in a reliable and secure environment, which may not be true in practice. In this paper, we investigate adversarial attacks against LiDAR semantic segmentation in autonomous driving. Specifically, we propose a novel adversarial attack framework based on which the attacker can easily fool LiDAR semantic segmentation by placing some simple objects (e.g., cardboard and road signs) at some locations in the physical space. We conduct extensive real-world experiments to evaluate the performance of our proposed attack framework. The experimental results show that our attack can achieve more than 90% success rate in real-world driving environments. To the best of our knowledge, this is the first study on physically realizable adversarial attacks against LiDAR point cloud semantic segmentation with real-world evaluations.
如今,大多数自动驾驶汽车(AVs)都依靠激光雷达(LiDAR,光探测和测距)感知来获取周围环境的准确信息。在基于LiDAR的感知系统中,语义分割可以根据人类感知将LiDAR点云划分为有意义的区域,为自动驾驶汽车提供对驾驶环境的语义理解,在其中起着至关重要的作用。然而,对于现有的语义分割模型,一个隐含的假设是它们是在一个可靠和安全的环境中执行的,这在实践中可能并不正确。在本文中,我们研究了自动驾驶中针对LiDAR语义分割的对抗性攻击。具体来说,我们提出了一种新的对抗性攻击框架,基于该框架,攻击者可以通过在物理空间的某些位置放置一些简单的物体(例如纸板和路标)来轻松地欺骗激光雷达语义分割。我们进行了大量的真实世界实验来评估我们提出的攻击框架的性能。实验结果表明,在真实驾驶环境下,我们的攻击成功率可以达到90%以上。据我们所知,这是第一个针对激光雷达点云语义分割的物理可实现对抗性攻击的研究。
{"title":"Adversarial Attacks against LiDAR Semantic Segmentation in Autonomous Driving","authors":"Yi Zhu, Chenglin Miao, Foad Hajiaghajani, Mengdi Huai, Lu Su, Chunming Qiao","doi":"10.1145/3485730.3485935","DOIUrl":"https://doi.org/10.1145/3485730.3485935","url":null,"abstract":"Today, most autonomous vehicles (AVs) rely on LiDAR (Light Detection and Ranging) perception to acquire accurate information about their immediate surroundings. In LiDAR-based perception systems, semantic segmentation plays a critical role as it can divide LiDAR point clouds into meaningful regions according to human perception and provide AVs with semantic understanding of the driving environments. However, an implicit assumption for existing semantic segmentation models is that they are performed in a reliable and secure environment, which may not be true in practice. In this paper, we investigate adversarial attacks against LiDAR semantic segmentation in autonomous driving. Specifically, we propose a novel adversarial attack framework based on which the attacker can easily fool LiDAR semantic segmentation by placing some simple objects (e.g., cardboard and road signs) at some locations in the physical space. We conduct extensive real-world experiments to evaluate the performance of our proposed attack framework. The experimental results show that our attack can achieve more than 90% success rate in real-world driving environments. To the best of our knowledge, this is the first study on physically realizable adversarial attacks against LiDAR point cloud semantic segmentation with real-world evaluations.","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127612809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
Demonstration of an Energy-Aware Task Scheduler for Battery-Less IoT Devices 无电池物联网设备的能量感知任务调度程序演示
Pub Date : 2021-11-15 DOI: 10.1145/3485730.3493358
Adnan Sabovic, A. Sultania, J. Famaey
Tiny energy harvesting battery-less devices present a promising alternative to battery-powered devices for a sustainable Internet of Things (IoT) vision. The use of small capacitors as energy storage, along with a dynamic and unpredictable harvesting environment, leads these devices to exhibit intermittent on-off behavior. As the traditional computing models cannot handle this behavior, in this demo we present and demonstrate an energy-aware task scheduler for battery-less IoT devices based on task dependencies and priorities, which can intelligently schedule the application tasks avoiding power failures.
微小的无电池能量收集设备为可持续的物联网(IoT)愿景提供了电池供电设备的替代方案。使用小型电容器作为能量存储,以及动态和不可预测的收集环境,导致这些设备表现出间歇性的开-关行为。由于传统的计算模型无法处理这种行为,在这个演示中,我们展示了一个基于任务依赖关系和优先级的无电池物联网设备的能量感知任务调度器,它可以智能地调度应用程序任务,避免电源故障。
{"title":"Demonstration of an Energy-Aware Task Scheduler for Battery-Less IoT Devices","authors":"Adnan Sabovic, A. Sultania, J. Famaey","doi":"10.1145/3485730.3493358","DOIUrl":"https://doi.org/10.1145/3485730.3493358","url":null,"abstract":"Tiny energy harvesting battery-less devices present a promising alternative to battery-powered devices for a sustainable Internet of Things (IoT) vision. The use of small capacitors as energy storage, along with a dynamic and unpredictable harvesting environment, leads these devices to exhibit intermittent on-off behavior. As the traditional computing models cannot handle this behavior, in this demo we present and demonstrate an energy-aware task scheduler for battery-less IoT devices based on task dependencies and priorities, which can intelligently schedule the application tasks avoiding power failures.","PeriodicalId":356322,"journal":{"name":"Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127911798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1