首页 > 最新文献

IEEE Journal of Selected Topics in Signal Processing最新文献

英文 中文
Index-Modulated Metasurface Transceiver Design Using Reconfigurable Intelligent Surfaces for 6G Wireless Networks 利用可重构智能表面为 6G 无线网络设计索引调制元表面收发器
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-10-06 DOI: 10.1109/JSTSP.2023.3322655
John A. Hodge;Kumar Vijay Mishra;Brian M. Sadler;Amir I. Zaghloul
Higher spectral and energy efficiencies are the envisioned defining characteristics of high data-rate sixth-generation (6G) wireless networks. One of the enabling technologies to meet these requirements is index modulation (IM), which transmits information through permutations of indices of spatial, frequency, or temporal media. In this paper, we propose novel electromagnetics-compliant designs of reconfigurable intelligent surface (RIS) apertures for realizing IM in 6G transceivers. We consider RIS modeling and implementation of spatial and subcarrier IMs, including beam steering, spatial multiplexing, and phase modulation capabilities. Numerical experiments for our proposed implementations show that the bit error rates obtained via RIS-aided IM outperform traditional implementations. We further establish the programmability of these transceivers to vary the reflection phase and generate frequency harmonics for IM through full-wave electromagnetic analyses of a specific reflect-array metasurface implementation.
更高的频谱效率和能效是第六代(6G)高数据速率无线网络的决定性特征。索引调制(IM)是满足这些要求的使能技术之一,它通过空间、频率或时间介质索引的排列来传输信息。在本文中,我们提出了符合电磁学原理的可重构智能表面(RIS)孔径新设计,以在 6G 收发器中实现 IM。我们考虑了空间和子载波 IM 的 RIS 建模和实现,包括波束转向、空间复用和相位调制功能。对我们提出的实现方法进行的数值实验表明,通过 RIS 辅助 IM 获得的误码率优于传统实现方法。通过对特定反射阵列元表面实施方案的全波电磁分析,我们进一步确定了这些收发器的可编程性,以改变反射相位并为 IM 生成频率谐波。
{"title":"Index-Modulated Metasurface Transceiver Design Using Reconfigurable Intelligent Surfaces for 6G Wireless Networks","authors":"John A. Hodge;Kumar Vijay Mishra;Brian M. Sadler;Amir I. Zaghloul","doi":"10.1109/JSTSP.2023.3322655","DOIUrl":"10.1109/JSTSP.2023.3322655","url":null,"abstract":"Higher spectral and energy efficiencies are the envisioned defining characteristics of high data-rate sixth-generation (6G) wireless networks. One of the enabling technologies to meet these requirements is index modulation (IM), which transmits information through permutations of indices of spatial, frequency, or temporal media. In this paper, we propose novel electromagnetics-compliant designs of reconfigurable intelligent surface (RIS) apertures for realizing IM in 6G transceivers. We consider RIS modeling and implementation of spatial and subcarrier IMs, including beam steering, spatial multiplexing, and phase modulation capabilities. Numerical experiments for our proposed implementations show that the bit error rates obtained via RIS-aided IM outperform traditional implementations. We further establish the programmability of these transceivers to vary the reflection phase and generate frequency harmonics for IM through full-wave electromagnetic analyses of a specific reflect-array metasurface implementation.","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 6","pages":"1248-1263"},"PeriodicalIF":7.5,"publicationDate":"2023-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136009024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DeepAdaIn-Net: Deep Adaptive Device-Edge Collaborative Inference for Augmented Reality DeepAdaIn-Net:用于增强现实的深度自适应设备边缘协同推理
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-09-22 DOI: 10.1109/JSTSP.2023.3312914
Li Wang;Xin Wu;Yi Zhang;Xinyun Zhang;Lianming Xu;Zhihua Wu;Aiguo Fei
The object inference for augmented reality (AR) requires a precise object localization within user's physical environment and the adaptability to dynamic communication conditions. Deep learning (DL) is advantageous in capturing highly-nonlinear features of diverse data sources drawn from complex objects. However, the existing DL techniques may have disfluency or instability issues when deployed on resource-constrained devices with poor communication conditions, resulting in bad user experiences. This article addresses these issues by proposing a deep adaptive inference network called DeepAdaIn-Net for the real-time device-edge collaborative object inference, aiming at reducing feature transmission volume while ensuring high feature-fitting accuracy during inference. Specifically, DeepAdaIn-Net encompasses a partition point selection (PPS) module, a high feature compression learning (HFCL) module, a bandwidth-aware feature configuration (BaFC) module, and a feature consistency compensation (FCC) module. The PPS module minimizes the total execution latency, including inference and transmission latency. The HFCL and BaFC modules can decouple the training and inference process by integrating a high-compression ratio feature encoder with the bandwidth-aware feature configuration, which ensures that the compressed data can adapt to the varying communication bandwidths. The FCC module fills the information gaps among the compressed features, guaranteeing high feature expression ability. We conduct extensive experiments to validate DeepAdaIn-Net using two object inference datasets: COCO2017 and emergency fire datasets, and the results demonstrate that our approach outperforms several conventional methods by deriving an optimal 123x feature compression for $640times 640$ images, which results in a mere 63.3 ms total latency and an accuracy loss of less than 3% when operating at a bandwidth of 16 Mbps.
增强现实(AR)的对象推理需要在用户的物理环境中精确定位对象,并适应动态通信条件。深度学习(DL)在捕获从复杂对象中提取的各种数据源的高度非线性特征方面具有优势。然而,现有的深度学习技术在部署在通信条件差、资源受限的设备上时,可能存在不流畅或不稳定的问题,从而导致糟糕的用户体验。为了解决这些问题,本文提出了一种深度自适应推理网络,称为DeepAdaIn-Net,用于实时设备边缘协同对象推理,旨在减少特征传输量,同时确保推理过程中的高特征拟合精度。具体来说,DeepAdaIn-Net包括一个分区点选择(PPS)模块、一个高特征压缩学习(HFCL)模块、一个带宽感知特征配置(BaFC)模块和一个特征一致性补偿(FCC)模块。PPS模块最大限度地减少了总执行延迟,包括推理和传输延迟。HFCL和BaFC模块通过集成高压缩比特征编码器和带宽感知特征配置来解耦训练和推理过程,确保压缩数据能够适应不同的通信带宽。FCC模块填补了压缩特征之间的信息空白,保证了较高的特征表达能力。我们使用两个对象推理数据集(COCO2017和紧急火灾数据集)进行了广泛的实验来验证DeepAdaIn-Net,结果表明,我们的方法优于几种传统方法,对640美元× 640美元的图像进行了最佳的123x特征压缩,在16 Mbps的带宽下运行时,总延迟仅为63.3 ms,精度损失小于3%。
{"title":"DeepAdaIn-Net: Deep Adaptive Device-Edge Collaborative Inference for Augmented Reality","authors":"Li Wang;Xin Wu;Yi Zhang;Xinyun Zhang;Lianming Xu;Zhihua Wu;Aiguo Fei","doi":"10.1109/JSTSP.2023.3312914","DOIUrl":"10.1109/JSTSP.2023.3312914","url":null,"abstract":"The object inference for augmented reality (AR) requires a precise object localization within user's physical environment and the adaptability to dynamic communication conditions. Deep learning (DL) is advantageous in capturing highly-nonlinear features of diverse data sources drawn from complex objects. However, the existing DL techniques may have disfluency or instability issues when deployed on resource-constrained devices with poor communication conditions, resulting in bad user experiences. This article addresses these issues by proposing a deep adaptive inference network called DeepAdaIn-Net for the real-time device-edge collaborative object inference, aiming at reducing feature transmission volume while ensuring high feature-fitting accuracy during inference. Specifically, DeepAdaIn-Net encompasses a partition point selection (PPS) module, a high feature compression learning (HFCL) module, a bandwidth-aware feature configuration (BaFC) module, and a feature consistency compensation (FCC) module. The PPS module minimizes the total execution latency, including inference and transmission latency. The HFCL and BaFC modules can decouple the training and inference process by integrating a high-compression ratio feature encoder with the bandwidth-aware feature configuration, which ensures that the compressed data can adapt to the varying communication bandwidths. The FCC module fills the information gaps among the compressed features, guaranteeing high feature expression ability. We conduct extensive experiments to validate DeepAdaIn-Net using two object inference datasets: COCO2017 and emergency fire datasets, and the results demonstrate that our approach outperforms several conventional methods by deriving an optimal 123x feature compression for \u0000<inline-formula><tex-math>$640times 640$</tex-math></inline-formula>\u0000 images, which results in a mere 63.3 ms total latency and an accuracy loss of less than 3% when operating at a bandwidth of 16 Mbps.","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 5","pages":"1052-1063"},"PeriodicalIF":7.5,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135650942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Guest Editorial Signal Processing for XR Communications and Systems XR通信与系统信号处理
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-09-01 DOI: 10.1109/JSTSP.2023.3326801
Yongpeng Wu;Erik G. Larsson;Jing Li;Angel Lozano;Luce Morin;Mai Xu;Chengshan Xiao;Wei Yang
Future wireless networks are expected to support ubiquitous extended reality (XR) with human-to-human communications. XR is a term that refers to all real-and-virtual combined environments and human-machine interactions generated by computer technology and wearables, where the ‘X’ represents any current or future spatial computing technology. XR includes augmented reality (AR), mixed reality (MR), and virtual reality (VR) that all are immersive at different levels and entail distinct degrees of sensory inputs. The ultra-high resolution, detailed representation, panoramic scenery, and multi-stimuli of XR provide a unique immersive experience, allowing users to interact within an alternative world. Transmitting XR video, with its ultra-high bit rate and low latency, presents critical challenges to wireless networking.
未来的无线网络有望支持无处不在的扩展现实(XR),实现人与人之间的通信。XR是一个术语,指所有由计算机技术和可穿戴设备产生的真实和虚拟的组合环境以及人机交互,其中“X”代表任何当前或未来的空间计算技术。XR包括增强现实(AR)、混合现实(MR)和虚拟现实(VR),它们都是不同层次的沉浸式体验,需要不同程度的感官输入。XR的超高分辨率、细节表现、全景风景和多种刺激提供了独特的沉浸式体验,允许用户在另一个世界中进行交互。传输具有超高比特率和低延迟的XR视频对无线网络提出了严峻的挑战。
{"title":"Guest Editorial Signal Processing for XR Communications and Systems","authors":"Yongpeng Wu;Erik G. Larsson;Jing Li;Angel Lozano;Luce Morin;Mai Xu;Chengshan Xiao;Wei Yang","doi":"10.1109/JSTSP.2023.3326801","DOIUrl":"https://doi.org/10.1109/JSTSP.2023.3326801","url":null,"abstract":"Future wireless networks are expected to support ubiquitous extended reality (XR) with human-to-human communications. XR is a term that refers to all real-and-virtual combined environments and human-machine interactions generated by computer technology and wearables, where the ‘X’ represents any current or future spatial computing technology. XR includes augmented reality (AR), mixed reality (MR), and virtual reality (VR) that all are immersive at different levels and entail distinct degrees of sensory inputs. The ultra-high resolution, detailed representation, panoramic scenery, and multi-stimuli of XR provide a unique immersive experience, allowing users to interact within an alternative world. Transmitting XR video, with its ultra-high bit rate and low latency, presents critical challenges to wireless networking.","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 5","pages":"913-918"},"PeriodicalIF":7.5,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10319123","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138138065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
VR+HD: Video Semantic Reconstruction From Spatio-Temporal Scene Graphs VR+HD:基于时空场景图的视频语义重构
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-09-01 DOI: 10.1109/JSTSP.2023.3323654
Chenxing Li;Yiping Duan;Qiyuan Du;Shiqi Sun;Xin Deng;Xiaoming Tao
With the development of computer science and deep learning networks, AI generation technology is becoming increasingly mature. Video has become one of the most important information carriers in our daily life because of their large amount of data and information. However, because of their large amount of information and complex semantics, video generation models, especially High Definition (HD) video, have been a difficult problem in the field of deep learning. Video semantic representation and semantic reconstruction are difficult tasks. Because video content is changeable and information is highly correlated, we propose a HD video generation model from a spatio-temporal scene graph: the spatio-temporal scene graph to video (StSg2vid) model. First, we enter the spatio-temporal scene graph sequence as the semantic representation model of the information in each frame of the video. The scene graph used to describe the semantic information of each frame contains the motion progress of the object in the video at that moment, which is equivalent to a clock. A spatio-temporal scene graph transmits the relationship information between objects through the graph convolutional neural network and predicts the scene layout of the moment. Lastly, the image generation model predicts the frame image of the current moment. The frame at each moment depends on the scene layout at the current moment and the frame and scene layout at the previous moment. We introduced the flow net, wrapping prediction model and the spatially-adaptive normalization (SPADE) network to generate images of each frame forecast. We used the Action genome dataset. Compared with the current state-of-the-art algorithms, the videos generated by our model achieve better results in both quantitative indicators and user evaluations. In addition, we also generalized the StSg2vid model into virtual reality (VR) videos of indoor scenes, preliminarily explored the generation method of VR videos, and achieved good results.
随着计算机科学和深度学习网络的发展,人工智能生成技术日趋成熟。视频以其庞大的数据量和信息量成为我们日常生活中最重要的信息载体之一。然而,由于视频的信息量大、语义复杂,视频生成模型,特别是高清视频的生成模型一直是深度学习领域的难点问题。视频语义表示和语义重构是一个难点问题。由于视频内容多变,信息高度相关,我们提出了一种从时空场景图生成高清视频的模型:时空场景图到视频(StSg2vid)模型。首先,我们输入时空场景图序列作为视频每帧信息的语义表示模型。用于描述每一帧语义信息的场景图包含了视频中物体在该时刻的运动进度,相当于一个时钟。时空场景图通过图卷积神经网络传递物体之间的关系信息,并预测时刻的场景布局。最后,图像生成模型预测当前时刻的帧图像。每个时刻的帧取决于当前时刻的场景布局和前一刻的帧和场景布局。我们引入流网络、包裹预测模型和空间自适应归一化(SPADE)网络来生成每帧预测的图像。我们使用了Action基因组数据集。与目前最先进的算法相比,我们的模型生成的视频在定量指标和用户评价方面都取得了更好的效果。此外,我们还将StSg2vid模型推广到室内场景的虚拟现实(VR)视频中,初步探索了VR视频的生成方法,取得了较好的效果。
{"title":"VR+HD: Video Semantic Reconstruction From Spatio-Temporal Scene Graphs","authors":"Chenxing Li;Yiping Duan;Qiyuan Du;Shiqi Sun;Xin Deng;Xiaoming Tao","doi":"10.1109/JSTSP.2023.3323654","DOIUrl":"10.1109/JSTSP.2023.3323654","url":null,"abstract":"With the development of computer science and deep learning networks, AI generation technology is becoming increasingly mature. Video has become one of the most important information carriers in our daily life because of their large amount of data and information. However, because of their large amount of information and complex semantics, video generation models, especially High Definition (HD) video, have been a difficult problem in the field of deep learning. Video semantic representation and semantic reconstruction are difficult tasks. Because video content is changeable and information is highly correlated, we propose a HD video generation model from a spatio-temporal scene graph: the spatio-temporal scene graph to video (StSg2vid) model. First, we enter the spatio-temporal scene graph sequence as the semantic representation model of the information in each frame of the video. The scene graph used to describe the semantic information of each frame contains the motion progress of the object in the video at that moment, which is equivalent to a clock. A spatio-temporal scene graph transmits the relationship information between objects through the graph convolutional neural network and predicts the scene layout of the moment. Lastly, the image generation model predicts the frame image of the current moment. The frame at each moment depends on the scene layout at the current moment and the frame and scene layout at the previous moment. We introduced the flow net, wrapping prediction model and the spatially-adaptive normalization (SPADE) network to generate images of each frame forecast. We used the Action genome dataset. Compared with the current state-of-the-art algorithms, the videos generated by our model achieve better results in both quantitative indicators and user evaluations. In addition, we also generalized the StSg2vid model into virtual reality (VR) videos of indoor scenes, preliminarily explored the generation method of VR videos, and achieved good results.","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 5","pages":"935-948"},"PeriodicalIF":7.5,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136258951","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Signal Processing Society Information IEEE信号处理学会信息
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-09-01 DOI: 10.1109/JSTSP.2023.3296231
{"title":"IEEE Signal Processing Society Information","authors":"","doi":"10.1109/JSTSP.2023.3296231","DOIUrl":"10.1109/JSTSP.2023.3296231","url":null,"abstract":"","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 5","pages":"C2-C2"},"PeriodicalIF":7.5,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10319125","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135783221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Signal Processing Society Information IEEE信号处理学会信息
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-09-01 DOI: 10.1109/JSTSP.2023.3296235
{"title":"IEEE Signal Processing Society Information","authors":"","doi":"10.1109/JSTSP.2023.3296235","DOIUrl":"10.1109/JSTSP.2023.3296235","url":null,"abstract":"","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 5","pages":"C3-C3"},"PeriodicalIF":7.5,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10319122","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135783222","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adaptive Semantic-Bit Communication for Extended Reality Interactions 扩展现实交互的自适应语义位通信
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-08-31 DOI: 10.1109/JSTSP.2023.3310654
Chaowei Wang;Yehao Li;Feifei Gao;Danhao Deng;Jisong Xu;Yuhan Liu;Weidong Wang
Semantic communication is a novel paradigm that conveys intention or goal from the source to the destination. It can greatly improve communication efficiency, especially for the applications that require extremely low latency and high reliability, such as augmented reality (AR), virtual reality (VR) or extended reality (XR). An adaptive semantic-bit communication structure based on resource efficiency enhancement for XR is proposed, in which part of the XR users employ semantic communication, while others employ the conventional way. We utilize adaptive communication and power allocation to maximize the system-level achievable performance indicated by equivalent semantic rate. The formulated problem is addressed by a two-step optimization. First, we propose a signal-to-interference-plus-noise ratio (SINR)-based paradigm selection scheme as the semantic communication outperforms the conventional way in low and moderate SINR regimes. Then we propose a genetic algorithm-based power allocation to solve the non-convex optimization. Simulation results demonstrate that the proposed scheme achieves a higher equivalent semantic rate against the baseline schemes.
语义交际是一种将意图或目的从源语传递到目的语的新型交际范式。它可以大大提高通信效率,特别是对于增强现实(AR)、虚拟现实(VR)或扩展现实(XR)等需要极低延迟和高可靠性的应用。提出了一种基于资源效率提高的XR自适应语义位通信结构,其中部分XR用户采用语义通信方式,而其他XR用户采用传统方式。我们利用自适应通信和功率分配来最大化等效语义率表示的系统级可实现性能。通过两步优化来解决公式问题。首先,我们提出了一种基于信噪比(SINR)的范式选择方案,因为语义通信在低和中等SINR条件下优于传统方式。然后提出了一种基于遗传算法的功率分配方法来解决非凸优化问题。仿真结果表明,该方案相对于基准方案具有较高的等效语义率。
{"title":"Adaptive Semantic-Bit Communication for Extended Reality Interactions","authors":"Chaowei Wang;Yehao Li;Feifei Gao;Danhao Deng;Jisong Xu;Yuhan Liu;Weidong Wang","doi":"10.1109/JSTSP.2023.3310654","DOIUrl":"10.1109/JSTSP.2023.3310654","url":null,"abstract":"Semantic communication is a novel paradigm that conveys intention or goal from the source to the destination. It can greatly improve communication efficiency, especially for the applications that require extremely low latency and high reliability, such as augmented reality (AR), virtual reality (VR) or extended reality (XR). An adaptive semantic-bit communication structure based on resource efficiency enhancement for XR is proposed, in which part of the XR users employ semantic communication, while others employ the conventional way. We utilize adaptive communication and power allocation to maximize the system-level achievable performance indicated by equivalent semantic rate. The formulated problem is addressed by a two-step optimization. First, we propose a signal-to-interference-plus-noise ratio (SINR)-based paradigm selection scheme as the semantic communication outperforms the conventional way in low and moderate SINR regimes. Then we propose a genetic algorithm-based power allocation to solve the non-convex optimization. Simulation results demonstrate that the proposed scheme achieves a higher equivalent semantic rate against the baseline schemes.","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 5","pages":"1080-1092"},"PeriodicalIF":7.5,"publicationDate":"2023-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76618608","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Orientation and Location Tracking of XR Devices: 5G Carrier Phase-Based Methods XR设备的方向和位置跟踪:基于5G载波相位的方法
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-08-28 DOI: 10.1109/JSTSP.2023.3309463
Jukka Talvitie;Mikko Säily;Mikko Valkama
Accurate knowledge of the three-dimensional (3D) orientations and 3D locations of the user devices, such as wearable glasses, is of paramount importance in different extended reality (XR) use cases and applications. In this article, we address the corresponding six degrees-of-freedom (6DoF) tracking challenge of 5G-empowered XR devices. We describe a new uplink (UL) carrier phase measurements based estimation approach, allowing for low-latency 3D orientation and 3D location tracking directly at the 5G network base-stations or gNodeBs (gNBs). extended Kalman filter (EKF) based practical signal processing algorithms are described while also the applicable Cramér-Rao lower-bounds (CRLBs) are derived and presented. Also, the related aspect of over-the-air estimation of the XR headset antenna constellation or antenna geometry is addressed. Additionally, the important practical challenges related to user equipment (UE) clock drifting as well as integer ambiguities in carrier phase based methods are both considered. Finally, an extensive set of numerical results is provided in an example indoor factory like environment, covering both 3.5 GHz and 28 GHz network deployments. The obtained results demonstrate the feasibility of continuous 6DoF tracking through the proposed approach, with root mean squared error (RMSE) accuracies below one degree for the 3D orientation and below one centimeter for the 3D location, respectively. The results also demonstrate that UE clock drifting and carrier phase integer ambiguities can both be efficiently estimated and tracked, as part of the overall proposed concept and methods.
准确了解用户设备(如可穿戴眼镜)的三维(3D)方向和3D位置,在不同的扩展现实(XR)用例和应用中至关重要。在本文中,我们解决了5g XR设备相应的六自由度(6DoF)跟踪挑战。我们描述了一种新的基于上行链路(UL)载波相位测量的估计方法,允许直接在5G网络基站或gnb (gnb)上进行低延迟3D定向和3D位置跟踪。介绍了基于扩展卡尔曼滤波(EKF)的实用信号处理算法,推导并给出了适用的cram - rao下界(CRLBs)。此外,还讨论了XR头戴式耳机天线星座或天线几何形状的空中估计的相关方面。此外,还考虑了与用户设备(UE)时钟漂移以及基于载波相位的方法中的整数模糊相关的重要实际挑战。最后,在一个类似室内工厂的示例环境中提供了一组广泛的数值结果,涵盖3.5 GHz和28 GHz网络部署。实验结果表明,该方法可实现连续6DoF跟踪,三维方向的均方根误差(RMSE)小于1度,三维位置的均方根误差小于1厘米。结果还表明,作为所提出的整体概念和方法的一部分,UE时钟漂移和载波相位整数模糊都可以有效地估计和跟踪。
{"title":"Orientation and Location Tracking of XR Devices: 5G Carrier Phase-Based Methods","authors":"Jukka Talvitie;Mikko Säily;Mikko Valkama","doi":"10.1109/JSTSP.2023.3309463","DOIUrl":"10.1109/JSTSP.2023.3309463","url":null,"abstract":"Accurate knowledge of the three-dimensional (3D) orientations and 3D locations of the user devices, such as wearable glasses, is of paramount importance in different extended reality (XR) use cases and applications. In this article, we address the corresponding six degrees-of-freedom (6DoF) tracking challenge of 5G-empowered XR devices. We describe a new uplink (UL) carrier phase measurements based estimation approach, allowing for low-latency 3D orientation and 3D location tracking directly at the 5G network base-stations or gNodeBs (gNBs). extended Kalman filter (EKF) based practical signal processing algorithms are described while also the applicable Cramér-Rao lower-bounds (CRLBs) are derived and presented. Also, the related aspect of over-the-air estimation of the XR headset antenna constellation or antenna geometry is addressed. Additionally, the important practical challenges related to user equipment (UE) clock drifting as well as integer ambiguities in carrier phase based methods are both considered. Finally, an extensive set of numerical results is provided in an example indoor factory like environment, covering both 3.5 GHz and 28 GHz network deployments. The obtained results demonstrate the feasibility of continuous 6DoF tracking through the proposed approach, with root mean squared error (RMSE) accuracies below one degree for the 3D orientation and below one centimeter for the 3D location, respectively. The results also demonstrate that UE clock drifting and carrier phase integer ambiguities can both be efficiently estimated and tracked, as part of the overall proposed concept and methods.","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 5","pages":"919-934"},"PeriodicalIF":7.5,"publicationDate":"2023-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10232971","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79758062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Integrated Sensing and Communication for Wireless Extended Reality (XR) With Reconfigurable Intelligent Surface 基于可重构智能表面的无线扩展现实(XR)集成传感与通信
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-08-14 DOI: 10.1109/JSTSP.2023.3304846
Teng Ma;Yue Xiao;Xia Lei;Ming Xiao
Future wireless networks will witness ubiquitous human-machine interactions, where extended reality (XR) is expected to be a key scenario in next-generation mobile systems. In this article, we examine the integrated sensing and communication (ISAC) framework in XR, where a reconfigurable intelligent surface (RIS) may assist user (UE) positioning and communication. Specifically, a practical positioning algorithm based on multiple signal classification (MUSIC) with the aid of specially designed RIS configurations is conceived. Furthermore, we formulate the joint optimization of the UE beamformer and RIS phase shifter to maximize the channel capacity under Cramér-Rao lower bound (CRLB) constraints, which is solved by alternating optimization with gradient projection and manifold optimization. Finally, we use simulation results to demonstrate the feasibility of the conceived positioning algorithm and corroborate the effectiveness of the proposed optimization approach.
未来的无线网络将见证无处不在的人机交互,扩展现实(XR)有望成为下一代移动系统的关键场景。在本文中,我们研究了XR中的集成传感和通信(ISAC)框架,其中可重构智能表面(RIS)可以帮助用户(UE)定位和通信。具体而言,提出了一种基于多信号分类(MUSIC)的实用定位算法,并结合特殊设计的RIS配置。在cramsamr - rao下界(CRLB)约束下,提出了UE波束形成器和RIS移相器的联合优化方案,利用梯度投影和流形优化交替优化的方法实现了信道容量最大化。最后,利用仿真结果验证了所提出的定位算法的可行性,并验证了所提优化方法的有效性。
{"title":"Integrated Sensing and Communication for Wireless Extended Reality (XR) With Reconfigurable Intelligent Surface","authors":"Teng Ma;Yue Xiao;Xia Lei;Ming Xiao","doi":"10.1109/JSTSP.2023.3304846","DOIUrl":"10.1109/JSTSP.2023.3304846","url":null,"abstract":"Future wireless networks will witness ubiquitous human-machine interactions, where extended reality (XR) is expected to be a key scenario in next-generation mobile systems. In this article, we examine the integrated sensing and communication (ISAC) framework in XR, where a reconfigurable intelligent surface (RIS) may assist user (UE) positioning and communication. Specifically, a practical positioning algorithm based on multiple signal classification (MUSIC) with the aid of specially designed RIS configurations is conceived. Furthermore, we formulate the joint optimization of the UE beamformer and RIS phase shifter to maximize the channel capacity under Cramér-Rao lower bound (CRLB) constraints, which is solved by alternating optimization with gradient projection and manifold optimization. Finally, we use simulation results to demonstrate the feasibility of the conceived positioning algorithm and corroborate the effectiveness of the proposed optimization approach.","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 5","pages":"980-994"},"PeriodicalIF":7.5,"publicationDate":"2023-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81444716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Secure Communication Guarantees for Diverse Extended-Reality Applications: A Unified Statistical Security Model 多种扩展现实应用的安全通信保证:一个统一的统计安全模型
IF 7.5 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2023-08-10 DOI: 10.1109/JSTSP.2023.3304117
Yuquan Xiao;Qinghe Du;Wenchi Cheng;Nan Lu
Privacy and security assurance over wireless transmissions is one of critical issues for future extended reality (XR) communication systems expected to be supported by the sixth generation of mobile communications networks (6G). In light of the strong anti-eavesdropping capability, physical layer security (PLS) techniques have been recognized as a competitive candidate to provide secure transmissions for XR services. However, existing key performance evaluation metrics, such as the security capacity and the outage security capacity, cannot well capture diverse features of quality-of-security (QoSec) requirements raised by XR services. To overcome the problem, in this article we propose a unified statistical security model that can characterize fine-grained security requirements for various XR applications. Specifically, the eavesdropping process at the eavesdropper is modeled by a queuing system. The arrival process represents the legitimate user's streaming data correctly-captured by the eavesdropper. The departure process represents data that are outdated and moved out of the queue, fitting the essential time-sensitive nature of XR applications. Yet storing the overheard data in the queue is not equivalent to data recovery, the eavesdropper has to accumulate a sufficient of amount correctly-captured data in the queue to successfully decipher some data each time. Under this framework, leveraging the effective bandwidth theory in statistically queuing analyses, we develop the concept of statistical security capacity, which is used to evaluate the legitimate user's throughput with the constrained information level leaked to the eavesdropper. The statistical security model is featured with a parameter called QoSec exponent, quantitatively indicating the fine-grained level of security requirement. Following this model, we formulate the nonconvex statistical-security-capacity maximization problems with the internal and external eavesdroppers, respectively, associated with the cases with and without eavesdropper's CSI known at the legitimate transmitter. Solving the two problems, we derive the corresponding optimal resource schemes over the time-varying fading channels. Simulation results demonstrate our proposal as an effective model for security requirements, and our scheme can significantly improve security-constrained throughput in XR communications compared to the baseline schemes.
无线传输的隐私和安全保障是未来扩展现实(XR)通信系统的关键问题之一,预计将由第六代移动通信网络(6G)支持。由于具有较强的抗窃听能力,物理层安全(PLS)技术已被认为是为XR业务提供安全传输的有竞争力的候选技术。然而,现有的关键性能评估指标,如安全容量和中断安全容量,不能很好地捕获XR服务提出的安全质量(QoSec)需求的各种特性。为了克服这个问题,在本文中,我们提出了一个统一的统计安全模型,该模型可以描述各种XR应用程序的细粒度安全需求。具体来说,窃听器上的窃听过程由排队系统建模。到达过程表示被窃听者正确捕获的合法用户的流数据。离开流程表示过时的数据并移出队列,符合XR应用程序的基本时间敏感特性。然而,将窃听到的数据存储在队列中并不等同于数据恢复,窃听者必须在队列中积累足够数量的正确捕获的数据,才能每次成功解密一些数据。在此框架下,利用统计排队分析中的有效带宽理论,提出了统计安全容量的概念,用于评估合法用户在泄漏给窃听者的受限信息水平下的吞吐量。统计安全模型具有一个称为QoSec指数的参数,定量地指示了细粒度的安全需求级别。根据该模型,我们分别针对合法发射机已知窃听者CSI和不知道窃听者CSI的情况,提出了具有内部窃听者和外部窃听者的非凸统计安全容量最大化问题。针对这两个问题,我们推导出时变衰落信道上相应的最优资源方案。仿真结果表明,我们的方案是一种有效的安全需求模型,与基准方案相比,我们的方案可以显著提高XR通信中受安全约束的吞吐量。
{"title":"Secure Communication Guarantees for Diverse Extended-Reality Applications: A Unified Statistical Security Model","authors":"Yuquan Xiao;Qinghe Du;Wenchi Cheng;Nan Lu","doi":"10.1109/JSTSP.2023.3304117","DOIUrl":"10.1109/JSTSP.2023.3304117","url":null,"abstract":"Privacy and security assurance over wireless transmissions is one of critical issues for future extended reality (XR) communication systems expected to be supported by the sixth generation of mobile communications networks (6G). In light of the strong anti-eavesdropping capability, physical layer security (PLS) techniques have been recognized as a competitive candidate to provide secure transmissions for XR services. However, existing key performance evaluation metrics, such as the security capacity and the outage security capacity, cannot well capture diverse features of quality-of-security (QoSec) requirements raised by XR services. To overcome the problem, in this article we propose a unified statistical security model that can characterize fine-grained security requirements for various XR applications. Specifically, the eavesdropping process at the eavesdropper is modeled by a queuing system. The arrival process represents the legitimate user's streaming data correctly-captured by the eavesdropper. The departure process represents data that are outdated and moved out of the queue, fitting the essential time-sensitive nature of XR applications. Yet storing the overheard data in the queue is not equivalent to data recovery, the eavesdropper has to accumulate a sufficient of amount correctly-captured data in the queue to successfully decipher some data each time. Under this framework, leveraging the effective bandwidth theory in statistically queuing analyses, we develop the concept of statistical security capacity, which is used to evaluate the legitimate user's throughput with the constrained information level leaked to the eavesdropper. The statistical security model is featured with a parameter called QoSec exponent, quantitatively indicating the fine-grained level of security requirement. Following this model, we formulate the nonconvex statistical-security-capacity maximization problems with the internal and external eavesdroppers, respectively, associated with the cases with and without eavesdropper's CSI known at the legitimate transmitter. Solving the two problems, we derive the corresponding optimal resource schemes over the time-varying fading channels. Simulation results demonstrate our proposal as an effective model for security requirements, and our scheme can significantly improve security-constrained throughput in XR communications compared to the baseline schemes.","PeriodicalId":13038,"journal":{"name":"IEEE Journal of Selected Topics in Signal Processing","volume":"17 5","pages":"1007-1021"},"PeriodicalIF":7.5,"publicationDate":"2023-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75239149","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Journal of Selected Topics in Signal Processing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1