{"title":"Optimization of resource allocation strategy for high-speed railway based on deep reinforcement learning","authors":"Xu Gao , Junhui Zhao , Qingmiao Zhang , Haitao Han","doi":"10.1016/j.phycom.2024.102455","DOIUrl":null,"url":null,"abstract":"<div><p>With the accelerated development of high-speed railway (HSR), the contradiction between the surge of user services and the demand for resource has become increasingly prominent. Mobile edge computing (MEC) has emerged to improve performance, reduce communication delay and ease network load. In this paper, we design a multi-user MEC system framework that aims to solve the joint optimization problem of computation offloading and resource allocation in HSR communication scenario with deep reinforcement learning algorithm. The framework dynamically allocates computation resource and network bandwidth through the real-time distance between users and base station (BS) to achieve optimal resource utilization and maximize user experience. To achieve this goal, we use a deep reinforcement learning based dynamic computation offloading and resource allocation (DDCORA) optimization algorithm. The algorithm minimizes the system cost by sharing state information among different users and making collaborative decisions to rationally allocate spectrum resource and computation resource. Simulation results show that DDCORA algorithm can significantly decrease the system cost while enhancing the overall system performance and user experience.</p></div>","PeriodicalId":48707,"journal":{"name":"Physical Communication","volume":"66 ","pages":"Article 102455"},"PeriodicalIF":2.0000,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physical Communication","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1874490724001733","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
With the accelerated development of high-speed railway (HSR), the contradiction between the surge of user services and the demand for resource has become increasingly prominent. Mobile edge computing (MEC) has emerged to improve performance, reduce communication delay and ease network load. In this paper, we design a multi-user MEC system framework that aims to solve the joint optimization problem of computation offloading and resource allocation in HSR communication scenario with deep reinforcement learning algorithm. The framework dynamically allocates computation resource and network bandwidth through the real-time distance between users and base station (BS) to achieve optimal resource utilization and maximize user experience. To achieve this goal, we use a deep reinforcement learning based dynamic computation offloading and resource allocation (DDCORA) optimization algorithm. The algorithm minimizes the system cost by sharing state information among different users and making collaborative decisions to rationally allocate spectrum resource and computation resource. Simulation results show that DDCORA algorithm can significantly decrease the system cost while enhancing the overall system performance and user experience.
期刊介绍:
PHYCOM: Physical Communication is an international and archival journal providing complete coverage of all topics of interest to those involved in all aspects of physical layer communications. Theoretical research contributions presenting new techniques, concepts or analyses, applied contributions reporting on experiences and experiments, and tutorials are published.
Topics of interest include but are not limited to:
Physical layer issues of Wireless Local Area Networks, WiMAX, Wireless Mesh Networks, Sensor and Ad Hoc Networks, PCS Systems; Radio access protocols and algorithms for the physical layer; Spread Spectrum Communications; Channel Modeling; Detection and Estimation; Modulation and Coding; Multiplexing and Carrier Techniques; Broadband Wireless Communications; Wireless Personal Communications; Multi-user Detection; Signal Separation and Interference rejection: Multimedia Communications over Wireless; DSP Applications to Wireless Systems; Experimental and Prototype Results; Multiple Access Techniques; Space-time Processing; Synchronization Techniques; Error Control Techniques; Cryptography; Software Radios; Tracking; Resource Allocation and Inference Management; Multi-rate and Multi-carrier Communications; Cross layer Design and Optimization; Propagation and Channel Characterization; OFDM Systems; MIMO Systems; Ultra-Wideband Communications; Cognitive Radio System Architectures; Platforms and Hardware Implementations for the Support of Cognitive, Radio Systems; Cognitive Radio Resource Management and Dynamic Spectrum Sharing.