Incentive Mechanism for Resource Trading in Video Analytic Services Using Reinforcement Learning

Abstract

Video analytics play a pivotal role in enhancing the safety of intelligent surveillance and autonomous driving. However, the transmission of vast video data and the computational demands of video analytics present challenges within traditional cloud computing paradigms. To address latency concerns, dynamic video analytics often leverage edge deployments. Nevertheless, the efficient allocation of resources at the edge, balancing cost-effectiveness and accuracy, becomes crucial, especially when multiple video analytics services concurrently operate within the system. This paper introduces an edge-centric incentive mechanism designed to encourage greater participation from edge nodes in offloading tasks. The key focus is on addressing the dynamic nature of edge resources and optimizing system returns through a rational pricing mechanism. We propose a decentralized Soft Actor-Critic algorithm grounded in game theory (DSACG) to autonomously learn the optimal pricing strategy. A comprehensive theoretical analysis, supported by extensive simulations, substantiates the effectiveness of our proposed solution.