Video Content Placement at the Network Edge: Centralized and Distributed Algorithms

Yanan Gao, Song Yang, Fan Li, Stojan Trajanovski, Pan Zhou, Pan Hui, Xiaoming Fu

Abstract: In the traditional video streaming service paradigm, content providers typically provision the requested video content to viewers through a central content delivery network (CDN). However, remote viewers usually experience long video streaming delay due to uncertain wide area network delay, which severely affects the quality of experience. Multi-Access Edge Computing (MEC) offers a way to shorten the video streaming delay by building small-scale cloud infrastructures at the network edge, which are in close proximity to the viewers. In this paper, we present novel centralized and distributed algorithms for the video content placement problem in MEC. In the proposed centralized video content placement algorithm, we leverage the Lyapunov optimization technique to formulate the video content placement problem as a series of one-time-slot optimization problems and apply an Alternating Direction Method of Multipliers (ADMM)-based method to solve each of them. We further devise a distributed Multi-Agent Reinforcement Learning (MARL)-based method with value decomposition mechanism and parallelization policy update method to solve the video content placement problem. The value Decomposition mechanism deals with the credit assignment among multiple agents, which promotes the cooperative optimization of the global target and reduces the frequency of information exchange. The parallelization of policy network can speed up the convergence process. Simulation results verify the effectiveness and superiority of our proposed centralized and distributed algorithms in terms of performance.