Multiple Approximate Dynamic Programming Controllers for Congestion Control

Yanping Xiang, Jianqiang Yi, Dongbin Zhao

Abstract: A communication network is a highly complex nonlinear dynamical system. To avoid congestion collapse and keep network utilization high, many congestion control methods have been proposed. In this paper, a new framework, using Adaptive Critic Designs (ACD) based on Approximate Dynamic Programming (ADP) theory, is presented for network congestion control. At the present time, almost all ACD controllers are designed for centralized control system. In the new frame, the whole network is considered as a multiple non-cooperative ACDs control system, wherein, each source controller is governed by an ACD. This frame provides a new approach to solve the congestion control problem of the networks.