Learning Team-Level Information Integration in Multi-Agent Communication

Xiangrui Meng, Ying Tan

Keywords: Multi-Agent Communication, Multi-Agent Reinforcement Learning, Team-Level Communication, Deep Reinforcement Learning

TL;DR: Double Channel Communication Model

Abstract: In human cooperation, both individual knowledge and group consensus play important roles in accomplishing tasks. However, existing multi-agent reinforcement learning (MARL) communication methods commonly focus on individual-level communication, which lacks the necessary global information for well-grounded decision-making. Meanwhile, individual-level communication is often infeasible when the communication bandwidth is limited. To tackle these problems, we propose a group-level information integration model called Double Channel Communication Network (DC2Net). DC2Net highlights the significance of independent group feature learning by separating individual and group feature learning into two independent channels. In this model, agents no longer communicate with each other in a peer-to-peer paradigm; instead, all interactions are carried out in the group channel. By combining individual and global features, decisions are made collaboratively. We conduct experiments on several multi-agent cooperative environments and the results show that the DC2Net not only outperforms state-of-the-art MARL communication models but also reduces the communication costs. Furthermore, the two independent channels enable adaptive balancing of individual and group feature learning based on task requirements.

Primary Area: reinforcement learning

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.

Submission Guidelines: I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2024/AuthorGuide.

Anonymous Url: I certify that there is no URL (e.g., github page) that could be used to find authors' identity.

No Acknowledgement Section: I certify that there is no acknowledgement section in this submission for double blind review.

Submission Number: 5718