T2MAC: Targeted and Trusted Multi-Agent Communication through Selective Engagement and Evidence-Driven Integration

Authors

  • Chuxiong Sun Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences State Key Laboratory of Intelligent Game
  • Zehua Zang Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences University of Chinese Academy of Sciences
  • Jiabao Li School of Automation and Electrical Engineering, University of Science and Technology Beijing
  • Jiangmeng Li Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences State Key Laboratory of Intelligent Game
  • Xiao Xu State Key Laboratory of Intelligent Game
  • Rui Wang Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences State Key Laboratory of Intelligent Game University of Chinese Academy of Sciences
  • Changwen Zheng Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences University of Chinese Academy of Sciences

DOI:

https://doi.org/10.1609/aaai.v38i13.29438

Keywords:

ML: Reinforcement Learning, MAS: Agent Communication

Abstract

Communication stands as a potent mechanism to harmonize the behaviors of multiple agents. However, existing work primarily concentrates on broadcast communication, which not only lacks practicality, but also leads to information redundancy. This surplus, one-fits-all information could adversely impact the communication efficiency. Furthermore, existing works often resort to basic mechanisms to integrate observed and received information, impairing the learning process. To tackle these difficulties, we propose Targeted and Trusted Multi-Agent Communication (T2MAC), a straightforward yet effective method that enables agents to learn selective engagement and evidence-driven integration. With T2MAC, agents have the capability to craft individualized messages, pinpoint ideal communication windows, and engage with reliable partners, thereby refining communication efficiency. Following the reception of messages, the agents integrate information observed and received from different sources at an evidence level. This process enables agents to collectively use evidence garnered from multiple perspectives, fostering trusted and cooperative behaviors. We evaluate our method on a diverse set of cooperative multi-agent tasks, with varying difficulties, involving different scales and ranging from Hallway, MPE to SMAC. The experiments indicate that the proposed model not only surpasses the state-of-the-art methods in terms of cooperative performance and communication efficiency, but also exhibits impressive generalization.

Downloads

Published

2024-03-24

How to Cite

Sun, C., Zang, Z., Li, J., Li, J., Xu, X., Wang, R., & Zheng, C. (2024). T2MAC: Targeted and Trusted Multi-Agent Communication through Selective Engagement and Evidence-Driven Integration. Proceedings of the AAAI Conference on Artificial Intelligence, 38(13), 15154-15163. https://doi.org/10.1609/aaai.v38i13.29438

Issue

Section

AAAI Technical Track on Machine Learning IV