AATEAM: Achieving the Ad Hoc Teamwork by Employing the Attention Mechanism


  • Shuo Chen Nanyang Technological University
  • Ewa Andrejczuk Nanyang Technological University
  • Zhiguang Cao National University of Singapore
  • Jie Zhang Nanyang Technological University




In the ad hoc teamwork setting, a team of agents needs to perform a task without prior coordination. The most advanced approach learns policies based on previous experiences and reuses one of the policies to interact with new teammates. However, the selected policy in many cases is sub-optimal. Switching between policies to adapt to new teammates' behaviour takes time, which threatens the successful performance of a task. In this paper, we propose AATEAM – a method that uses the attention-based neural networks to cope with new teammates' behaviour in real-time. We train one attention network per teammate type. The attention networks learn both to extract the temporal correlations from the sequence of states (i.e. contexts) and the mapping from contexts to actions. Each attention network also learns to predict a future state given the current context and its output action. The prediction accuracies help to determine which actions the ad hoc agent should take. We perform extensive experiments to show the effectiveness of our method.




How to Cite

Chen, S., Andrejczuk, E., Cao, Z., & Zhang, J. (2020). AATEAM: Achieving the Ad Hoc Teamwork by Employing the Attention Mechanism. Proceedings of the AAAI Conference on Artificial Intelligence, 34(05), 7095-7102. https://doi.org/10.1609/aaai.v34i05.6196



AAAI Technical Track: Multiagent Systems