Determinantal Reinforcement Learning

Authors

  • Takayuki Osogami IBM Research - Tokyo
  • Rudy Raymond IBM Research - Tokyo

DOI:

https://doi.org/10.1609/aaai.v33i01.33014659

Abstract

We study reinforcement learning for controlling multiple agents in a collaborative manner. In some of those tasks, it is insufficient for the individual agents to take relevant actions, but those actions should also have diversity. We propose the approach of using the determinant of a positive semidefinite matrix to approximate the action-value function in reinforcement learning, where we learn the matrix in a way that it represents the relevance and diversity of the actions. Experimental results show that the proposed approach allows the agents to learn a nearly optimal policy approximately ten times faster than baseline approaches in benchmark tasks of multi-agent reinforcement learning. The proposed approach is also shown to achieve the performance that cannot be achieved with conventional approaches in partially observable environment with exponentially large action space.

Downloads

Published

2019-07-17

How to Cite

Osogami, T., & Raymond, R. (2019). Determinantal Reinforcement Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01), 4659-4666. https://doi.org/10.1609/aaai.v33i01.33014659

Issue

Section

AAAI Technical Track: Machine Learning