CLASSQ-L: A Q-Learning Algorithm for Adversarial Real-Time Strategy Games

Abstract

We present CLASS_Q-L (for: class Q-learning) an application of the Q-learning reinforcement learning algorithm to play complete Wargus games. Wargus is a real-time strategy game where players control armies consisting of units of different classes (e.g., archers, knights). CLASS_Q-L uses a single table for each class  of unit so that each unit is controlled and updates its class’ Q-table. This enables rapid learning as in Wargus there are many units of the same class. We present initial results of CLASS_Q-L against a variety of opponents.