Remember More by Recalling Less: Investigating the Role of Batch Size in Continual Learning with Experience Replay (Student Abstract)

Authors

  • Maciej Wołczyk Jagiellonian University
  • Andrii Krutsylo Jagiellonian University

Keywords:

Continual Learning, Experience Replay, Online Learning, Optimiziation

Abstract

Experience replay is a simple and well-performing strategy for continual learning problems, often used as a basis for more advanced methods. However, the dynamics of experience replay are not yet well understood. To showcase this, we focus on a single component of this problem, namely choosing the batch size of the buffer samples. We find that small batches perform much better at stopping forgetting than larger batches, contrary to the intuitive assumption that it is better to recall more samples from the past to avoid forgetting. We show that this phenomenon does not disappear under learning rate tuning and we propose possible directions for further analysis.

Downloads

Published

2021-05-18

How to Cite

Wołczyk, M., & Krutsylo, A. (2021). Remember More by Recalling Less: Investigating the Role of Batch Size in Continual Learning with Experience Replay (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence, 35(18), 15923-15924. Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/17958

Issue

Section

AAAI Student Abstract and Poster Program