Remember More by Recalling Less: Investigating the Role of Batch Size in Continual Learning with Experience Replay (Student Abstract)
Keywords:Continual Learning, Experience Replay, Online Learning, Optimiziation
AbstractExperience replay is a simple and well-performing strategy for continual learning problems, often used as a basis for more advanced methods. However, the dynamics of experience replay are not yet well understood. To showcase this, we focus on a single component of this problem, namely choosing the batch size of the buffer samples. We find that small batches perform much better at stopping forgetting than larger batches, contrary to the intuitive assumption that it is better to recall more samples from the past to avoid forgetting. We show that this phenomenon does not disappear under learning rate tuning and we propose possible directions for further analysis.
How to Cite
Wołczyk, M., & Krutsylo, A. (2021). Remember More by Recalling Less: Investigating the Role of Batch Size in Continual Learning with Experience Replay (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence, 35(18), 15923-15924. Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/17958
AAAI Student Abstract and Poster Program