Le Lan, C.; G. Bellemare, M.; Castro, P. S. Metrics and Continuity in Reinforcement Learning. AAAI 2021, 35, 8261-8269.