Ouhamma, R.; Basu, D.; Maillard, O. Bilinear Exponential Family of MDPs: Frequentist Regret Bound With Tractable Exploration & Planning. AAAI 2023, 37, 9336-9344.