Chen, Xing, Dongcui Diao, Hechang Chen, Hengshuai Yao, Haiyin Piao, Zhixiao Sun, Zhiwei Yang, Randy Goebel, Bei Jiang, and Yi Chang. “The Sufficiency of Off-Policyness and Soft Clipping: PPO Is Still Insufficient According to an Off-Policy Measure”. Proceedings of the AAAI Conference on Artificial Intelligence 37, no. 6 (June 26, 2023): 7078-7086. Accessed May 8, 2024. https://ojs.aaai.org/index.php/AAAI/article/view/25864.