Chen, X., D. Diao, H. Chen, H. Yao, H. Piao, Z. Sun, Z. Yang, R. Goebel, B. Jiang, and Y. Chang. “The Sufficiency of Off-Policyness and Soft Clipping: PPO Is Still Insufficient According to an Off-Policy Measure”. Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, no. 6, June 2023, pp. 7078-86, doi:10.1609/aaai.v37i6.25864.