Chen, Xing, Dongcui Diao, Hechang Chen, Hengshuai Yao, Haiyin Piao, Zhixiao Sun, Zhiwei Yang, Randy Goebel, Bei Jiang, and Yi Chang. 2023. “The Sufficiency of Off-Policyness and Soft Clipping: PPO Is Still Insufficient According to an Off-Policy Measure”. Proceedings of the AAAI Conference on Artificial Intelligence 37 (6):7078-86. https://doi.org/10.1609/aaai.v37i6.25864.