Tang, Hongyao, et al. “What about Inputting Policy in Value Function: Policy Representation and Policy-Extended Value Function Approximator”. Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 8, June 2022, pp. 8441-9, doi:10.1609/aaai.v36i8.20820.