H. Tang, “What about Inputting Policy in Value Function: Policy Representation and Policy-Extended Value Function Approximator”, AAAI, vol. 36, no. 8, pp. 8441–8449, Jun. 2022.