Tang, H.; Meng, Z.; Hao, J.; Chen, C.; Graves, D.; Li, D.; Yu, C.; Mao, H.; Liu, W.; Yang, Y. What about Inputting Policy in Value Function: Policy Representation and Policy-Extended Value Function Approximator. AAAI 2022, 36, 8441-8449.