Xu, Yifan, et al. “When Human Preferences Flip: An Instance-Dependent Robust Loss for RLHF”. Proceedings of the AAAI Conference on Artificial Intelligence, vol. 40, no. 44, Mar. 2026, pp. 38057-65, doi:10.1609/aaai.v40i44.41143.