Xu, Y. et al. 2026. When Human Preferences Flip: An Instance-Dependent Robust Loss for RLHF. Proceedings of the AAAI Conference on Artificial Intelligence. 40, 44 (Mar. 2026), 38057–38065. DOI:https://doi.org/10.1609/aaai.v40i44.41143.