Pan, J. et al. 2026. Pre-DPO: Improving Data Utilization in Direct Preference Optimization Using a Guiding Reference Model. Proceedings of the AAAI Conference on Artificial Intelligence. 40, 38 (Mar. 2026), 32646–32654. DOI:https://doi.org/10.1609/aaai.v40i38.40542.