TY - JOUR AU - Guo, Tianchu AU - Zhang, Hui AU - Yoo, ByungIn AU - Liu, Yongchao AU - Kwak, Youngjun AU - Han, Jae-Joon PY - 2021/05/18 Y2 - 2024/03/29 TI - Order Regularization on Ordinal Loss for Head Pose, Age and Gaze Estimation JF - Proceedings of the AAAI Conference on Artificial Intelligence JA - AAAI VL - 35 IS - 2 SE - AAAI Technical Track on Computer Vision I DO - 10.1609/aaai.v35i2.16240 UR - https://ojs.aaai.org/index.php/AAAI/article/view/16240 SP - 1496-1504 AB - Ordinal loss is widely used in solving regression problems with deep learning technologies. Its basic idea is to convert regression to classification while preserving the natural order. However, the order constraint is enforced only by ordinal label implicitly, leading to the real output values not strictly in order. It causes the network to learn separable feature rather than discriminative feature, and possibly overfit on training set. In this paper, we propose order regularization on ordinal loss, which makes the outputs in order by explicitly constraining the ordinal classifiers in order. The proposed method contains two parts, i.e. similar-weights constraint, which reduces the ineffective space between classifiers, and differential-bias constraint, which enforces the decision planes in order and enhances the discrimination power of the classifiers. Experimental results show that our proposed method boosts the performance of original ordinal loss on various regression problems such as head pose, age, and gaze estimation, with significant error reduction of around 5%. Furthermore, our method outperforms the state of the art on all these tasks, with the performance gain of 14.4%, 2.2% and 6.5% on head pose, age and gaze estimation respectively. ER -