Anti-Makeup: Learning A Bi-Level Adversarial Network for Makeup-Invariant Face Verification

Authors

  • Yi Li Institute of Automation, Chinese Academy of Sciences
  • Lingxiao Song Institute of Automation, Chinese Academy of Sciences
  • Xiang Wu Institute of Automation, Chinese Academy of Sciences
  • Ran He Institute of Automation, Chinese Academy of Sciences
  • Tieniu Tan Institute of Automation, Chinese Academy of Sciences

Abstract

Makeup is widely used to improve facial attractiveness and is well accepted by the public. However, different makeup styles will result in significant facial appearance changes. It remains a challenging problem to match makeup and non-makeup face images. This paper proposes a learning from generation approach for makeup-invariant face verification by introducing a bi-level adversarial network (BLAN). To alleviate the negative effects from makeup, we first generate non-makeup images from makeup ones, and then use the synthesized non-makeup images for further verification. Two adversarial networks in BLAN are integrated in an end-to-end deep network, with the one on pixel level for reconstructing appealing facial images and the other on feature level for preserving identity information. These two networks jointly reduce the sensing gap between makeup and non-makeup images. Moreover, we make the generator well constrained by incorporating multiple perceptual losses. Experimental results on three benchmark makeup face datasets demonstrate that our method achieves state-of-the-art verification accuracy across makeup status and can produce photo-realistic non-makeup face images.

Downloads

Published

2018-04-27

How to Cite

Li, Y., Song, L., Wu, X., He, R., & Tan, T. (2018). Anti-Makeup: Learning A Bi-Level Adversarial Network for Makeup-Invariant Face Verification. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1). Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/12294