Deep Semantic Structural Constraints for Zero-Shot Learning

Authors

  • Yan Li Institute of Automation, Chinese Academy of Sciences
  • Zhen Jia Institute of Automation, Chinese Academy of Sciences
  • Junge Zhang Institute of Automation, Chinese Academy of Sciences
  • Kaiqi Huang Institute of Automation, Chinese Academy of Sciences
  • Tieniu Tan Institute of Automation, Chinese Academy of Sciences

DOI:

https://doi.org/10.1609/aaai.v32i1.12244

Abstract

Zero-shot learning aims to classify unseen image categories by learning a visual-semantic embedding space. In most cases, the traditional methods adopt a separated two-step pipeline that extracts image features are utilized to learn the embedding space. It leads to the lack of specific structural semantic information of image features for zero-shot learning task. In this paper, we propose an end-to-end trainable Deep Semantic Structural Constraints model to address this issue. The proposed model contains the Image Feature Structure constraint and the Semantic Embedding Structure constraint, which aim to learn structure-preserving image features and endue the learned embedding space with stronger generalization ability respectively. With the assistance of semantic structural information, the model gains more auxiliary clues for zero-shot learning. The state-of-the-art performance certifies the effectiveness of our proposed method.

Downloads

Published

2018-04-27

How to Cite

Li, Y., Jia, Z., Zhang, J., Huang, K., & Tan, T. (2018). Deep Semantic Structural Constraints for Zero-Shot Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1). https://doi.org/10.1609/aaai.v32i1.12244