Deep Graph-neighbor Coherence Preserving Network for Unsupervised Cross-modal Hashing

Authors

  • Jun Yu Hangzhou Dianzi University
  • Hao Zhou Hangzhou Dianzi University
  • Yibing Zhan Hangzhou Dianzi University
  • Dacheng Tao The University of Sydney

Keywords:

Web Search & Information Retrieval

Abstract

Unsupervised cross-modal hashing (UCMH) has become a hot topic recently. Current UCMH focuses on exploring data similarities. However, current UCMH methods calculate the similarity between two data, mainly relying on the two data's cross-modal features. These methods suffer from inaccurate similarity problems that result in a suboptimal retrieval Hamming space, because the cross-modal features between the data are not sufficient to describe the complex data relationships, such as situations where two data have different feature representations but share the inherent concepts. In this paper, we devise a deep graph-neighbor coherence preserving network (DGCPN). Specifically, DGCPN stems from graph models and explores graph-neighbor coherence by consolidating the information between data and their neighbors. DGCPN regulates comprehensive similarity preserving losses by exploiting three types of data similarities (i.e., the graph-neighbor coherence, the coexistent similarity, and the intra- and inter-modality consistency) and designs a half-real and half-binary optimization strategy to reduce the quantization errors during hashing. Essentially, DGCPN addresses the inaccurate similarity problem by exploring and exploiting the data's intrinsic relationships in a graph. We conduct extensive experiments on three public UCMH datasets. The experimental results demonstrate the superiority of DGCPN, e.g., by improving the mean average precision from 0.722 to 0.751 on MIRFlickr-25K using 64-bit hashing codes to retrieval texts from images. We will release the source code package and the trained model on https://github.com/Atmegal/DGCPN.

Downloads

Published

2021-05-18

How to Cite

Yu, J., Zhou, H., Zhan, Y., & Tao, D. (2021). Deep Graph-neighbor Coherence Preserving Network for Unsupervised Cross-modal Hashing. Proceedings of the AAAI Conference on Artificial Intelligence, 35(5), 4626-4634. Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/16592

Issue

Section

AAAI Technical Track on Data Mining and Knowledge Management