ER: Equivariance Regularizer for Knowledge Graph Completion
Keywords:Knowledge Representation And Reasoning (KRR)
AbstractTensor factorization and distanced based models play important roles in knowledge graph completion (KGC). However, the relational matrices in KGC methods often induce a high model complexity, bearing a high risk of overfitting. As a remedy, researchers propose a variety of different regularizers such as the tensor nuclear norm regularizer. Our motivation is based on the observation that the previous work only focuses on the “size” of the parametric space, while leaving the implicit semantic information widely untouched. To address this issue, we propose a new regularizer, namely, Equivariance Regularizer (ER), which can suppress overfitting by leveraging the implicit semantic information. Specifically, ER can enhance the generalization ability of the model by employing the semantic equivariance between the head and tail entities. Moreover, it is a generic solution for both distance based models and tensor factorization based models. Our experimental results indicate a clear and substantial improvement over the state-of-the-art relation prediction methods.
How to Cite
Cao, Z., Xu, Q., Yang, Z., & Huang, Q. (2022). ER: Equivariance Regularizer for Knowledge Graph Completion. Proceedings of the AAAI Conference on Artificial Intelligence, 36(5), 5512-5520. https://doi.org/10.1609/aaai.v36i5.20490
AAAI Technical Track on Knowledge Representation and Reasoning