Topology Distance: A Topology-Based Approach for Evaluating Generative Adversarial Networks

Authors

  • Danijela Horak AIG
  • Simiao Yu AIG
  • Gholamreza Salimi-Khorshidi AIG University of Oxford

DOI:

https://doi.org/10.1609/aaai.v35i9.16943

Keywords:

Neural Generative Models & Autoencoders, Adversarial Learning & Robustness, General, Evaluation and Analysis (Machine Learning)

Abstract

Automatic evaluation of the goodness of Generative Adversarial Networks (GANs) has been a challenge for the field of machine learning. In this work, we propose a distance complementary to existing measures: Topology Distance (TD), the main idea behind which is to compare the geometric and topological features of the latent manifold of real data with those of generated data. More specifically, we build Vietoris-Rips complex on image features, and define TD based on the differences in persistent-homology groups of the two manifolds. We compare TD with the most commonly-used and relevant measures in the field, including Inception Score (IS), Fr\'echet Inception Distance (FID), Kernel Inception Distance (KID) and Geometry Score (GS), in a range of experiments on various datasets. We demonstrate the unique advantage and superiority of our proposed approach over the aforementioned metrics. A combination of our empirical results and the theoretical argument we propose in favour of TD, strongly supports the claim that TD is a powerful candidate metric that researchers can employ when aiming to automatically evaluate the goodness of GANs’ learning.

Downloads

Published

2021-05-18

How to Cite

Horak, D., Yu, S., & Salimi-Khorshidi, G. (2021). Topology Distance: A Topology-Based Approach for Evaluating Generative Adversarial Networks. Proceedings of the AAAI Conference on Artificial Intelligence, 35(9), 7721-7728. https://doi.org/10.1609/aaai.v35i9.16943

Issue

Section

AAAI Technical Track on Machine Learning II