Discriminative Feature Learning for Unsupervised Video Summarization

Authors

  • Yunjae Jung Korea Advanced Institute of Science and Technology
  • Donghyeon Cho Korea Advanced Institute of Science and Technology
  • Dahun Kim Korea Advanced Institute of Science and Technology
  • Sanghyun Woo Korea Advanced Institute of Science and Technology
  • In So Kweon Korea Advanced Institute of Science and Technology

DOI:

https://doi.org/10.1609/aaai.v33i01.33018537

Abstract

In this paper, we address the problem of unsupervised video summarization that automatically extracts key-shots from an input video. Specifically, we tackle two critical issues based on our empirical observations: (i) Ineffective feature learning due to flat distributions of output importance scores for each frame, and (ii) training difficulty when dealing with longlength video inputs. To alleviate the first problem, we propose a simple yet effective regularization loss term called variance loss. The proposed variance loss allows a network to predict output scores for each frame with high discrepancy which enables effective feature learning and significantly improves model performance. For the second problem, we design a novel two-stream network named Chunk and Stride Network (CSNet) that utilizes local (chunk) and global (stride) temporal view on the video features. Our CSNet gives better summarization results for long-length videos compared to the existing methods. In addition, we introduce an attention mechanism to handle the dynamic information in videos. We demonstrate the effectiveness of the proposed methods by conducting extensive ablation studies and show that our final model achieves new state-of-the-art results on two benchmark datasets.

Downloads

Published

2019-07-17

How to Cite

Jung, Y., Cho, D., Kim, D., Woo, S., & Kweon, I. S. (2019). Discriminative Feature Learning for Unsupervised Video Summarization. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01), 8537-8544. https://doi.org/10.1609/aaai.v33i01.33018537

Issue

Section

AAAI Technical Track: Vision