Active Video Summarization: Customized Summaries via On-line Interaction with the User

Authors

  • Ana Garcia del Molino Institute for Infocomm Research, A*STAR
  • Xavier Boix Massachusetts Institute of Technology
  • Joo-Hwee Lim Institute for Infocomm Research, A*STAR
  • Ah-Hwee Tan Nanyang Technological University

DOI:

https://doi.org/10.1609/aaai.v31i1.11234

Keywords:

Video Summarization, Wearable and Consumer Videos, User's Preferences, Active Inference

Abstract

To facilitate the browsing of long videos, automatic video summarization provides an excerpt that represents its content. In the case of egocentric and consumer videos, due to their personal nature, adapting the summary to specific user's preferences is desirable. Current approaches to customizable video summarization obtain the user's preferences prior to the summarization process. As a result, the user needs to manually modify the summary to further meet the preferences. In this paper, we introduce Active Video Summarization (AVS), an interactive approach to gather the user's preferences while creating the summary. AVS asks questions about the summary to update it on-line until the user is satisfied. To minimize the interaction, the best segment to inquire next is inferred from the previous feedback. We evaluate AVS in the commonly used UTEgo dataset. We also introduce a new dataset for customized video summarization (CSumm) recorded with a Google Glass. The results show that AVS achieves an excellent compromise between usability and quality. In 41% of the videos, AVS is considered the best over all tested baselines, including summaries manually generated. Also, when looking for specific events in the video, AVS provides an average level of satisfaction higher than those of all other baselines after only six questions to the user.

Downloads

Published

2017-02-12

How to Cite

Garcia del Molino, A., Boix, X., Lim, J.-H., & Tan, A.-H. (2017). Active Video Summarization: Customized Summaries via On-line Interaction with the User. Proceedings of the AAAI Conference on Artificial Intelligence, 31(1). https://doi.org/10.1609/aaai.v31i1.11234