Rushes Summarization with Self-Organizing Maps

Markus Koskela, Mats Sjöberg, Jorma Laaksonen, Ville Viitaniemi, and Hannes Muurinen. In Proceedings of TRECVID Workshop on Video Summarization (TVS 2007) at ACM Multimedia 2007. Augsburg, Germany. September 2007.

PDF version available here. © Copyright 2007 by ACM, Inc.

In this paper, we describe our approach for video summarization that was applied to the BBC rushes material as part of the TRECVID 2007 evaluations. The method consists of initial shot boundary detection followed by shot similarity assessment and pruning, with both stages implemented using multiple parallel Self-Organizing Maps and within our content-based multimedia information retrieval and analysis framework named PicSOM. The results indicate that our approach can be successfully applied to rushes summarization. Compared to other submissions, our method resulted in the overall shortest summaries with close to median performance in the fraction of ground-truth inclusions found.