Graph-based Hierarchical Video Segmentation with
filter-based motion features
This software implements a video segmentation algorithm, together with filter-based motion features, respectively proposed in the following papers:
Efficient Hierarchical Graph-Based Video Segmentation
Matthias Grundmann, Vivek Kwatra, Mei Han, Irfan Essa, CVPR, 2010.
Segmentation of Dynamic Scenes with Distributions of Spatiotemporally Oriented Energies
Damien Teney, Matthew Brown, BMVC, 2014.
The segmentation algorithm is flexible and can use, as features, the original color histograms, the histograms of filter-based motion features (HoMEs), histograms of optical flow, or combinations of those. New types of features can easily be integrated as well. The extraction of image features and the segmention are to be run separately in two separate steps. Please see the provided examples.
Two tools are provided to open and visualize the results of the segmentation:
An interactive tool that allows flipping through frames and levels of the segmentation.
A single-run function that generates an image with the boundaries of the segments of all levels of the segmentation, where the strength of each boundary is defined from the highest level of the segmentation it appears in.
Some MEX code needs to be compiled to run the segmentation algorithm. This can be done with the following script: /Segmentation/private/make.m