Flattening supervoxel hierarchies by the uniform entropy slice

Chenliang Xu, Spencer Whitt, Jason J. Corso

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

47 Scopus citations

Abstract

Supervoxel hierarchies provide a rich multiscale decomposition of a given video suitable for subsequent processing in video analysis. The hierarchies are typically computed by an unsupervised process that is susceptible to under-segmentation at coarse levels and over-segmentation at fine levels, which make it a challenge to adopt the hierarchies for later use. In this paper, we propose the first method to overcome this limitation and flatten the hierarchy into a single segmentation. Our method, called the uniform entropy slice, seeks a selection of supervoxels that balances the relative level of information in the selected supervoxels based on some post hoc feature criterion such as object-ness. For example, with this criterion, in regions nearby objects, our method prefers finer supervoxels to capture the local details, but in regions away from any objects we prefer coarser supervoxels. We formulate the uniform entropy slice as a binary quadratic program and implement four different feature criteria, both unsupervised and supervised, to drive the flattening. Although we apply it only to supervoxel hierarchies in this paper, our method is generally applicable to segmentation tree hierarchies. Our experiments demonstrate both strong qualitative performance and superior quantitative performance to state of the art baselines on benchmark internet videos.

Original languageEnglish
Title of host publicationProceedings - 2013 IEEE International Conference on Computer Vision, ICCV 2013
Pages2240-2247
Number of pages8
DOIs
StatePublished - 2013
Event2013 14th IEEE International Conference on Computer Vision, ICCV 2013 - Sydney, NSW, Australia
Duration: 1 Dec 20138 Dec 2013

Publication series

NameProceedings of the IEEE International Conference on Computer Vision

Conference

Conference2013 14th IEEE International Conference on Computer Vision, ICCV 2013
Country/TerritoryAustralia
CitySydney, NSW
Period1/12/138/12/13

Fingerprint

Dive into the research topics of 'Flattening supervoxel hierarchies by the uniform entropy slice'. Together they form a unique fingerprint.

Cite this