Assisted video object labeling by joint tracking of regions and keypoints.
2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6.
(pp. 2309 - 2315).
Manual labeling of objects in videos is a tedious task We present an approach which automatically propagates the labels from a single frame to the next ones.We tackle the challenging problem of tracking segmented regions by combining keypoint tracking with an advanced multiple region matching strategy, based on inclusion similarity and connected regions.We ran experiments on a 101 frame driving video sequence for which we produced the corresponding hand-labeled groundtruth. We make this valuable dataset available for the research community. We show our technique can accommodate variations in segmentation (and correct them), even in presence of multiple independent motions and partial occlusion. Results show that most of the labeled pixels can be correctly propagated even after a hundred frames. The performance of this automatic propagation mechanism over many frames can greatly reduce the user effort in the task of video object labeling.
|Title:||Assisted video object labeling by joint tracking of regions and keypoints|
|Event:||11th IEEE International Conference on Computer Vision|
|Location:||Rio de Janeiro, BRAZIL|
|Dates:||2007-10-14 - 2007-10-21|
|UCL classification:||UCL > School of BEAMS > Faculty of Engineering Science > Computer Science|
Archive Staff Only