Open Access Research

Real-time reliability measure-driven multi-hypothesis tracking using 2D and 3D features

Marcos D Zúñiga1*, François Brémond2 and Monique Thonnat2

Author Affiliations

1 Electronics Department, Universidad Técnica Federico Santa María, Av. España 1680, Casilla 110-V, Valparaíso, Chile

2 Project-Team PULSAR - INRIA, 2004 route des Lucioles, Sophia Antipolis, France

For all author emails, please log on.

EURASIP Journal on Advances in Signal Processing 2011, 2011:142  doi:10.1186/1687-6180-2011-142

Published: 30 December 2011

Abstract

We propose a new multi-target tracking approach, which is able to reliably track multiple objects even with poor segmentation results due to noisy environments. The approach takes advantage of a new dual object model combining 2D and 3D features through reliability measures. In order to obtain these 3D features, a new classifier associates an object class label to each moving region (e.g. person, vehicle), a parallelepiped model and visual reliability measures of its attributes. These reliability measures allow to properly weight the contribution of noisy, erroneous or false data in order to better maintain the integrity of the object dynamics model. Then, a new multi-target tracking algorithm uses these object descriptions to generate tracking hypotheses about the objects moving in the scene. This tracking approach is able to manage many-to-many visual target correspondences. For achieving this characteristic, the algorithm takes advantage of 3D models for merging dissociated visual evidence (moving regions) potentially corresponding to the same real object, according to previously obtained information. The tracking approach has been validated using video surveillance benchmarks publicly accessible. The obtained performance is real time and the results are competitive compared with other tracking algorithms, with minimal (or null) reconfiguration effort between different videos.

Keywords:
multi-hypothesis tracking; reliability measures; object models