N. M. Al-Shakarji,
G. Seetharaman, and
International Society for Optics and Photonics ,
Multi-object tracking is one of the most challenging problem among computer vision applications due to computational cost, partial or full occlusions, crowded scenes, and etc. It has many real-life applicable uses from surveillance to video analysis and video summarization. In this paper, we propose a hybrid tracking-by-detection system that combines local and global data association scheme to ensure efficiency and reduce complexity. In local data association, spatial and appearance modules are used to ensure first step assignment for the strongest object matching. Then tracklet linking is applied during global data association step after filtering out all unreliable and distractor hypotheses using spatial, temporal and appearance descriptors. Our framework can handle the appearance of new objects, temporal disappearance, object terminations, and object occlusions. Our experiments on MOT16 dataset consisting of challenging real-world videos show the integration between local and global data association is important and having promising performance.
author = "N. M. Al-Shakarji and F. Bunyak and G. Seetharaman and K. Palaniappan",
title = "A hybrid local and global multi-object tracking with semantic spatial and appearance modules",
year = 2018,
journal = "International Society for Optics and Photonics ",
volume = 10645,
pages = "106450B",
month = "Apr",
keywords = "multi-object tracking, tracking-by-detection, global data association, local data association, appearance modules",
url = "https://spiedigitallibrary.org/conference-proceedings-of-spie/10645/106450B/A-hybrid-local-and-global-multi-object-tracking-with-semantic/10.1117/12.2309315.short"
N. M. Al-Shakarji, F. Bunyak, G. Seetharaman, and K. Palaniappan. A hybrid local and global multi-object tracking with semantic spatial and appearance modules. International Society for Optics and Photonics , volume 10645, pages 106450B, April 2018.