Multiple object tracking with attention to appearance, structure, motion and size

Objective of multiple object tracking (MOT) is to assign a unique track identity for all the objects of interest in a video, across the whole sequence. Tracking-by-detection is the most common approach used in addressing MOT problem. In this work, we propose a method to address MOT by defining a dis...

Full description

Saved in:
Bibliographic Details
Main Authors: Karunasekera, Hasith, Wang, Han, Zhang, Handuo
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2021
Subjects:
Online Access:https://hdl.handle.net/10356/146128
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-146128
record_format dspace
spelling sg-ntu-dr.10356-1461282021-01-27T04:16:57Z Multiple object tracking with attention to appearance, structure, motion and size Karunasekera, Hasith Wang, Han Zhang, Handuo School of Electrical and Electronic Engineering Engineering::Electrical and electronic engineering Multiple Object Tracking (MOT) Histograms Objective of multiple object tracking (MOT) is to assign a unique track identity for all the objects of interest in a video, across the whole sequence. Tracking-by-detection is the most common approach used in addressing MOT problem. In this work, we propose a method to address MOT by defining a dissimilarity measure based on object motion, appearance, structure, and size. We calculate the appearance and structure-based dissimilarity measure by matching histograms following a grid architecture. Motion and size for each track are predicted using the information from track's history. These dissimilarity values are then used in the Hungarian algorithm, in the data association step for track identity assignment. In addition, we introduce a method to address any false detection in stable tracks. The proposed method runs in real time following an online approach. We evaluate our method in both MOT17 benchmark data-set for pedestrian tracking and KITTI benchmark data-set for vehicle tracking using the same system parameters to verify the robustness of the proposed method. The method can achieve state-of-the-art results in both benchmarks. National Research Foundation (NRF) Published version 2021-01-27T04:16:57Z 2021-01-27T04:16:57Z 2019 Journal Article Karunasekera, H., Wang, H., & Zhang, H. (2019). Multiple object tracking with attention to appearance, structure, motion and size. IEEE Access, 7, 104423-104434. doi:10.1109/ACCESS.2019.2932301 2169-3536 2169-3536 https://hdl.handle.net/10356/146128 10.1109/ACCESS.2019.2932301 7 104423 104434 en MRP1A IEEE Access © 2019 The Author(s). This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see http://creativecommons.org/licenses/by/4.0/ application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering
Multiple Object Tracking (MOT)
Histograms
spellingShingle Engineering::Electrical and electronic engineering
Multiple Object Tracking (MOT)
Histograms
Karunasekera, Hasith
Wang, Han
Zhang, Handuo
Multiple object tracking with attention to appearance, structure, motion and size
description Objective of multiple object tracking (MOT) is to assign a unique track identity for all the objects of interest in a video, across the whole sequence. Tracking-by-detection is the most common approach used in addressing MOT problem. In this work, we propose a method to address MOT by defining a dissimilarity measure based on object motion, appearance, structure, and size. We calculate the appearance and structure-based dissimilarity measure by matching histograms following a grid architecture. Motion and size for each track are predicted using the information from track's history. These dissimilarity values are then used in the Hungarian algorithm, in the data association step for track identity assignment. In addition, we introduce a method to address any false detection in stable tracks. The proposed method runs in real time following an online approach. We evaluate our method in both MOT17 benchmark data-set for pedestrian tracking and KITTI benchmark data-set for vehicle tracking using the same system parameters to verify the robustness of the proposed method. The method can achieve state-of-the-art results in both benchmarks.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Karunasekera, Hasith
Wang, Han
Zhang, Handuo
format Article
author Karunasekera, Hasith
Wang, Han
Zhang, Handuo
author_sort Karunasekera, Hasith
title Multiple object tracking with attention to appearance, structure, motion and size
title_short Multiple object tracking with attention to appearance, structure, motion and size
title_full Multiple object tracking with attention to appearance, structure, motion and size
title_fullStr Multiple object tracking with attention to appearance, structure, motion and size
title_full_unstemmed Multiple object tracking with attention to appearance, structure, motion and size
title_sort multiple object tracking with attention to appearance, structure, motion and size
publishDate 2021
url https://hdl.handle.net/10356/146128
_version_ 1690658393554944000