Multiple object tracking with attention to appearance, structure, motion and size
Objective of multiple object tracking (MOT) is to assign a unique track identity for all the objects of interest in a video, across the whole sequence. Tracking-by-detection is the most common approach used in addressing MOT problem. In this work, we propose a method to address MOT by defining a dis...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2021
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/146128 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-146128 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1461282021-01-27T04:16:57Z Multiple object tracking with attention to appearance, structure, motion and size Karunasekera, Hasith Wang, Han Zhang, Handuo School of Electrical and Electronic Engineering Engineering::Electrical and electronic engineering Multiple Object Tracking (MOT) Histograms Objective of multiple object tracking (MOT) is to assign a unique track identity for all the objects of interest in a video, across the whole sequence. Tracking-by-detection is the most common approach used in addressing MOT problem. In this work, we propose a method to address MOT by defining a dissimilarity measure based on object motion, appearance, structure, and size. We calculate the appearance and structure-based dissimilarity measure by matching histograms following a grid architecture. Motion and size for each track are predicted using the information from track's history. These dissimilarity values are then used in the Hungarian algorithm, in the data association step for track identity assignment. In addition, we introduce a method to address any false detection in stable tracks. The proposed method runs in real time following an online approach. We evaluate our method in both MOT17 benchmark data-set for pedestrian tracking and KITTI benchmark data-set for vehicle tracking using the same system parameters to verify the robustness of the proposed method. The method can achieve state-of-the-art results in both benchmarks. National Research Foundation (NRF) Published version 2021-01-27T04:16:57Z 2021-01-27T04:16:57Z 2019 Journal Article Karunasekera, H., Wang, H., & Zhang, H. (2019). Multiple object tracking with attention to appearance, structure, motion and size. IEEE Access, 7, 104423-104434. doi:10.1109/ACCESS.2019.2932301 2169-3536 2169-3536 https://hdl.handle.net/10356/146128 10.1109/ACCESS.2019.2932301 7 104423 104434 en MRP1A IEEE Access © 2019 The Author(s). This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see http://creativecommons.org/licenses/by/4.0/ application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Electrical and electronic engineering Multiple Object Tracking (MOT) Histograms |
spellingShingle |
Engineering::Electrical and electronic engineering Multiple Object Tracking (MOT) Histograms Karunasekera, Hasith Wang, Han Zhang, Handuo Multiple object tracking with attention to appearance, structure, motion and size |
description |
Objective of multiple object tracking (MOT) is to assign a unique track identity for all the objects of interest in a video, across the whole sequence. Tracking-by-detection is the most common approach used in addressing MOT problem. In this work, we propose a method to address MOT by defining a dissimilarity measure based on object motion, appearance, structure, and size. We calculate the appearance and structure-based dissimilarity measure by matching histograms following a grid architecture. Motion and size for each track are predicted using the information from track's history. These dissimilarity values are then used in the Hungarian algorithm, in the data association step for track identity assignment. In addition, we introduce a method to address any false detection in stable tracks. The proposed method runs in real time following an online approach. We evaluate our method in both MOT17 benchmark data-set for pedestrian tracking and KITTI benchmark data-set for vehicle tracking using the same system parameters to verify the robustness of the proposed method. The method can achieve state-of-the-art results in both benchmarks. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Karunasekera, Hasith Wang, Han Zhang, Handuo |
format |
Article |
author |
Karunasekera, Hasith Wang, Han Zhang, Handuo |
author_sort |
Karunasekera, Hasith |
title |
Multiple object tracking with attention to appearance, structure, motion and size |
title_short |
Multiple object tracking with attention to appearance, structure, motion and size |
title_full |
Multiple object tracking with attention to appearance, structure, motion and size |
title_fullStr |
Multiple object tracking with attention to appearance, structure, motion and size |
title_full_unstemmed |
Multiple object tracking with attention to appearance, structure, motion and size |
title_sort |
multiple object tracking with attention to appearance, structure, motion and size |
publishDate |
2021 |
url |
https://hdl.handle.net/10356/146128 |
_version_ |
1690658393554944000 |