Topological spatial verification for instance search
This paper proposes an elastic spatial verification method for Instance Search, particularly for dealing with non-planar and non-rigid queries exhibiting complex spatial transformations. Different from existing models that map keypoints between images based on a linear transformation (e.g., affine,...
Saved in:
Main Authors: | , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2015
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/6360 https://ink.library.smu.edu.sg/context/sis_research/article/7363/viewcontent/bare_jrnl.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-7363 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-73632021-11-23T03:44:56Z Topological spatial verification for instance search ZHANG, Wei NGO, Chong-wah This paper proposes an elastic spatial verification method for Instance Search, particularly for dealing with non-planar and non-rigid queries exhibiting complex spatial transformations. Different from existing models that map keypoints between images based on a linear transformation (e.g., affine, homography), our model exploits the topological arrangement of keypoints to address the non-linear spatial transformations that are extremely common in real life situations. In particular, we propose a novel technique to elastically verify the topological spatial consistency with the triangulated graph through a "sketch-and-match" scheme. The spatial topology configuration, emphasizing relative positioning rather than absolute coordinates, is first sketched by a triangulated graph, whose edges essentially capture the topological layout of the corresponding keypoints. Next, the spatial consistency is efficiently estimated as the number of common edges between the triangulated graphs. Compared to the existing methods, our technique is much more effective in modeling the complex spatial transformations of non-planar and non-rigid instances, while being compatible to instances with simple linear transformations. Moreover, our method is by nature more robust in spatial verification by considering the locations, rather than the local geometry of keypoints, which are sensitive to motions and viewpoint changes. We evaluate our method extensively on three years of TRECVID datasets, as well as our own dataset MQA, showing large improvement over other methods for the task of Instance Search. 2015-08-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/6360 info:doi/10.1109/TMM.2015.2440997 https://ink.library.smu.edu.sg/context/sis_research/article/7363/viewcontent/bare_jrnl.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Instance search non-planar and non-rigid objects spatial verification triangulated graph Computer Sciences Graphics and Human Computer Interfaces |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Instance search non-planar and non-rigid objects spatial verification triangulated graph Computer Sciences Graphics and Human Computer Interfaces |
spellingShingle |
Instance search non-planar and non-rigid objects spatial verification triangulated graph Computer Sciences Graphics and Human Computer Interfaces ZHANG, Wei NGO, Chong-wah Topological spatial verification for instance search |
description |
This paper proposes an elastic spatial verification method for Instance Search, particularly for dealing with non-planar and non-rigid queries exhibiting complex spatial transformations. Different from existing models that map keypoints between images based on a linear transformation (e.g., affine, homography), our model exploits the topological arrangement of keypoints to address the non-linear spatial transformations that are extremely common in real life situations. In particular, we propose a novel technique to elastically verify the topological spatial consistency with the triangulated graph through a "sketch-and-match" scheme. The spatial topology configuration, emphasizing relative positioning rather than absolute coordinates, is first sketched by a triangulated graph, whose edges essentially capture the topological layout of the corresponding keypoints. Next, the spatial consistency is efficiently estimated as the number of common edges between the triangulated graphs. Compared to the existing methods, our technique is much more effective in modeling the complex spatial transformations of non-planar and non-rigid instances, while being compatible to instances with simple linear transformations. Moreover, our method is by nature more robust in spatial verification by considering the locations, rather than the local geometry of keypoints, which are sensitive to motions and viewpoint changes. We evaluate our method extensively on three years of TRECVID datasets, as well as our own dataset MQA, showing large improvement over other methods for the task of Instance Search. |
format |
text |
author |
ZHANG, Wei NGO, Chong-wah |
author_facet |
ZHANG, Wei NGO, Chong-wah |
author_sort |
ZHANG, Wei |
title |
Topological spatial verification for instance search |
title_short |
Topological spatial verification for instance search |
title_full |
Topological spatial verification for instance search |
title_fullStr |
Topological spatial verification for instance search |
title_full_unstemmed |
Topological spatial verification for instance search |
title_sort |
topological spatial verification for instance search |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2015 |
url |
https://ink.library.smu.edu.sg/sis_research/6360 https://ink.library.smu.edu.sg/context/sis_research/article/7363/viewcontent/bare_jrnl.pdf |
_version_ |
1770575941497520128 |