Interactive search vs. automatic search: An extensive study on video retrieval
This article conducts user evaluation to study the performance difference between interactive and automatic search. Particularly, the study aims to provide empirical insights of how the performance landscape of video search changes, with tens of thousands of concept detectors freely available to exp...
Saved in:
Main Authors: | , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2021
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/6303 https://ink.library.smu.edu.sg/context/sis_research/article/7306/viewcontent/NGUYEN_Tran_2021.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-7306 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-73062022-04-14T03:05:01Z Interactive search vs. automatic search: An extensive study on video retrieval NGUYEN, Phuong-Anh NGO, Chong-wah This article conducts user evaluation to study the performance difference between interactive and automatic search. Particularly, the study aims to provide empirical insights of how the performance landscape of video search changes, with tens of thousands of concept detectors freely available to exploit for query formulation. We compare three types of search modes: free-to-play (i.e., search from scratch), non-free-to-play (i.e., search by inspecting results provided by automatic search), and automatic search including concept-free and concept-based retrieval paradigms. The study involves a total of 40 participants; each performs interactive search over 15 queries of various difficulty levels using two search modes on the IACC.3 dataset provided by TRECVid organizers. The study suggests that the performance of automatic search is still far behind interactive search. Furthermore, providing users with the result of automatic search for exploration does not show obvious advantage over asking users to search from scratch. The study also analyzes user behavior to reveal insights of how users compose queries, browse results, and discover new query terms for search, which can serve as guideline for future research of both interactive and automatic search. 2021-05-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/6303 info:doi/10.1145/3429457 https://ink.library.smu.edu.sg/context/sis_research/article/7306/viewcontent/NGUYEN_Tran_2021.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Video retrieval ad hoc video search user study interactive search automatic search Data Storage Systems Graphics and Human Computer Interfaces |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Video retrieval ad hoc video search user study interactive search automatic search Data Storage Systems Graphics and Human Computer Interfaces |
spellingShingle |
Video retrieval ad hoc video search user study interactive search automatic search Data Storage Systems Graphics and Human Computer Interfaces NGUYEN, Phuong-Anh NGO, Chong-wah Interactive search vs. automatic search: An extensive study on video retrieval |
description |
This article conducts user evaluation to study the performance difference between interactive and automatic search. Particularly, the study aims to provide empirical insights of how the performance landscape of video search changes, with tens of thousands of concept detectors freely available to exploit for query formulation. We compare three types of search modes: free-to-play (i.e., search from scratch), non-free-to-play (i.e., search by inspecting results provided by automatic search), and automatic search including concept-free and concept-based retrieval paradigms. The study involves a total of 40 participants; each performs interactive search over 15 queries of various difficulty levels using two search modes on the IACC.3 dataset provided by TRECVid organizers. The study suggests that the performance of automatic search is still far behind interactive search. Furthermore, providing users with the result of automatic search for exploration does not show obvious advantage over asking users to search from scratch. The study also analyzes user behavior to reveal insights of how users compose queries, browse results, and discover new query terms for search, which can serve as guideline for future research of both interactive and automatic search. |
format |
text |
author |
NGUYEN, Phuong-Anh NGO, Chong-wah |
author_facet |
NGUYEN, Phuong-Anh NGO, Chong-wah |
author_sort |
NGUYEN, Phuong-Anh |
title |
Interactive search vs. automatic search: An extensive study on video retrieval |
title_short |
Interactive search vs. automatic search: An extensive study on video retrieval |
title_full |
Interactive search vs. automatic search: An extensive study on video retrieval |
title_fullStr |
Interactive search vs. automatic search: An extensive study on video retrieval |
title_full_unstemmed |
Interactive search vs. automatic search: An extensive study on video retrieval |
title_sort |
interactive search vs. automatic search: an extensive study on video retrieval |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2021 |
url |
https://ink.library.smu.edu.sg/sis_research/6303 https://ink.library.smu.edu.sg/context/sis_research/article/7306/viewcontent/NGUYEN_Tran_2021.pdf |
_version_ |
1770575930740178944 |