Social tag relevance estimation via ranking-oriented neighbour voting

• Main Authors: CUI, Chaoran, SHEN, Jialie, MA, Jun, LIAN, Tao
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2015
• Subjects: Learning to rank; Neighbour voting; Tag relevance estimation; Tag-based image search; Computer Sciences; Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/3541; https://ink.library.smu.edu.sg/context/sis_research/article/4542/viewcontent/SocialTagRelevanceLeranviaRankNeighborVoting_2015_MM.pdf
• Institution: Singapore Management University

User-generated tags associated with social images are frequently imprecise and incomplete. Therefore, a fundamental challenge in tag-based applications is the problem of tag relevance estimation, which concerns how to interpret and quantify the relevance of a tag with respect to the contents of an image. In this paper, we address the key problem from a new perspective of learning to rank, and develop a novel approach to facilitate tag relevance estimation to directly optimize the ranking performance of tag-based image search. A supervision step is introduced into the neighbour voting scheme, in which tag relevance is estimated by accumulating votes from visual neighbours. Through explicitly modelling the neighbour weights and tag correlations, the risk of making heuristic assumptions is effectively avoided for conventional methods. Extensive experiments on a benchmark dataset in comparison with the state-of-the-art methods demonstrate the promise of our approach.