Evaluation of CQAs

Search engines have long been recognized as the gateways for online information seeking, but the gradual sophistication of the online information seekers has led to the emergence of Community-based Question-Answering (CQA) sites as an alternative source of information on the Web. There are many CQAs...

Full description

Saved in:
Bibliographic Details
Main Author: Banerjee Snehasish
Other Authors: Alton Chua Yeow Kuan
Format: Theses and Dissertations
Language:English
Published: 2012
Subjects:
Online Access:http://hdl.handle.net/10356/49019
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-49019
record_format dspace
spelling sg-ntu-dr.10356-490192019-12-10T11:28:07Z Evaluation of CQAs Banerjee Snehasish Alton Chua Yeow Kuan Wee Kim Wee School of Communication and Information DRNTU::Engineering::Computer science and engineering::Information systems Search engines have long been recognized as the gateways for online information seeking, but the gradual sophistication of the online information seekers has led to the emergence of Community-based Question-Answering (CQA) sites as an alternative source of information on the Web. There are many CQAs around but their overall effectiveness has not been widely studied. So, the dissertation addresses this problem and attempts to evaluate the overall effectiveness of CQAs based on a three-pronged evaluation framework; consisting of (1) answer quality, (2) answer responsiveness, and (3) corpus comprehensiveness. A total of 500 questions were posted in each of the six CQA sites (Yahoo! Answers, WikiAnswers, Answerbag, Baidu Knows, Tencent Soso Wenwen, Sina iAsk) and the resulting 3000 transactions were examined to conduct a three-way comparison: (1) within languages – English and Chinese; (2) between languages- English versus Chinese; and (3) across all the six individual CQA sites. Results indicate that among the three English CQAs, Yahoo! Answers and WikiAnswers provide the highest answer quality; Yahoo! Answers provides the highest answer responsiveness; and WikiAnswers, the highest corpus comprehensiveness. On the other hand, among the three Chinese CQAs, Tencent Soso Wenwen and Sina iAsk provide the highest answer quality; Tencent Soso Wenwen provides the highest answer responsiveness; and Baidu Knows, the highest corpus comprehensiveness. The cross-cultural and inter-language comparison between the English CQAs and the Chinese CQAs reveal that there is hardly any difference between the two in terms of answer quality. However, the English sites outdo the Chinese sites in terms of answer responsiveness; and vice-versa in terms of corpus comprehensiveness. The comparison across all the six individual CQAs reveals that WikiAnswers and Sina iAsk provide the highest answer quality; Yahoo! Answers provides the highest answer responsiveness; while Baidu Knows provides the highest corpus comprehensiveness. The results serve as a prescriptive guideline to the online information seekers, highlighting which CQA to turn to, based on their requirements. Also, it gives useful insights on the desiderata of an ideal CQA. Master of Science (Information Studies) 2012-05-14T02:55:11Z 2012-05-14T02:55:11Z 2012 2012 Thesis http://hdl.handle.net/10356/49019 en Nanyang Technological University 61 p. application/pdf
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic DRNTU::Engineering::Computer science and engineering::Information systems
spellingShingle DRNTU::Engineering::Computer science and engineering::Information systems
Banerjee Snehasish
Evaluation of CQAs
description Search engines have long been recognized as the gateways for online information seeking, but the gradual sophistication of the online information seekers has led to the emergence of Community-based Question-Answering (CQA) sites as an alternative source of information on the Web. There are many CQAs around but their overall effectiveness has not been widely studied. So, the dissertation addresses this problem and attempts to evaluate the overall effectiveness of CQAs based on a three-pronged evaluation framework; consisting of (1) answer quality, (2) answer responsiveness, and (3) corpus comprehensiveness. A total of 500 questions were posted in each of the six CQA sites (Yahoo! Answers, WikiAnswers, Answerbag, Baidu Knows, Tencent Soso Wenwen, Sina iAsk) and the resulting 3000 transactions were examined to conduct a three-way comparison: (1) within languages – English and Chinese; (2) between languages- English versus Chinese; and (3) across all the six individual CQA sites. Results indicate that among the three English CQAs, Yahoo! Answers and WikiAnswers provide the highest answer quality; Yahoo! Answers provides the highest answer responsiveness; and WikiAnswers, the highest corpus comprehensiveness. On the other hand, among the three Chinese CQAs, Tencent Soso Wenwen and Sina iAsk provide the highest answer quality; Tencent Soso Wenwen provides the highest answer responsiveness; and Baidu Knows, the highest corpus comprehensiveness. The cross-cultural and inter-language comparison between the English CQAs and the Chinese CQAs reveal that there is hardly any difference between the two in terms of answer quality. However, the English sites outdo the Chinese sites in terms of answer responsiveness; and vice-versa in terms of corpus comprehensiveness. The comparison across all the six individual CQAs reveals that WikiAnswers and Sina iAsk provide the highest answer quality; Yahoo! Answers provides the highest answer responsiveness; while Baidu Knows provides the highest corpus comprehensiveness. The results serve as a prescriptive guideline to the online information seekers, highlighting which CQA to turn to, based on their requirements. Also, it gives useful insights on the desiderata of an ideal CQA.
author2 Alton Chua Yeow Kuan
author_facet Alton Chua Yeow Kuan
Banerjee Snehasish
format Theses and Dissertations
author Banerjee Snehasish
author_sort Banerjee Snehasish
title Evaluation of CQAs
title_short Evaluation of CQAs
title_full Evaluation of CQAs
title_fullStr Evaluation of CQAs
title_full_unstemmed Evaluation of CQAs
title_sort evaluation of cqas
publishDate 2012
url http://hdl.handle.net/10356/49019
_version_ 1681047921126014976