Building a sentiment corpus using a gamified framework
Gamification, the use of game mechanics and game elements in non-game contexts, is an emerging approach for crowdsourcing the collection of data. This study uses a gamified application in the form of an online debate game as a cost-efficient way to build an agreement-objection corpus from which a se...
Saved in:
Main Author: | |
---|---|
Format: | text |
Language: | English |
Published: |
Animo Repository
2014
|
Online Access: | https://animorepository.dlsu.edu.ph/etd_masteral/4613 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | De La Salle University |
Language: | English |
Summary: | Gamification, the use of game mechanics and game elements in non-game contexts, is an emerging approach for crowdsourcing the collection of data. This study uses a gamified application in the form of an online debate game as a cost-efficient way to build an agreement-objection corpus from which a sentiment corpus can potentially be derived. This approach has advantages over traditional ways which are difficult, time-consuming, and expensive, since there is currently no automated way to determine sentiment polarity. It allows for a time-efficient and cost-efficient way of building a sentiment corpus that can be applied to several natural language processing tasks and research.
Polarity, the gamified application used for this study, was able to collect 626 statements after being deployed for 43 days. The cleaning process was able to filter out 72.88% of the noise data. After the cleaning process, a total of 596 statements remained in the agreement-objection corpus. Assuming that this corpus can be mapped into a sentiment corpus by assuming all agree statements are positive and everything else are negative, it results into a sentiment corpus of 82.86% accuracy. |
---|