Your cursor reveals: On analyzing workers’ browsing behavior and annotation quality In crowdsourcing tasks

• Main Authors: LO, Pei-chi, LIM, Ee-peng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Crowdsourcing; Machine Learning; Annotations; User Modeling; Empirical Study; Databases and Information Systems; Numerical Analysis and Scientific Computing
• Online Access: https://ink.library.smu.edu.sg/sis_research/7950; https://ink.library.smu.edu.sg/context/sis_research/article/8953/viewcontent/Your_Cursor_Reveals_pvoa_cc_by.pdf
• Institution: Singapore Management University

In this work, we investigate the connection between browsing behavior and task quality of crowdsourcing workers performing annotation tasks that require information judgements. Such information judgements are often required to derive ground truth answers to information retrieval queries. We explore...