UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Qualitative Framing of Financial Incentives - A Case of Emotion Annotation

Madjiheurem, S; Sintsova, V; Pu, P; (2016) Qualitative Framing of Financial Incentives - A Case of Emotion Annotation. arXiv Green open access

[thumbnail of 1609.00439v1.pdf]
Preview
Text
1609.00439v1.pdf - Accepted Version

Download (115kB) | Preview

Abstract

Online labor platforms, such as the Amazon Mechanical Turk, provide an effective framework for eliciting responses to judgment tasks. Previous work has shown that workers respond best to financial incentives, especially to extra bonuses. However, most of the tested incentives involve describing the bonus conditions in formulas instead of plain English. We believe that different incentives given in English (or in qualitative framing) will result in differences in workers' performance, especially when task difficulties vary. In this paper, we report the preliminary results of a crowdsourcing experiment comparing workers' performance using only qualitative framings of financial incentives. Our results demonstrate a significant increase in workers' performance using a specific well-formulated qualitative framing inspired by the Peer Truth Serum. This positive effect is observed only when the difficulty of the task is high, while when the task is easy there is no difference of which incentives to use.

Type: Working / discussion paper
Title: Qualitative Framing of Financial Incentives - A Case of Emotion Annotation
Open access status: An open access version is available from UCL Discovery
Additional information: Work-in-Progress Paper in the 4th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2016)
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/10068151
Downloads since deposit
13Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item