publications: - title: "Investigating Factors Influencing Crowdsourcing Tasks with High Imaginative Load" author: - name: "Raynor Vliegendhart" link: "http://dmirlab.tudelft.nl/users/raynor-vliegendhart" - name: "Larson, Martha" link: "https://researchr.org/alias/larson%2C-martha" - name: "Kofler, Christoph" link: "https://researchr.org/alias/kofler%2C-christoph" - name: "Eickhoff, Carsten" link: "https://researchr.org/alias/eickhoff%2C-carsten" - name: "Pouwelse, Johan" link: "https://researchr.org/alias/pouwelse%2C-johan" year: "2011" month: "February" abstract: "We report useful observations made during the design and test of a crowdsourcing task with a high \"imaginative load\", a term we introduce to designate a task that requires workers to answer questions from a hypothetical point of view that is beyond their daily experiences. We find that workers are able to deliver high quality responses to such {HITs}, but that it is important that the HIT title allows workers to formulate accurate expectations of the task. Also important is the inclusion of free-text justification questions that target specific items in a pattern that is not obviously predictable. These findings were supported by a small-scale experiment run on several crowdsourcing platforms." links: "wsdm/csdm2011": "http://ir.ischool.utexas.edu/csdm2011/proceedings/csdm2011\\_vliegendhart.pdf" tags: - "testing" - "design" researchr: "https://researchr.org/publication/citeulike%3A8777208" cites: 0 citedby: 0 booktitle: "WSDM'11 Workshop on Crowdsourcing for Search and Data Mining" kind: "inproceedings" key: "citeulike:8777208"