Microtask Crowdsourcing to solve Semantic Web Problems00:00
Tutorial Overview00:03
Crowdsourcing: Problem solving via open calls01:55
Crowdsourcing comes in different forms and flavors03:21
In this tutorial: Crowdsourcing as human computation05:17
In this Tutorial: Microtask Crowdsourcing05:47
Agenda for today07:20
Presenters - 109:31
Presenters - 209:46
Presenters - 310:03
Web site10:22
Microtask crowdsourcing fundamentals10:54
Microtask crowdsourcing11:09
Dimensions of microtask crowdsourcing - 112:25
Dimensions of microtask crowdsourcing - 212:28
Dimensions of microtask crowdsourcing - 316:41
Example19:08
A large, but not always diverse crowd24:13
Significant amount of resources and timely delivery - 125:44
Significant amount of resources and timely delivery - 226:54
Broad range of tasks28:24
It's not always just about money29:50
Explicit vs. implicit contribution34:19
Complex workflows cannot always be directly implemented37:33
Dimensions of microtask crowdsourcing - 438:53
Open solution spaces45:06
Measuring performance can be challenging48:54
Aligning incentives is essential52:51
Pricing on Mturk54:26
Hybrid systems55:48
Example: Hybrid data integration56:53
Example: Hybrid query processing57:57
In this tutorial: Paid microtask crowdsourcing59:04
Components of a microtask platform59:19
Amazon mechanical Turk01:01:47
Crowdflower01:04:07
Samasource.org01:04:48
Mobileworks01:05:57
Many other platforms01:07:25
Summary - 101:10:32
Summary - 201:10:37
