A Crowdsourcing Engine for Mechanized Labor

Abstract

Crowdsourcing is an established approach for producing and analyzing data that can be represented as a human-assisted computation system. This paper presents a crowdsourcing engine that makes it possible to run a highly customizable hosted crowdsourcing platform controlling the entire annotation process including such elements as task allocation, worker ranking and result aggregation. The approach and the implementation have been described, and the conducted experiment shows promising preliminary results.

Keywords

• краудсорсинг
• механизированный труд
• человеко-машинные вычисления
• назначение заданий
• оценка труда участников
• агрегация ответов