Find tag "crowds"
22.5K views | +4 today
antropologo.net, dataviz, collective intelligence, algorithms, social learning, social change, digital humanities
Curated by luiy
Your new post is loading...
Your new post is loading...
Scooped by luiy

#Measuring the #Intelligence of #Crowds | #CI

#Measuring the #Intelligence of #Crowds | #CI | e-Xploration | Scoop.it
Microsoft Research in the UK reports useful results on crowdsourcing, based on aggregating questions from a standard IQ test on Amazon’s Mechanical Turk (AMT).
luiy's insight:

The Abstract for their 2012 study Crowd IQ: Measuring the Intelligence of Crowdsourcing Platforms describes the research and findings succinctly:


We measure crowdsourcing performance based on a standard IQ questionnaire, and examine Amazon’s Mechanical Turk (AMT) performance under different conditions. These include variations of the payment amount offered, the way incorrect responses affect workers’ reputations, threshold reputation scores of participating AMT workers, and the number of workers per task. We show that crowds composed of workers of high reputation achieve higher performance than low reputation crowds, and the effect of the amount of payment is non-monotone—both paying too much and too little affects performance. Furthermore, higher performance is achieved when the task is designed such that incorrect responses can decrease workers’ reputation scores. Using majority vote to aggregate multiple responses to the same task can significantly improve performance, which can be further boosted by dynamically allocating workers to tasks in order to break ties.

No comment yet.
Rescooped by luiy from Homo Agilis (Collective Intelligence, Agility and Sustainability : The Future is already here)

The #crowd a study of the popular #mind by gustave le bon circa 1896 !!

The Crowd a Study of The Popular Mind by Gustave Le Bon

Via Claude Emond
Claude Emond's curator insight, January 10, 2014 10:29 AM

How much have we changed ?? :)