How many turkers are there?
With the recent interest in getting multiple turkers into a virtual room at the same time, it would be nice to know how many individual turkers are out there. We don’t have the answer, but we have run lots of experiments, and we can aggregate all of our historical data (much of which is posted on this blog) to get a sense for how many turkers might be out there, and how active they are.
These graphs are based on 4,449 HITs, with a total of 28,168 assignments. Most of these were posted over a 75-day period. Here is the number of assignments completed each day of that span:
Most of our assignments were done on single days, but there is some spread in the data.
We had work done by 1,496 individual turkers. Here is the number of assignments completed by each turker:
This is a classic Power Law distribution. We even see something close to the 80-20 rule: 80% of assignments are completed by the top 22% of turkers. The last 25% of turkers completed 1 assignment each.
So, it looks like there may be relatively few active turkers out there doing most of the work. I have some anicdotal evidence that it is hard to get, say 500 separate turkers to complete a single HIT over a short time-span. Of course, this will change as MTurk grows, and it’s not even clear that this data gives a good picture of everything that happens on MTurk. We have posted a variety of types of HITs, but nothing compared to the variety of HITs that are out there.
It might be nice if someone ran a study soliciting as many individual turkers as possible to complete a single HIT, just to see how many there are at a given time — something simple, like here’s 50-cents to click a button.
There may also be some questions we can answer with the data we have, but haven’t thought to ask yet. Please don’t be shy about posting comments and suggestions.
You can follow any responses to this entry through the RSS 2.0 feed. Both comments and pings are currently closed.