from the Perils of Wonkery
Like Bitly, Twitter has a great real-time data set and very smart data scientists and engineers. But instead of relying on a primarily computational solution, Twitter treats real-time search more like a CAPTCHA problem. With this kind of messy data, lots of human brains can find meaning much faster and more accurately than lots of lines of code. So Twitter uses a real-time computation system called Storm to identify search spikes, then Mechanical Turk (Amazon’s crowdsourcing online platform for small jobs) to farm out annotating that data to human beings all over the world.
The judges are like little focus groups that match intent with revenue.
The ongoing relevance and necessity of human intelligence in making sense of the world!
“Twitter just told us how cool its real-time search is… and how it makes its money” - The Verge
Realist Synthesis: An Introduction
Pawson, Ray; Walshe, Kieran; Greenhalgh, Trisha