Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.
Join us at an upcoming SMX event:
Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:
Comments
I am sure Google use human evaluators. We all know the "rate" function they all have internally so just counting the actual Google staff would be over the 10k mark (right?). So the question is not so much if Google have such evaluators but to what extent its just part of what a lot of Googlers do - search Google, and how many are specifically hired as evaluators. Also, even if there was 10k external evaluators how much time do each put into it. The equation is not that simple :)
If its just stuff like this: http://www.searchbistro.com/secretlab.html then I dont think theres any cause for concern. but if its stuff like http://www.google.com/search?num=100&hl=en&safe=off&rls=GGLB,GGLB:1969-53,GGLB:en&q=mesothelioma+more:condition_treatment&cx=disease_for_patients&sa=N&oi=cooptsr&resnum=0&ct=col1&cd=1 (note "Labeled by" under search results), then there appears to be more of a human impact on rankings. Note: (beta testing and kicking tires...posting links...and long links...will ya take these? )
Yes, long links mess up the comments. Its a classic :)
Paired up with TrustRank methodology, I dont think theyd need 10k of evaluators...
Then again, if you subdivide down by different countries/languages, it might not be quite so many per any one version of Google web search.