- 34
- Sphinn It!
Posted By: Sebastian 295 days ago
Topic Type: News Story (Jump to http://sebastians-pamphlets.com)
Category: Google SEO
***
If you ever need a hot tip on how to waste an hour or two with quite funny but completely useless SEO research, read my divulgement of a new and somewhat mysterious robots.txt statement invented by Google:
Noindex: /
3 Comments


Comments
Bring anti sea-sickness pills, gets dizzy when you read it.
Fun stuff.
Is it just a part of the Robustness Principle in operation at Google?
Maybe they are supporting syntax that they see a lot of people using in error?
Google has confirmed that their crawler understands the Noindex: directive in robots.txt, but it's an experiment so be careful when you play with it:
http://sebastians-pamphlets.com/about-noindex-crawler-directives-in-robots-txt/#comment-710