Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.

An interesting look at what different people use for Robots.txt, assuming a smart SEO isn’t serving a different version to bots.
Comments2 Comments  


Avatar Moderator
from Sebastian 3789 Days ago #
Votes: 0

> What Do SEO/SEM People Put In Robots.txt Files?Way too often crap, or better lack of disallow’ed crap like monthly archives. ;)

from Hobo 3789 Days ago #
Votes: 0

Jeez Sebastian you’re even spamming this site as well - don’t you let up? ha ha! :)Shaun

Upcoming Conferences

Search Marketing ExpoSearch Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.

Join us at an upcoming SMX event: