Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.

Ann Smarty writes:
"While I do not encourage anyone to rely too much on Robots.txt tools (you should either make your best to understand the syntax yourself or turn to an experienced consultant to avoid any issues), the Robots.txt generators and checkers I am listing below will hopefully be of additional help..."
Comments3 Comments  

Comments

Avatar
from yetanotherben 1956 Days ago #
Votes: 0

Compilations like this are always worth bookmarking - I don’t care what people say - thanks!As a follow-up I’ll submit the Jane and Robot, which helps with the syntax...Cheers.

Avatar
from yetanotherben 1956 Days ago #
Votes: 0

It’s been posted here, a piece by Vanessa Fox that’s probably worth a read: http://sphinn.com/story/91505

Avatar
from thebestdigital 1956 Days ago #
Votes: 0

I think that a good ideaThanks for sharing

Upcoming Conferences

Search Marketing ExpoSearch Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.



Join us at an upcoming SMX event: