News Source: http://www.searchenginejournal.com
Published: Dec 08, 2008 - 08:42 pm
Story Found By: bbcarter 1623 Days ago
Category: SEO
"While I do not encourage anyone to rely too much on Robots.txt tools (you should either make your best to understand the syntax yourself or turn to an experienced consultant to avoid any issues), the Robots.txt generators and checkers I am listing below will hopefully be of additional help..."
3 Comments
Comments
Compilations like this are always worth bookmarking - I don’t care what people say - thanks!As a follow-up I’ll submit the Jane and Robot, which helps with the syntax...Cheers.
It’s been posted here, a piece by Vanessa Fox that’s probably worth a read: http://sphinn.com/story/91505
I think that a good ideaThanks for sharing