Calendar
Network
Feeds
- 49
- Sphinn It!
Went Hot: November 26, 2007 - 3:53 pm
Posted By: Sebastian 587 days ago
Topic Type: News Story (Jump to http://sebastians-pamphlets.com)
Category: SEO
Here is my step by step "How to create a smart robots.txt" guide. Adapt. Test. Enjoy.
8 Comments
Comments
That looks very interesting. Thanks for the share.
Hot topic in two hours methinks.
This needs to be used with care. There are several ways to catch yourself out if bots catch different versions of the file from the same site at different times.
Use with care, and test, test, test and test again.
Well, too frequent changes of robots.txt can irritate search engines regardless whether the robots.txt is cloaked or not. I second your "Use with care, and test, test, test and test again.".
Great tutorial. You'd be a great, and popular, teacher. Rough around the edges...but extremely knowledgeable. Like the Howard Stern of Search.
Ron, thank you, but Howard Stern is in another league.
You don't even know how cool this is. I'm in the midst of writing (yes, this is off topic) an SEO friendly CMS and was wondering how to dynamically rewrite URLs using info from the database.
I had know idea this could be done. Well, I had some idea because I'm a vbseo user, but didn't realize it was this 'easy.'...or obvious i mean.
Interesting article there. It has given me plenty to think about and consider. Cheers.
Rough around the edges isn't what makes him unique. How many other SEO guys have a thorough database/development background and include such strategies and tutorials in their postings? Not many. He has carved his identity as such.