News Source: http://sebastians-pamphlets.com
Published: Nov 26, 2007 - 03:53 pm
Story Found By: Sebastian 1538 Days ago
Category: SEO
Here is my step by step "How to create a smart robots.txt" guide. Adapt. Test. Enjoy.
8 Comments
Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.
News Source: http://sebastians-pamphlets.com
Published: Nov 26, 2007 - 03:53 pm
Story Found By: Sebastian 1538 Days ago
Category: SEO
Here is my step by step "How to create a smart robots.txt" guide. Adapt. Test. Enjoy.
8 Comments
Upcoming Conferences
Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.
Join us at an upcoming SMX event:
- SMX West - Feb. 28 - Mar. 1, 2012
- SMX Munich - Mar. 27-28, 2012
- SMX Toronto - Apr. 25-26, 2012
- SMX Sydney - May 1-2, 2012
- SMX London - May 15-16, 2012
- SMX Advanced Seattle - June 5-6, 2012
- SMX Paris - June 7-8 2012
- SMX Melbourne - Aug. 2012
- SMX East - Oct. 2-4, 2012
- SMX Stockholm - Sept. 15-16, 2012
- SMX Social Media Marketing - Dec. 2012
Latest News From Marketing Land
- Marketing Day: February 10, 2012
- Report: iPhone, iPad Now Drive More Web Traffic Than Mac OS
- Drawing Out Your Affiliate Program Marketing Plan
- Is Yahoo About To Make Another Big Mistake — With Its Display Ad Business?
- Google Analytics For The Enterprise: Perception & Reality
- - See more news at Marketing Land -
Upcoming Webcasts
Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:
- The Inside Scoop on Automating and Optimizing Your PPC Campaigns - February 21, 2012
Latest News From Search Engine Land
- Google’s Recent Domain Registrations: Labs, Screenwise & AdWords
- Google AdWords Gets Shared Lists To Eliminate Duplicate Data Entry
- SearchCap: The Day In Search, February 10, 2012
- Now, Mitt Romney Has A Santorum-Like Bing & Google Problem
- Search In Pics: Google Sugar Cube, Yahoo Valentines & Chrome M&M’s
- - See more news at Search Engine Land -
Comments
That looks very interesting. Thanks for the share.
Hot topic in two hours methinks. This needs to be used with care. There are several ways to catch yourself out if bots catch different versions of the file from the same site at different times. Use with care, and test, test, test and test again.
Well, too frequent changes of robots.txt can irritate search engines regardless whether the robots.txt is cloaked or not. I second your "<b>Use with care, and test, test, test and test again.</b>".
Great tutorial. You’d be a great, and popular, teacher. Rough around the edges...but extremely knowledgeable. Like the Howard Stern of Search.
Ron, thank you, but Howard Stern is in another league.
You don’t even know how cool this is. I’m in the midst of writing (yes, this is off topic) an SEO friendly CMS and was wondering how to dynamically rewrite URLs using info from the database. I had know idea this could be done. Well, I had some idea because I’m a vbseo user, but didn’t realize it was this ’easy.’...or obvious i mean.
Interesting article there. It has given me plenty to think about and consider. Cheers.
Rough around the edges isn’t what makes him unique. How many other SEO guys have a thorough database/development background and include such strategies and tutorials in their postings? Not many. He has carved his identity as such.