News Source: http://janeandrobot.com
Published: Jun 10, 2008 - 04:08 pm
Story Found By: Rhea 1341 Days ago
Category: SEO
5 Comments
Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.
News Source: http://janeandrobot.com
Published: Jun 10, 2008 - 04:08 pm
Story Found By: Rhea 1341 Days ago
Category: SEO
5 Comments
Upcoming Conferences
Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.
Join us at an upcoming SMX event:
- SMX West - Feb. 28 - Mar. 1, 2012
- SMX Munich - Mar. 27-28, 2012
- SMX Toronto - Apr. 25-26, 2012
- SMX Sydney - May 1-2, 2012
- SMX London - May 15-16, 2012
- SMX Advanced Seattle - June 5-6, 2012
- SMX Paris - June 7-8 2012
- SMX Melbourne - Aug. 2012
- SMX East - Oct. 2-4, 2012
- SMX Stockholm - Sept. 15-16, 2012
- SMX Social Media Marketing - Dec. 2012
Latest News From Marketing Land
- Marketing Day: February 10, 2012
- Report: iPhone, iPad Now Drive More Web Traffic Than Mac OS
- Drawing Out Your Affiliate Program Marketing Plan
- Is Yahoo About To Make Another Big Mistake — With Its Display Ad Business?
- Google Analytics For The Enterprise: Perception & Reality
- - See more news at Marketing Land -
Upcoming Webcasts
Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:
- The Inside Scoop on Automating and Optimizing Your PPC Campaigns - February 21, 2012
Latest News From Search Engine Land
- Google’s Recent Domain Registrations: Labs, Screenwise & AdWords
- Google AdWords Gets Shared Lists To Eliminate Duplicate Data Entry
- SearchCap: The Day In Search, February 10, 2012
- Now, Mitt Romney Has A Santorum-Like Bing & Google Problem
- Search In Pics: Google Sugar Cube, Yahoo Valentines & Chrome M&M’s
- - See more news at Search Engine Land -
Comments
YOU RAWK Vanessa! Thanks... instant classic + EPIC WIN!
Hooray for Vanessa! I’m sending this straight to my development team.
This is great! I just sent the link over to several people I know who were working with this.Thanks!
One of the best robots posts I have seen. Will definately link to it when the topic comes up. Incidentally I did a post yesterday which could have used it, but rather links to robotstxt.org.
Use Case - Robots.txt - META/ X-Robots-Tag - Other - Supported ByAllow access to your content - Allow - FOLLOW - INDEX - Google/Yahoo/MicrosoftDisallow access to your content - Disallow - NOINDEX - NOFOLLOW - Google/Yahoo/MicrosoftThere is a lot of over-simplification here. It might be wise to explain that links on a page can be followed even if the page is not indexed. Be aware that noindex (meta tag) does not mean "do not crawl the page", it means "do not show in SERPs". Google quite happily takes a copy of the page (they have to, in order to see the meta tag) and will follow links out from it unless you expressly disallow that.