Yahoo!, Google, Microsoft Clarify robots.txt Support

Hot News Archive

Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.

News Source: http://searchengineland.com
Published: Jun 06, 2008 - 09:24 am
Story Found By: theGypsy 1347 Days ago
Category: SEO

Vanessa Fox via Search Engine Land - Today, Google, Yahoo!, and Microsoft have come together to post details of how each of them support robots.txt and the robots meta tag. While their posts use terms like "collaboration" and "working together", they haven’t joined together to implement a new standard (as they did with sitemaps.org). Rather, they are simply making a joint stand in messaging that robots.txt is the standard way of blocking search engine robot access to web sites.
Comments

Discuss

Comments

Upcoming Conferences

Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.

SMX Web Site » | SMX Difference » | SMX News »

Join us at an upcoming SMX event:

SMX West - Feb. 28 - Mar. 1, 2012
SMX Munich - Mar. 27-28, 2012
SMX Toronto - Apr. 25-26, 2012
SMX Sydney - May 1-2, 2012
SMX London - May 15-16, 2012
SMX Advanced Seattle - June 5-6, 2012
SMX Paris - June 7-8 2012
SMX Melbourne - Aug. 2012
SMX East - Oct. 2-4, 2012
SMX Stockholm - Sept. 15-16, 2012
SMX Social Media Marketing - Dec. 2012