Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.

Sphinn Home » Vertical Search
Google Offers Robots.txt Generator
Vertical Search News Source: http://searchengineland.com
Published: Mar 29, 2008 - 02:55 pm
Story Found By: kevgibbo 1880 Days ago
Category: Vertical Search
"Google’s rolled out a new tool at Google Webmaster Central, a robots.txt generator. It’s designed to allow site owners to easily create a robots.txt file, one of the two main ways (along with the meta robots tag) to prevent search engines from indexing content."
 Comments6 Comments  

Comments

Avatar
from garyprice 1879 Days ago #
Votes: 0

On a somewhat related note from November, 2007 some robots.txt research from Penn St. Researching Robots.txt Files: Study shows Google favored over other search engines by webmasters; Say Hello to BotSeerhttp://tinyurl.com/2ua27cDirect to BotSeer tool (cool!)http://botseer.ist.psu.eduSince the original post, BotSeer now also offers info about various web crawlers.

Avatar
from avi 1878 Days ago #
Votes: -1

Google, have you run out of earth shattering products to release? If one is running a site that gets to the point where they need to block bots, they should have the basic skills to upload a simple notepad file, IMHO. Does anybody feel that this new tool has value to them?

Avatar
from crystalq 1877 Days ago #
Votes: 0

Yep, It stops product thieves and keeps hidden content hidden.

Avatar
from bwelford 1877 Days ago #
Votes: 0

Good one.  It’s all pretty basic stuff but I’m sure many will learn something from perusing this.

Avatar
from zach007 1877 Days ago #
Votes: 0

I agreed it is a good one. Regards,Rasya PazkaA team of successful entrepreneurs credited for  www.SelectWealthSystem.com A new home-based-business marketing system that provides the strategic high ground for internet marketing.Pro Team Marketing uses an automated marketing system that is currently promoting a cutting-edge young company, entering the early growth stage, that targets the largest consumer base in the United States with their financial educational products.  http://www.SelectWealthSystem.com

Avatar
from webdorf 1876 Days ago #
Votes: 0

kevgibbo,thanks for this article. Didn’t know about it before. Should be useful service, i think.

Upcoming Conferences

Search Marketing ExpoSearch Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.


SMX Web Site » | SMX Difference » | SMX News »

Join us at an upcoming SMX event:

Latest News From Marketing Land
Upcoming Webcasts

Digital Marketing Depot Learn more about search marketing with our free online webcasts and webinars from our sister site, Digital Marketing Depot. Upcoming online events include:


Webcasts:
Research:
Whitepapers:

See More Topics

Latest News From Search Engine Land