Sphinn Home » SEO
Sebastian is an expert on the technical side of SEO, though sometimes his more in depth posts tend to challenge the neural nodes of accomplished experts.
Shaun grabbed his ear, and in this entertaining and educational interview they go into some of the basics of what Robots.txt is, and how it should be used.
2 Comments     

Comments

from CharlesBM 36 days ago #
Votes: 0 | Vote:
+ -

I realize that your don't need to use a robot.txt but I found (using Google Webmaster Tools) they it sometimes has trouble reading your site if no file exists.  Once I started putting a file out there Google stopped returning errors.  Wierd but true.

from SettlementBoard 19 days ago #
Votes: 0 | Vote:
+ -

that depends on the type of hosting you have.  this is typical of shared hosting packages


Log in to comment or register here.
Search Marketing Expo

Save the date for:
SMX Local & Mobile - San Francisco, CA (July 24-25) See the agenda, and register now!
SMX Sao Paolo - Brazil - (Aug. 7-8)
SMX China - September 23 & 24, 2008
SMX Stockholm - September 23 & 24, 2008
SMX East - NYC - (Oct. 6-8) Registration is now open.
SMX London - November 4 & 5, 2008