Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.

"Even bots that respect the REP can harm your search engine rankings, or reveal sensitive information to your competitors." Great stuff.
Comments2 Comments  

Comments

Avatar
from Hobo 1701 Days ago #
Votes: 0

Cool Smart Robots.txt info :)



Avatar
from manojmapxl 1694 Days ago #
Votes: 0

Ho Hobo,

There are some pages already crawled by Google but now its showing 404 error. Is there any option to protect the urls.



Upcoming Conferences

Search Marketing ExpoSearch Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.



Join us at an upcoming SMX event: