Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.

They promised us a reverse DNS their IPs to search.live.com but they are not. So now we may be blocking their spiders from crawling us.
Comments5 Comments  

Comments

Avatar
from tappingcreativity 1529 Days ago #
Votes: 0

Good information to have on hand. Good post.

Avatar
from LilRascal 1529 Days ago #
Votes: 0

Yeah. So now I get to update the good ol’ cloaking software.From now on, live.com referer=big effin goatse.

Avatar
from TannerC 1529 Days ago #
Votes: 0

Hmm, interesting. While I don’t agree with LilRascal’s comment about "goatse", it pretty much sucks.

Avatar
from dan404 1529 Days ago #
Votes: -4

Good god, give me a break. Yes my sites have been hit by this also but in no way does it compare with ask’s minefield!Live.com and Msn bots have been the least of my problems. Multiple grabs of my pages by Ask’s Minefield has cost me way more in band width and log confusion than queries from live.com for Viagra and infinitum.Give MS a break for once, thay are trying to do the right thing, as apposed to ask which from my perspective whats everyone to visit your site but through their cache!At least MS forces you to go to the content page Ask? Minefield, they have their own rules.  never obeys robots.txt and is doing far more harm than MSM/LIVE/MICROSOFT every could. You’ll see them eventually. Figure it out!Look for this:"GET / HTTP/1.1" 200 19533 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9a1) Gecko/20070308 Minefield/3.0a1"If you see that then a customer or browser saw your site while not going to you site but staying on ask.com without their knowledge.

Avatar Moderator
from Sebastian 1529 Days ago #
Votes: 1

Dan404, did you read the post? Probably not. It’s about crawler verification, not MSN’s spam bot.

Upcoming Conferences

Search Marketing ExpoSearch Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.



Join us at an upcoming SMX event:

Upcoming Webcasts

Search Marketing Now Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include: