Sphinn Home » Microsoft SEO
They promised us a reverse DNS their IPs to search.live.com but they are not. So now we may be blocking their spiders from crawling us.
5 Comments     

Comments

from tappingcreativity 211 days ago #
Votes: 0 | Vote:
+ -

Good information to have on hand. Good post.

from LilRascal 211 days ago #
Votes: 0 | Vote:
+ -

Yeah. So now I get to update the good ol' cloaking software.
From now on, live.com referer=big effin goatse.

from TannerC 211 days ago #
Votes: 0 | Vote:
+ -

Hmm, interesting. While I don't agree with LilRascal's comment about "goatse", it pretty much sucks.

from dan404 211 days ago # - show/hide this comment
Votes: -4 | Vote:
+ -

Good god, give me a break. Yes my sites have been hit by this also but in no way does it compare with ask's minefield!
Live.com and Msn bots have been the least of my problems. Multiple grabs of my pages by Ask's Minefield has cost me way more in band width and log confusion than queries from live.com for Viagra and infinitum.
Give MS a break for once, thay are trying to do the right thing, as apposed to ask which from my perspective whats everyone to visit your site but through their cache!
At least MS forces you to go to the content page Ask? Minefield, they have their own rules.  never obeys robots.txt and is doing far more harm than MSM/LIVE/MICROSOFT every could. You'll see them eventually.
Figure it out!

Look for this:
"GET / HTTP/1.1" 200 19533 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9a1) Gecko/20070308 Minefield/3.0a1"If you see that then a customer or browser saw your site while not going to you site but staying on ask.com without their knowledge.

from Sebastian 211 days ago #
Votes: 1 | Vote:
+ -

Dan404, did you read the post? Probably not. It's about crawler verification, not MSN's spam bot.


Log in to comment or register here.
Search Marketing Expo

Save the date for:
SMX Local & Mobile - San Francisco, CA (July 24-25) See the agenda, and register now!
SMX Sao Paolo - Brazil - (Aug. 7-8)
SMX China - September 23 & 24, 2008
SMX Stockholm - September 23 & 24, 2008
SMX East - NYC - (Oct. 6-8) Registration is now open.
SMX London - November 4 & 5, 2008