They promised us a reverse DNS their IPs to search.live.com but they are not. So now we may be blocking their spiders from crawling us.
5 Comments
5 Comments
Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.
Upcoming Conferences
Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.
Join us at an upcoming SMX event:
- SMX West - Feb. 28 - Mar. 1, 2012
- SMX Munich - Mar. 27-28, 2012
- SMX Toronto - Apr. 25-26, 2012
- SMX Sydney - May 1-2, 2012
- SMX London - May 15-16, 2012
- SMX Advanced Seattle - June 5-6, 2012
- SMX Paris - June 7-8 2012
- SMX Melbourne - Aug. 2012
- SMX East - Oct. 2-4, 2012
- SMX Stockholm - Sept. 15-16, 2012
- SMX Social Media Marketing - Dec. 2012
Latest News From Marketing Land
- Marketing Day: February 10, 2012
- Report: iPhone, iPad Now Drive More Web Traffic Than Mac OS
- Drawing Out Your Affiliate Program Marketing Plan
- Is Yahoo About To Make Another Big Mistake — With Its Display Ad Business?
- Google Analytics For The Enterprise: Perception & Reality
- - See more news at Marketing Land -
Upcoming Webcasts
Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:
- The Inside Scoop on Automating and Optimizing Your PPC Campaigns - February 21, 2012
Latest News From Search Engine Land
- Google’s Recent Domain Registrations: Labs, Screenwise & AdWords
- Google AdWords Gets Shared Lists To Eliminate Duplicate Data Entry
- SearchCap: The Day In Search, February 10, 2012
- Now, Mitt Romney Has A Santorum-Like Bing & Google Problem
- Search In Pics: Google Sugar Cube, Yahoo Valentines & Chrome M&M’s
- - See more news at Search Engine Land -
Comments
Good information to have on hand. Good post.
Yeah. So now I get to update the good ol’ cloaking software.From now on, live.com referer=big effin goatse.
Hmm, interesting. While I don’t agree with LilRascal’s comment about "goatse", it pretty much sucks.
Good god, give me a break. Yes my sites have been hit by this also but in no way does it compare with ask’s minefield!Live.com and Msn bots have been the least of my problems. Multiple grabs of my pages by Ask’s Minefield has cost me way more in band width and log confusion than queries from live.com for Viagra and infinitum.Give MS a break for once, thay are trying to do the right thing, as apposed to ask which from my perspective whats everyone to visit your site but through their cache!At least MS forces you to go to the content page Ask? Minefield, they have their own rules. never obeys robots.txt and is doing far more harm than MSM/LIVE/MICROSOFT every could. You’ll see them eventually. Figure it out!Look for this:"GET / HTTP/1.1" 200 19533 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9a1) Gecko/20070308 Minefield/3.0a1"If you see that then a customer or browser saw your site while not going to you site but staying on ask.com without their knowledge.
Dan404, did you read the post? Probably not. It’s about crawler verification, not MSN’s spam bot.