Sphinn - MSNbot/1.0 is defunct - Long live MSNbot/1.1 that saves you bandwidth costs

38
Sphinn It!

MSNbot/1.0 is defunct - Long live MSNbot/1.1 that saves you bandwidth costs

Went Hot: February 13, 2008 - 9:18 am
Posted By: Sebastian 241 days ago
Topic Type: News Story (Jump to http://sebastians-pamphlets.com)
Category: Microsoft SEO

Microsoft Live Search upgrades their crawler today. From now on msnbot/1.1 supports conditional GET requests and HTTP compression. That's a very much appreciated move. I've chatted with Nathan Buggia from Live Search who was kind enough to provide me with some interesting info in addition to the official announcement.

3 Comments

Who Desphunn This (0)

Comments

from JohnWeb 241 days ago #

Votes: 0 | Vote:

+ -

Nice to see Sphinn indexed already for your article title. Hope you didn't cut-n-paste the description.

from Sebastian 241 days ago #

Votes: 0 | Vote:

+ -

Nope, I didn't cut 'n paste the desc - but Shaun is right, the BlitzIndexing thingy sucks ATM. :(

from IncrediBILL 240 days ago #

Votes: 0 | Vote:

+ -

Now if only Yahoo! could get their stuff together and share a common cache for all their creepy crawlers but that's unlikely to happen with everyone down there running for cover to avoid the grim reaper.

BTW, you can get good dedicated servers from PEER1 companies that come with 2000GB total bandwidth per month for a real low fee and this has kept me from being dinged for over usage for years now as my monthly bandwidth has never exceeded 300GB so far, but I'm still growing ;)