Published: Mar 28, 2008 - 09:29 pm
Story Found By: aimClear 1520 Days ago
Category: Analytics
3 Comments
3 Comments
Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.
Join us at an upcoming SMX event:
Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:
Comments
A great example that goes to show that your internet company is only as strong as your programming department. Now, not to be to harsh, it sounds to me like they are doing something wrong or using the wrong set of tools for the job. Web crawlers have been around for ages, and have been bypassing login pages for just as long. A very wise man once told me over wine and cream cheese wontons: "If its on the web you can scrap it".
The real question with these sort of tools, is the level of noise reduction that takes place. Spam can kill the usefulness of tools such as this very quickly.
@scott8723 Im pretty sure its not the crawlers that have the ability to bypass login pages to get at protected data, but rather the site owner detectes the crawler and lets it in without authentication. @BrianChappell thats an excellent point, especially given how much pure marketing goes on inside the social networks.