Forum Moderators: open

Message Too Old, No Replies

MSN Crawled to much - IMDB site limit reached.

         

clearvision

10:50 pm on Jan 21, 2008 (gmt 0)

10+ Year Member



Oooops....Maybe this is old news to some of you,but thought is was a little humorous.

MSN.com crawled IMDB site too often and the search listings are the proof!

[search.live.com...]

The 2nd search listing reads as follows:

IMDb - Request Limit Reached
Request Limit Reached IMDb aims to be fair to all users. There have been an unusually high number of pages requested by you (or from your organization's web proxy)

vincevincevince

11:45 am on Jan 23, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



IMDB obviously didn't think MSNBOT important enough to be categorised along with the other bots which were able crawl it... says a lot about MSN's traffic value