homepage Welcome to WebmasterWorld Guest from 107.22.70.215
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Accredited PayPal World Seller

Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

    
MSNBOT going crazy
It's appetite for dynamic links seems unsasionable
Orange_XL




msg:1533585
 10:24 pm on Jun 25, 2003 (gmt 0)

Has anyone else notice that MSNBOT goes wild on dynamic pages such as forums? I'm using phpBB and MSNBOT has already hit it serveral thousend times, while it is only a small forum with few sections and topics. It just seems to think that every new session or other variable is a new webpage.

 

jeremy goodrich




msg:1533586
 10:26 pm on Jun 25, 2003 (gmt 0)

Many search engines have done that to my sites in the past - as well as some that run bots with fake referrers :)

If it's causing a performance issue with your site, I would add the IP(s) in question to your .htaccess file to limit their bandwidth sucking. You can always let them index your site later, as they decide / and or announce they are releasing a publically searchable index.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved