homepage Welcome to WebmasterWorld Guest from 54.211.100.183
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

    
MSNBOT going crazy
It's appetite for dynamic links seems unsasionable
Orange_XL

10+ Year Member



 
Msg#: 17 posted 10:24 pm on Jun 25, 2003 (gmt 0)

Has anyone else notice that MSNBOT goes wild on dynamic pages such as forums? I'm using phpBB and MSNBOT has already hit it serveral thousend times, while it is only a small forum with few sections and topics. It just seems to think that every new session or other variable is a new webpage.

 

jeremy goodrich

WebmasterWorld Senior Member jeremy_goodrich us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 17 posted 10:26 pm on Jun 25, 2003 (gmt 0)

Many search engines have done that to my sites in the past - as well as some that run bots with fake referrers :)

If it's causing a performance issue with your site, I would add the IP(s) in question to your .htaccess file to limit their bandwidth sucking. You can always let them index your site later, as they decide / and or announce they are releasing a publically searchable index.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved