homepage Welcome to WebmasterWorld Guest from 107.20.25.215
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

    
different crawl type
orgaseo




msg:1535545
 7:02 am on Aug 6, 2004 (gmt 0)

I just checked some of our projects and noted that 65.54.164.101 ist just checking the headlines but 207.46.98.52 does a deep crawl.

12 pages 65.54.xx against 1250 pages 207.46.xx

Can anybody confirm this?

 

Leosghost




msg:1535546
 12:55 pm on Aug 6, 2004 (gmt 0)

this is their answer to "bot bans" due to non respect of probots text by their bots?

orlady




msg:1535547
 1:34 pm on Aug 8, 2004 (gmt 0)

I have not attempted to ban the MSN bot, but I see similar behavior. My logs show just one one-page visit by 65.54.164.132 this month, but 207.46.98.141 has accessed 149 pages since the beginning of August.

ADDED: I forgot to mention that the site does not show up in MSN Search results, in spite of frequent extensive visits over a couple of months. (No one here is likely to be surprised by this.)

pendanticist




msg:1535548
 2:48 pm on Aug 8, 2004 (gmt 0)

I don't see either of those numbers mentioned in my logs and for what it's worth, these three (last two octets noted below) are responsible for 472 requests for pages this week alone.

.188.50 / .188.70 / .164.36

I do show up in search results.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved