Welcome to WebmasterWorld Guest from 54.146.59.51

Forum Moderators: mack

Message Too Old, No Replies

different crawl type

     
7:02 am on Aug 6, 2004 (gmt 0)

New User

10+ Year Member

joined:July 22, 2004
posts:31
votes: 0


I just checked some of our projects and noted that 65.54.164.101 ist just checking the headlines but 207.46.98.52 does a deep crawl.

12 pages 65.54.xx against 1250 pages 207.46.xx

Can anybody confirm this?

12:55 pm on Aug 6, 2004 (gmt 0)

Senior Member from FR 

WebmasterWorld Senior Member leosghost is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Feb 15, 2004
posts:6717
votes: 230


this is their answer to "bot bans" due to non respect of probots text by their bots?
1:34 pm on Aug 8, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:May 25, 2003
posts:42
votes: 0


I have not attempted to ban the MSN bot, but I see similar behavior. My logs show just one one-page visit by 65.54.164.132 this month, but 207.46.98.141 has accessed 149 pages since the beginning of August.

ADDED: I forgot to mention that the site does not show up in MSN Search results, in spite of frequent extensive visits over a couple of months. (No one here is likely to be surprised by this.)

2:48 pm on Aug 8, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 27, 2002
posts:1685
votes: 0


I don't see either of those numbers mentioned in my logs and for what it's worth, these three (last two octets noted below) are responsible for 472 requests for pages this week alone.

.188.50 / .188.70 / .164.36

I do show up in search results.