Welcome to WebmasterWorld Guest from 184.108.40.206 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Pubcon Platinum Sponsor 2014
different crawl type orgaseo msg:1535545 7:02 am on Aug 6, 2004 (gmt 0) I just checked some of our projects and noted that 220.127.116.11 ist just checking the headlines but 18.104.22.168 does a deep crawl.
12 pages 65.54.xx against 1250 pages 207.46.xx
Can anybody confirm this?
Leosghost msg:1535546 12:55 pm on Aug 6, 2004 (gmt 0)
this is their answer to "bot bans" due to non respect of probots text by their bots? orlady msg:1535547 1:34 pm on Aug 8, 2004 (gmt 0)
I have not attempted to ban the MSN bot, but I see similar behavior. My logs show just one one-page visit by 22.214.171.124 this month, but 126.96.36.199 has accessed 149 pages since the beginning of August.
ADDED: I forgot to mention that the site does not show up in MSN Search results, in spite of frequent extensive visits over a couple of months. (No one here is likely to be surprised by this.)
pendanticist msg:1535548 2:48 pm on Aug 8, 2004 (gmt 0)
I don't see either of those numbers mentioned in my logs and for what it's worth, these three ( last two octets noted below) are responsible for 472 requests for pages this week alone.
.188.50 / .188.70 / .164.36
do show up in search results.