Welcome to WebmasterWorld Guest from 54.196.232.162

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

SNAP.COM spider???

     
2:08 am on Jun 30, 2000 (gmt 0)

Junior Member

10+ Year Member

joined:June 20, 2000
posts:151
votes: 0


IP: 206.132.166.16
User Agent: Mozilla/4.07 [en]

Would they have a spider???

Air_

2:33 am on June 30, 2000 (gmt 0)

Inactive Member
Account Expired

 
 


The whois says it's SNAP just like you said, did it ask for robots.txt? Could be a link checker.
3:00 am on July 8, 2000 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 8, 2000
posts:684
votes: 0


SNAP is now spidering upon LiveDirectory Submissions...
We've been showing it's crawler, pages that rank well in Inktomi, and have achieved some nice rankings in LiveDirectory..
7:58 am on July 9, 2000 (gmt 0)

Junior Member

10+ Year Member

joined:June 20, 2000
posts:151
votes: 0


Hey Redzone, thanks for the info. That's what I was theorizing. Do you have the User Agent/IP of that by any chance?
Thanks for any help.
3:31 pm on July 9, 2000 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 8, 2000
posts:684
votes: 0


Kamikaze:

Here is what we see coming in for the crawl. We have a dedicated person for SNAP LD submissions, and SNAP usually crawls within 8 hours of the submission.

UA - Mozilla/4.07 [en]
IP - 206.132.166

So that matches what you've seen..