Welcome to WebmasterWorld Guest from 107.20.34.173

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

SNAP.COM spider???

     

Kamikaze

2:08 am on Jun 30, 2000 (gmt 0)

10+ Year Member



IP: 206.132.166.16
User Agent: Mozilla/4.07 [en]

Would they have a spider???

Air_

2:33 am on Jun 30, 2000 (gmt 0)



The whois says it's SNAP just like you said, did it ask for robots.txt? Could be a link checker.

redzone

3:00 am on Jul 8, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



SNAP is now spidering upon LiveDirectory Submissions...
We've been showing it's crawler, pages that rank well in Inktomi, and have achieved some nice rankings in LiveDirectory..

Kamikaze

7:58 am on Jul 9, 2000 (gmt 0)

10+ Year Member



Hey Redzone, thanks for the info. That's what I was theorizing. Do you have the User Agent/IP of that by any chance?
Thanks for any help.

redzone

3:31 pm on Jul 9, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Kamikaze:

Here is what we see coming in for the crawl. We have a dedicated person for SNAP LD submissions, and SNAP usually crawls within 8 hours of the submission.

UA - Mozilla/4.07 [en]
IP - 206.132.166

So that matches what you've seen..

 

Featured Threads

Hot Threads This Week

Hot Threads This Month