homepage Welcome to WebmasterWorld Guest from 54.211.219.68
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
SNAP.COM spider???
Kamikaze

10+ Year Member



 
Msg#: 75 posted 2:08 am on Jun 30, 2000 (gmt 0)

IP: 206.132.166.16
User Agent: Mozilla/4.07 [en]

Would they have a spider???

 

Air_

10+ Year Member



 
Msg#: 75 posted 2:33 am on Jun 30, 2000 (gmt 0)

The whois says it's SNAP just like you said, did it ask for robots.txt? Could be a link checker.

redzone

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 75 posted 3:00 am on Jul 8, 2000 (gmt 0)

SNAP is now spidering upon LiveDirectory Submissions...
We've been showing it's crawler, pages that rank well in Inktomi, and have achieved some nice rankings in LiveDirectory..

Kamikaze

10+ Year Member



 
Msg#: 75 posted 7:58 am on Jul 9, 2000 (gmt 0)

Hey Redzone, thanks for the info. That's what I was theorizing. Do you have the User Agent/IP of that by any chance?
Thanks for any help.

redzone

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 75 posted 3:31 pm on Jul 9, 2000 (gmt 0)

Kamikaze:

Here is what we see coming in for the crawl. We have a dedicated person for SNAP LD submissions, and SNAP usually crawls within 8 hours of the submission.

UA - Mozilla/4.07 [en]
IP - 206.132.166

So that matches what you've seen..

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved