homepage Welcome to WebmasterWorld Guest from 23.22.173.58
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Is this INK spider?
Kamikaze

10+ Year Member



 
Msg#: 77 posted 11:11 pm on Jun 27, 2000 (gmt 0)

I got 2 visits from INKTOMI that I've never seen before. And I'm not sure if it's a spider or not.

IP: 209.131.52.115
User Agent: Mozilla/4.73 [en] (Win98; U) INKTOMI

AND

IP: 209.131.52.146
User Agent: Mozilla/4.7 [en] (WinNT; I) INKTOMI

 

Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 77 posted 11:34 pm on Jun 27, 2000 (gmt 0)

.146 for sure.
and 115 probable.

Kamikaze

10+ Year Member



 
Msg#: 77 posted 11:58 pm on Jun 27, 2000 (gmt 0)

Thanks Brett!!! :)

Cisco

10+ Year Member



 
Msg#: 77 posted 4:26 pm on Jun 30, 2000 (gmt 0)

The host name for 209.131.52.146
is JI-TMP-PC.dhcp.inktomi.com

With PC-dhcp in the name, are you sure that's not Joe Surfer browsing from an Inktomi office on a LAN?


seoboy

10+ Year Member



 
Msg#: 77 posted 5:47 pm on Jun 30, 2000 (gmt 0)


i'm with cisco - sounds like a lan to me. far as i can make out, MANY if not ALL PCs at ink have their own IPs assigned. If you reverselookup across a class C of theirs, you will find a lot of these PC listings.

brett has a good list of them here:
[searchengineworld.com ]

poses a challenging question - to cloak, or not to cloak pages to these IPs...

our current position is to cloak (and i'm not saying its the right decision) - and we've had some visits from these PC ips to pages over the past month or so... which means - if its a desktop computers - someone is seeing the page meant for the spider. we'll see what the ramifications are!


seoboy



Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 77 posted 11:30 am on Jul 5, 2000 (gmt 0)

I think the cloak/no cloak question depends upon how different your pages are visually. I worry being how the person is going to see it. Second, cloak for all ink ip's no matter what.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved