homepage Welcome to WebmasterWorld Guest from 54.166.123.2
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Is this INK spider?
Kamikaze




msg:405224
 11:11 pm on Jun 27, 2000 (gmt 0)

I got 2 visits from INKTOMI that I've never seen before. And I'm not sure if it's a spider or not.

IP: 209.131.52.115
User Agent: Mozilla/4.73 [en] (Win98; U) INKTOMI

AND

IP: 209.131.52.146
User Agent: Mozilla/4.7 [en] (WinNT; I) INKTOMI

 

Brett_Tabke




msg:405225
 11:34 pm on Jun 27, 2000 (gmt 0)

.146 for sure.
and 115 probable.

Kamikaze




msg:405226
 11:58 pm on Jun 27, 2000 (gmt 0)

Thanks Brett!!! :)

Cisco




msg:405227
 4:26 pm on Jun 30, 2000 (gmt 0)

The host name for 209.131.52.146
is JI-TMP-PC.dhcp.inktomi.com

With PC-dhcp in the name, are you sure that's not Joe Surfer browsing from an Inktomi office on a LAN?


seoboy




msg:405228
 5:47 pm on Jun 30, 2000 (gmt 0)


i'm with cisco - sounds like a lan to me. far as i can make out, MANY if not ALL PCs at ink have their own IPs assigned. If you reverselookup across a class C of theirs, you will find a lot of these PC listings.

brett has a good list of them here:
[searchengineworld.com ]

poses a challenging question - to cloak, or not to cloak pages to these IPs...

our current position is to cloak (and i'm not saying its the right decision) - and we've had some visits from these PC ips to pages over the past month or so... which means - if its a desktop computers - someone is seeing the page meant for the spider. we'll see what the ramifications are!


seoboy



Brett_Tabke




msg:405229
 11:30 am on Jul 5, 2000 (gmt 0)

I think the cloak/no cloak question depends upon how different your pages are visually. I worry being how the person is going to see it. Second, cloak for all ink ip's no matter what.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved