homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Marketing and Biz Dev / Cloaking
Forum Library, Charter, Moderator: open

Cloaking Forum

Problem with class C Ip Checks

 11:58 pm on Apr 6, 2002 (gmt 0)

Hi All, Question. If i take the ip address of the spider visiting, then knock off the end if it and make it a class c ip. ( to 204.152.191) then do a search in the database it will flag that its a spider because of the folowing ips:,,, and But Its altavistas translator service!
so whats the best way to get past this?

my pseudocode is:
function SpiderVerify(ip,UA)
'ip = ip address
'ua = User Agent
make ip class C
' to 123.123.123
check to see if any ips like that in database.
flag good for no matches.
flag bad for matches.



 12:18 am on Apr 7, 2002 (gmt 0)

Also why make it a class C instead of the full IP?


 5:41 am on Apr 8, 2002 (gmt 0)

The advantage is that spiders tend to be added from the same class "C" IP range, so it provides an opportunity to detect spiders that would otherwise be missed.


 4:23 pm on Apr 8, 2002 (gmt 0)

You should keep a database of translators as well. Do a check on the translator database before the spider database. Here's the IPs I have listed as translators:


 11:47 pm on Apr 8, 2002 (gmt 0)

Wow, Thanks so much, this is what i do:
first i grab the ip address and UA. then i also make the ip a class C. now what I do is check it against a sql2000 database and it does this check.
is IP a translator yes/no
if no
is class C ip like any spiders yes/no
if no
is UA like any spider UAs

This is as thurrow as i can get i think. Anyone else have any better ideas?


 11:02 pm on Apr 9, 2002 (gmt 0)

I would do the check against the list of translators before truncating the IP address into a Class C.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Marketing and Biz Dev / Cloaking
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved