sinyala1 - 12:05 pm on May 6, 2002 (gmt 0)

What are you guys talking about slowing the server down? What are you kidding?

You have a spider trap.......this spider trap is submitted to search engines. The IP is recorded and DNS upon going to the web page. The database isn't even on the same server as the any of my cloaked site, it just requests to use the spider database. Here's my code, and this code loads extremely fast, like not even close to .01 seconds. Like I said, it's stupid to stick with agents. So IP's change, their DNS's do not, and if they do the spider trap will pick them up but I seriously doubt altavista's going to change their entire network and server names anytime soon and if they did I'd easily pick them up on next weeks run of spider trap. It's updated weekly and I've never had a spider miss it and I've been cloaking for 2 years. Be safe with your agents as you think but if I check logs and never saw a spider miss and go to my normal site I would say I'm doing pretty good. I couldn't find your code because it was 404 but here's my spider trap IP and DNS loggin code:
$new_ip = $REMOTE_ADDR;

$new_dns = gethostbyaddr($new_ip);

$result = mysql_query("SELECT * FROM spiders ORDER BY id", $db);

while($myrow = mysql_fetch_array($result)){

$id = $myrow["id"];

$ip = $myrow["ip"];

$count = $myrow["count"];

if($new_ip == $ip){

$found = "1";

$count++;

mysql_query("UPDATE spiders SET count='$count' WHERE id='$id'", $db);

}

}

if(!$found){

mysql_query("INSERT into spiders (ip, dns, engine) VALUES ('$new_ip', '$new_dns', 'IP') ", $db);