Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

How to build a spider trap?

4:37 pm on Aug 24, 2005 (gmt 0)

Full Member

10+ Year Member

joined:Nov 19, 2003
votes: 0

Hi all,

I am trying to build a spider trap, and figuered that if anyone knew how - it would be you all!

Are there any good php spider traps that I can use as a base, and then build from there?

If not, is this a valid model?

Basically I will record in a DB all hits to robots.txt, and record IP and User-Agent.

Am I missing anything?


5:32 pm on Aug 24, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 22, 2001
votes: 0

Check out this post: [webmasterworld.com...]

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members