Does spiderhunts pseudocode show a good or best way to cloak and detect spiders? Im using it to possible make a Dll file or asp.net cloaking script. Does anyone know of better methods or can add to his code? I dont have money so i have to do this all from scratch.
ahh come on guys, help me out! Ive got so many questions! like would it be better to reduce the dns of the ip address to a 2nd level dns and compare it to a list of spiders with there 2nd level domains? or just compare the whole dns to a list of whole dns and ip addreeses?
Well, using partial IP's coupled with some other identifier, like User Agent and maybe no referrer, will keep the list shorter and therefore performance will also be better. I would stay away from resolving host names though, unless you have DNS on the same box as the cloak, otherwise it can get way too slow.
its part of .NET technology where you can do that. Im going to be testing speed of it though. I realy want the most accurate and efficiant way i can come up with. Possibly for resale after I give it away for testing.