Welcome to WebmasterWorld Guest from 22.214.171.124 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
Is there a Complete Spider IP List...somewhere? With so many pros here there's got to have one right... Mtlinfo
I read a good bunch a threads about cloaking and i've started to do that but i can't find a public Spider IP list gathered, built and updated by Webmasters on this board so is there one or not and if not then why don't we start one here rather then having to read all the different posts here talking about a new spider they have discovered?
Just my 2 cents :-D
I don't do any cloaking but, I think this is generally considered a good list: [ ...] iplists.com
Well, you can look through here: top 10 list of useful bots to allow on your site? [ webmasterworld.com]
New Forum Proposal: Spider Traps [ webmasterworld.com]
Alright hehe thanks guys nice work :-D
Now all i need to know is if AIR uses this iplist.com site to keep his ICS IP list updated but it looks like it when i quickly compare his with that site's IP list.
It's not that i don't trust the guy after all he's one of the best programmer but you're never too sure or safe in this cloaking business.
I don't think Air uses iplists.com... At least he hasn't told me that he does... iplists.com is my site. Mtlinfo
It that is true then congrats man :-D you did i nice job on that but who supplies you with those IPs anyway? You own stats? Webmasters? Santa Claus? Fantomaster? ;-)
Keep up the good work.
My own logs and the help of many many people who send me their suspicious log entries... And of course this forum [ webmasterworld.com]!
I also have set up a couple of bot traps that email me whenever a previously undiscovered bot stops by.
By the way I believe Fantomaster's list is a pretty good one, too.