Welcome to WebmasterWorld Guest from 54.198.147.221

Forum Moderators: open

Message Too Old, No Replies

Is there a Complete Spider IP List...somewhere?

With so many pros here there's got to have one right...

     
8:03 am on Jan 25, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 3, 2003
posts:170
votes: 0


Hi guys,

I read a good bunch a threads about cloaking and i've started to do that but i can't find a public Spider IP list gathered, built and updated by Webmasters on this board so is there one or not and if not then why don't we start one here rather then having to read all the different posts here talking about a new spider they have discovered?

Just my 2 cents :-D

Mtlinfo

8:11 am on Jan 25, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member nick_w is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Feb 4, 2002
posts:5044
votes: 0


I don't do any cloaking but, I think this is generally considered a good list: [iplists.com...]

Nick

8:16 am on Jan 25, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 27, 2002
posts:1685
votes: 0


Well, you can look through here:

top 10 list of useful bots to allow on your site? [webmasterworld.com]

or here:

New Forum Proposal: Spider Traps [webmasterworld.com]

Pendanticist.

10:12 am on Jan 25, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 3, 2003
posts:170
votes: 0


Alright hehe thanks guys nice work :-D

Now all i need to know is if AIR uses this iplist.com site to keep his ICS IP list updated but it looks like it when i quickly compare his with that site's IP list.

It's not that i don't trust the guy after all he's one of the best programmer but you're never too sure or safe in this cloaking business.

See ya,

Mtlinfo

3:14 pm on Jan 27, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 22, 2001
posts:2450
votes: 0


I don't think Air uses iplists.com... At least he hasn't told me that he does... iplists.com is my site.
10:28 pm on Jan 27, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 3, 2003
posts:170
votes: 0


Hi volatilegx,

It that is true then congrats man :-D you did i nice job on that but who supplies you with those IPs anyway? You own stats? Webmasters? Santa Claus? Fantomaster? ;-)

Keep up the good work.

Mtlinfo

8:22 pm on Jan 28, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 22, 2001
posts:2450
votes: 0


My own logs and the help of many many people who send me their suspicious log entries... And of course this forum [webmasterworld.com]!

I also have set up a couple of bot traps that email me whenever a previously undiscovered bot stops by.

By the way I believe Fantomaster's list is a pretty good one, too.