Forum Moderators: open

Message Too Old, No Replies

Grub Crawler has new name

         

Josk

9:46 am on Feb 7, 2002 (gmt 0)

10+ Year Member



Hi,

Probably old news to some, but I've had two Grub Crawlers in called "Mozilla/4.0 (compatible;
grub-client-0.2.3; Crawl your stuff with [grub.org)"...]

IP's are 65.34.157.194 and 213.28.88.21 .

volatilegx

4:49 pm on Feb 7, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks Josk

My list for Grub is

# Grub
crawler.grub.org
65.34.157.194
206.30.142.100
213.28.88.2
216.183.203.7

Anybody have more?

Josk

9:38 am on Feb 8, 2002 (gmt 0)

10+ Year Member



At the moment I'm not really worrying at the IB addresses. If it a distributed crawler then potential customers could end up seeing the wrong things...

volatilegx

7:57 pm on Feb 11, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



that's a good point :)