Combine/0.0

Forum Moderators: open

Message Too Old, No Replies

Just grabbet robots and fled

4:47 pm on Apr 8, 2003 (gmt 0)

Hi:

Noticed this last night...

130.235.140.184 - - [07/Apr/2003:21:11:26 -0600] "GET /robots.txt HTTP/1.0" 206 4536 "-" "COMBINE/0.0"

Just grabbed /robots.txt on ALL my sites and left...

dave

4:53 pm on Apr 8, 2003 (gmt 0)

My rule:

Be nice to all spiders.

There was a day when nobody had heard of Googlebot.

5:03 pm on Apr 8, 2003 (gmt 0)

My rule:

Look up the IP address, and then decide. If Googlebot comes in on a dial-up line, you might want to look at your blocking logic. :)

This one's from Lund University in Sweden - You decide.

Jim

9:51 pm on Apr 8, 2003 (gmt 0)

At this point.... it stays.

11:15 am on Apr 29, 2003 (gmt 0)

For what it's worth:

130.225.95.179 - - [29/Apr/2003:03:22:05 -0700] "GET /robots.txt HTTP/1.1" 200 220 "-" "COMBINE/0.0"

Shows a different IP Number.

OrgName: Danish Computer Centre for Research and Education
OrgID: DCCRE
Address: Building 305, DTH
Address: DK-2800 Lyngby

Given the concensus, I guess I'll leave it be too.

Pendanticist.