Webcraft - who is it? - Crawler, Spider, and User Agent ID forum at WebmasterWorld

Forum Moderators: open

Message Too Old, No Replies

Webcraft - who is it?

1:49 pm on Mar 28, 2001 (gmt 0)

It took pages, that are only allowed for Google. It doesn´t seem taking the robots.txt.

Any thoughts?

4:28 pm on Mar 28, 2001 (gmt 0)

Mail them and find out Leon. I can't see it in any logs of our euro sites yet.

8:54 am on Mar 29, 2001 (gmt 0)

i saw it on several of my site, but i have no info on it

9:33 am on Mar 29, 2001 (gmt 0)

Also on 63.96.163.30, no robots request. Seemed just to grab one level deep.

iway.fr refreshes to fr.uu.net ?

9:39 am on Mar 29, 2001 (gmt 0)

Been getting this visitor for quite a few months now on a number of my domains.