Forum Moderators: open

Message Too Old, No Replies

TECOMAC-Crawler/0.3

grabbed robots, no info

         

bull

7:39 am on Oct 31, 2002 (gmt 0)

10+ Year Member



213.61.4.100 - - [30/Oct/2002:23:19:27 +0100] "GET /robots.txt HTTP/1.0" 404 496 www.x.de "-" "TECOMAC-Crawler/0.3" "-"
213.61.4.100 - - [30/Oct/2002:23:19:27 +0100] "GET / HTTP/1.0" 200 1862 www.x.de "-" "TECOMAC-Crawler/0.3" "-"

has anyone info on this one? seems to like german pages only as a google search on the ua indicates.

[arexera.de...]
Tecomac Gmbh (Germany) now Arexera Information Technologies

[arexera.de...]
They offer the "X-Crawler". So why is TECOMAC-Crawler still here? Also, who is 213.61.4.100?

volatilegx

7:38 pm on Oct 31, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



This looks like a distributed crawler. 213.61.4.100 could be anybody who's purchased a license to use the crawler.