My mother tongue is French, i will try to make sense, OK?
I recently recieved the visit of sneaky robot. It seems to provoke a 404 to test the server.
Here is a clip from the log.
18.104.22.168 - - [04/Jan/2001:02:34:16 -0500] "GET /robots.txt HTTP/1.0" 200 354
22.214.171.124 - - [04/Jan/2001:02:34:22 -0500] "GET / HTTP/1.0" 200 14788
126.96.36.199 - - [04/Jan/2001:02:34:20 -0500] "GET /test404response462450495.html HTTP/1.0"
The site uses java script redirect to the index.htm file, only because I use frames.
A couple of real content pages where optimised for targeted engines, but I neither use entry pages nor cloaking. I visited digital integrity web site to discover that they sell robots.
Can some one teach me about this robot, please?
Edited by: Macguru