Forum Moderators: DixonJones

Message Too Old, No Replies

Bizzare errors in my logs...

interfering with robots.txt?

         

jo1ene

6:10 pm on Jun 13, 2004 (gmt 0)

10+ Year Member



[client 66.196.XX.149] File does not exist: /foo/www/internetaccess.htmrobots.txt

[client 66.196.XX.64] File does not exist: /foo/www/internetaccess.htm

Wassup?

I have no such file as internetaccess.htm and never have.
I have always used .html
I have a robot.txt and spiders can and do get it.
I used Xenu to check all the site links and they're A-OK.

In your opinion, is this a bad thing? It keeps popping up every few days. Should I care?

[edited by: webdiversity at 10:16 am (utc) on June 14, 2004]
[edit reason] no specific IP's please [/edit]

bull

8:22 pm on Jun 13, 2004 (gmt 0)

10+ Year Member



As the IP belongs to former Inktomi, I would not worry. I had some three or four weeks ago requests for files that never have existed on my site but that seemed to be real filenames from other sites by Inktomi. Went away after some days. Still doing fine on Yahoo.