Forum Moderators: open
Is there an error with Slurp requesting and slash before the "/http" today?
68.142.250.23 - - [10/Feb/2005:17:38:44 +0100] "GET /http://foobar.com/s/foo/bar1.html HTTP/1.0" 404 324 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; [help.yahoo.com...]
68.142.250.23 - - [10/Feb/2005:18:10:56 +0100] "GET /http://foobar.com/s/foo/bar2.html HTTP/1.0" 404 324 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; [help.yahoo.com...]
This is resulting in 404s:
[Thu Feb 10 16:42:18 2005] [error] [client 68.142.250.23] File does not exist: /usr/local/apache2/htdocs/http:
[Thu Feb 10 16:45:04 2005] [error] [client 68.142.249.167] File does not exist: /usr/local/apache2/htdocs/http:
[Thu Feb 10 17:38:44 2005] [error] [client 68.142.250.23] File does not exist: /usr/local/apache2/htdocs/http:
Thanks for any help!
Many sites use urls of the form:
[foo.com...] to implement cgi
redirects, so the mere presence of these urls in our crawl logs isn't a bug.
Thanks,
Tim