Welcome to WebmasterWorld Guest from 54.205.115.177

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Bullheaded GoogleBot

asking nonexistent javascript stuff again and again

   
1:53 pm on Jan 10, 2005 (gmt 0)

10+ Year Member



In our log files we see gbot requests like these very often - seems gbot takes some Jscript from elsewhere in our sites and re-phrases it to nonsense:

66.249.71.70 - - [02/Jan/2005:04:30:30 +0100] "GET /eOperator/gte HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.18 - - [02/Jan/2005:08:04:59 +0100] "GET /eCat3/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.71.32 - - [02/Jan/2005:08:14:18 +0100] "GET /sortdir/asc HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.37 - - [02/Jan/2005:08:24:03 +0100] "GET /eDate/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.68 - - [02/Jan/2005:08:45:49 +0100] "GET /eOperator/lte HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.71.40 - - [02/Jan/2005:09:33:54 +0100] "GET /eText/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.68 - - [02/Jan/2005:09:59:30 +0100] "GET /sortdir/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.71.40 - - [02/Jan/2005:10:02:09 +0100] "GET /eOperator/eq HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.18 - - [02/Jan/2005:10:02:56 +0100] "GET /eCat1/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.37 - - [02/Jan/2005:11:12:04 +0100] "GET /eCat2/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.55 - - [02/Jan/2005:12:37:47 +0100] "GET /sortdir/desc HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"

I ask because sometimes he seems to come just for index, robots and that stuff instead of spidering new pages we have.

Should we worry?