Welcome to WebmasterWorld Guest from 54.159.214.27

Forum Moderators: DixonJones & mademetop

Bullheaded GoogleBot

asking nonexistent javascript stuff again and again

   
1:53 pm on Jan 10, 2005 (gmt 0)

10+ Year Member



In our log files we see gbot requests like these very often - seems gbot takes some Jscript from elsewhere in our sites and re-phrases it to nonsense:

66.249.71.70 - - [02/Jan/2005:04:30:30 +0100] "GET /eOperator/gte HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.18 - - [02/Jan/2005:08:04:59 +0100] "GET /eCat3/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.71.32 - - [02/Jan/2005:08:14:18 +0100] "GET /sortdir/asc HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.37 - - [02/Jan/2005:08:24:03 +0100] "GET /eDate/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.68 - - [02/Jan/2005:08:45:49 +0100] "GET /eOperator/lte HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.71.40 - - [02/Jan/2005:09:33:54 +0100] "GET /eText/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.68 - - [02/Jan/2005:09:59:30 +0100] "GET /sortdir/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.71.40 - - [02/Jan/2005:10:02:09 +0100] "GET /eOperator/eq HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.18 - - [02/Jan/2005:10:02:56 +0100] "GET /eCat1/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.37 - - [02/Jan/2005:11:12:04 +0100] "GET /eCat2/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.55 - - [02/Jan/2005:12:37:47 +0100] "GET /sortdir/desc HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"

I ask because sometimes he seems to come just for index, robots and that stuff instead of spidering new pages we have.

Should we worry?

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month