Welcome to WebmasterWorld Guest from 54.196.233.239

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Bullheaded GoogleBot

asking nonexistent javascript stuff again and again

     

albert

1:53 pm on Jan 10, 2005 (gmt 0)

10+ Year Member



In our log files we see gbot requests like these very often - seems gbot takes some Jscript from elsewhere in our sites and re-phrases it to nonsense:

66.249.71.70 - - [02/Jan/2005:04:30:30 +0100] "GET /eOperator/gte HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.18 - - [02/Jan/2005:08:04:59 +0100] "GET /eCat3/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.71.32 - - [02/Jan/2005:08:14:18 +0100] "GET /sortdir/asc HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.37 - - [02/Jan/2005:08:24:03 +0100] "GET /eDate/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.68 - - [02/Jan/2005:08:45:49 +0100] "GET /eOperator/lte HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.71.40 - - [02/Jan/2005:09:33:54 +0100] "GET /eText/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.68 - - [02/Jan/2005:09:59:30 +0100] "GET /sortdir/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.71.40 - - [02/Jan/2005:10:02:09 +0100] "GET /eOperator/eq HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.18 - - [02/Jan/2005:10:02:56 +0100] "GET /eCat1/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.37 - - [02/Jan/2005:11:12:04 +0100] "GET /eCat2/ HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
66.249.64.55 - - [02/Jan/2005:12:37:47 +0100] "GET /sortdir/desc HTTP/1.0" 404 1031 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"

I ask because sometimes he seems to come just for index, robots and that stuff instead of spidering new pages we have.

Should we worry?

 

Featured Threads

Hot Threads This Week

Hot Threads This Month