| Welcome to WebmasterWorld Guest from 126.96.36.199 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
|Teoma bot and cgi requests|
I happened to come across this forum and did a quick search through my logs.
I see a ton of retarted hits from Teoma as follows
egspd407.teoma.com - - [06/Feb/2003:22:49:10 -0700] "GET /forum/showthread.php HTTP/1.0" 200 18104 "-" "Mozilla/2.0 (compatible; Ask Jeeves/Teoma)"
Obviously its ignoring the threadid parameter and is picking up the vBulletin error message. It has done this a total of 577 times.
Should I block this beast or let it do its thing?
Unless it picks up the correct content i see no reason why not exclude it from the page.
You can try removing it once in a while and see if it still happens
Hmm I think Google has the same problem - it causes a user session or something and confuses it, but Google is smart enough to only try it a couple of times.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved