Welcome to WebmasterWorld Guest from 54.227.52.24

Forum Moderators: open

Message Too Old, No Replies

Teoma bot and cgi requests

     

shrirch

6:28 am on Feb 7, 2003 (gmt 0)

10+ Year Member



I happened to come across this forum and did a quick search through my logs.

I see a ton of retarted hits from Teoma as follows

egspd407.teoma.com - - [06/Feb/2003:22:49:10 -0700] "GET /forum/showthread.php HTTP/1.0" 200 18104 "-" "Mozilla/2.0 (compatible; Ask Jeeves/Teoma)"

Obviously its ignoring the threadid parameter and is picking up the vBulletin error message. It has done this a total of 577 times.

Should I block this beast or let it do its thing?

lazerzubb

1:48 pm on Feb 7, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Unless it picks up the correct content i see no reason why not exclude it from the page.
You can try removing it once in a while and see if it still happens

WindSun

10:20 pm on Feb 7, 2003 (gmt 0)

10+ Year Member



Hmm I think Google has the same problem - it causes a user session or something and confuses it, but Google is smart enough to only try it a couple of times.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month