Welcome to WebmasterWorld Guest from 54.224.203.224

Forum Moderators: open

Message Too Old, No Replies

Teoma bot and cgi requests

     
6:28 am on Feb 7, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Nov 14, 2002
posts:422
votes: 0


I happened to come across this forum and did a quick search through my logs.

I see a ton of retarted hits from Teoma as follows

egspd407.teoma.com - - [06/Feb/2003:22:49:10 -0700] "GET /forum/showthread.php HTTP/1.0" 200 18104 "-" "Mozilla/2.0 (compatible; Ask Jeeves/Teoma)"

Obviously its ignoring the threadid parameter and is picking up the vBulletin error message. It has done this a total of 577 times.

Should I block this beast or let it do its thing?

1:48 pm on Feb 7, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 16, 2001
posts:2059
votes: 0


Unless it picks up the correct content i see no reason why not exclude it from the page.
You can try removing it once in a while and see if it still happens
10:20 pm on Feb 7, 2003 (gmt 0)

Full Member

10+ Year Member

joined:May 8, 2002
posts:325
votes: 0


Hmm I think Google has the same problem - it causes a user session or something and confuses it, but Google is smart enough to only try it a couple of times.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members