homepage Welcome to WebmasterWorld Guest from 54.196.18.51
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Ask - Teoma
Forum Library, Charter, Moderator: open

Ask - Teoma Forum

    
Teoma bot and cgi requests
shrirch




msg:31386
 6:28 am on Feb 7, 2003 (gmt 0)

I happened to come across this forum and did a quick search through my logs.

I see a ton of retarted hits from Teoma as follows

egspd407.teoma.com - - [06/Feb/2003:22:49:10 -0700] "GET /forum/showthread.php HTTP/1.0" 200 18104 "-" "Mozilla/2.0 (compatible; Ask Jeeves/Teoma)"

Obviously its ignoring the threadid parameter and is picking up the vBulletin error message. It has done this a total of 577 times.

Should I block this beast or let it do its thing?

 

lazerzubb




msg:31387
 1:48 pm on Feb 7, 2003 (gmt 0)

Unless it picks up the correct content i see no reason why not exclude it from the page.
You can try removing it once in a while and see if it still happens

WindSun




msg:31388
 10:20 pm on Feb 7, 2003 (gmt 0)

Hmm I think Google has the same problem - it causes a user session or something and confuses it, but Google is smart enough to only try it a couple of times.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Ask - Teoma
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved