homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Ask - Teoma
Forum Library, Charter, Moderator: open

Ask - Teoma Forum

The Ask Jeeves/Teoma Spider is out of control!

 7:30 pm on Feb 22, 2004 (gmt 0)

Anyone else seeing this relentless spider?
I'm over 200,000 requests so far this month.
I was never one to consider blocking a spider before but it's about time to tame this beast.



 8:31 pm on Feb 22, 2004 (gmt 0)

Yes, same thing here. Being pounding for about two months now. Still does not return any useful results for spidered pages.

But I'm not disabling it. It's a pity there is no way in robots.txt to limit query frequency without total blocking.


 11:07 pm on Feb 22, 2004 (gmt 0)

Same story - Teoma hits new sites (right behind G-bot) - but NO traffic . ..


 5:23 pm on Feb 23, 2004 (gmt 0)

I had GIGS of transfer from the AskJeeves/Teoma bot in the past month or two and I have yet to be included in the index! Ridiculous.


 12:58 am on Mar 5, 2004 (gmt 0)

same problem here. 12,000 requests in a 3-4 hour period. My mod_throttle actually kicked in.


 3:47 am on Mar 5, 2004 (gmt 0)

133K hits in January and 435K hits last month, all on one site. Total number of pages in Teoma: 0

I could say the same about AltaVista though.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Ask - Teoma
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved