homepage Welcome to WebmasterWorld Guest from 54.167.75.155
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Ask - Teoma
Forum Library, Charter, Moderator: open

Ask - Teoma Forum

    
The Ask Jeeves/Teoma Spider is out of control!
MrSpeed




msg:30952
 7:30 pm on Feb 22, 2004 (gmt 0)

Anyone else seeing this relentless spider?
I'm over 200,000 requests so far this month.
I was never one to consider blocking a spider before but it's about time to tame this beast.

 

andrew_m




msg:30953
 8:31 pm on Feb 22, 2004 (gmt 0)

Yes, same thing here. Being pounding for about two months now. Still does not return any useful results for spidered pages.

But I'm not disabling it. It's a pity there is no way in robots.txt to limit query frequency without total blocking.

howiejs




msg:30954
 11:07 pm on Feb 22, 2004 (gmt 0)

Same story - Teoma hits new sites (right behind G-bot) - but NO traffic . ..

filo




msg:30955
 5:23 pm on Feb 23, 2004 (gmt 0)

I had GIGS of transfer from the AskJeeves/Teoma bot in the past month or two and I have yet to be included in the index! Ridiculous.

pcgamez




msg:30956
 12:58 am on Mar 5, 2004 (gmt 0)

same problem here. 12,000 requests in a 3-4 hour period. My mod_throttle actually kicked in.

Bobby_Davro




msg:30957
 3:47 am on Mar 5, 2004 (gmt 0)

133K hits in January and 435K hits last month, all on one site. Total number of pages in Teoma: 0

I could say the same about AltaVista though.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Ask - Teoma
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved