The Ask Jeeves/Teoma Spider is out of control! Ask

Welcome to WebmasterWorld Guest from 54.224.75.101
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,

Pubcon Platinum Sponsor

Home / Forums Index / Search Engines / Ask - Teoma

Forum Library : Charter : Moderator: open
Ask - Teoma Forum

The Ask Jeeves/Teoma Spider is out of control!

MrSpeed

msg:30952

7:30 pm on Feb 22, 2004 (gmt 0)

Anyone else seeing this relentless spider?
I'm over 200,000 requests so far this month.
I was never one to consider blocking a spider before but it's about time to tame this beast.

andrew_m

msg:30953

8:31 pm on Feb 22, 2004 (gmt 0)

Yes, same thing here. Being pounding for about two months now. Still does not return any useful results for spidered pages.

But I'm not disabling it. It's a pity there is no way in robots.txt to limit query frequency without total blocking.

howiejs

msg:30954

11:07 pm on Feb 22, 2004 (gmt 0)

Same story - Teoma hits new sites (right behind G-bot) - but NO traffic . ..

filo

msg:30955

5:23 pm on Feb 23, 2004 (gmt 0)

I had GIGS of transfer from the AskJeeves/Teoma bot in the past month or two and I have yet to be included in the index! Ridiculous.

pcgamez

msg:30956

12:58 am on Mar 5, 2004 (gmt 0)

same problem here. 12,000 requests in a 3-4 hour period. My mod_throttle actually kicked in.

Bobby_Davro

msg:30957

3:47 am on Mar 5, 2004 (gmt 0)

133K hits in January and 435K hits last month, all on one site. Total number of pages in Teoma: 0

I could say the same about AltaVista though.

Global Options:

top

home

open messages

active posts

Home / Forums Index / Search Engines / Ask - Teoma

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved

Ask - Teoma Forum