Teoma/Ask jeeves has problems! Until further notice, they are banned from my sites! Their spider has problems... it requests too much, and I suspect it requests files in such a way as to crash the server.
EliteWeb
5:58 pm on Aug 27, 2003 (gmt 0)
Check the programming for your site, if a simple spider crashes your server the pages being served have bugs in it. If its standard HTML blame the web server. If its coding then check the code and stress test the server. Think if your site was on CNN or slashdot one day, it would be down in less than a second from the traffic. :D
If it does pass varaibles or does anything server side check for alternative methods of doing so, if your using a premade package check for updates, fixes and patches.
sidyadav
10:11 pm on Aug 30, 2003 (gmt 0)
Ask Jeeves/Teoma Bot works fine on my site, In fact , It requests less than Googlebot and FAST!
cyberprosper
11:58 am on Sep 8, 2003 (gmt 0)
The site's are not perfect, I know this. However, no other bots caused the same problems. In fact, google requests far more pages. It actually does not really matter. I have had no problems since I blocked the teoma robot. And, I do not seem to be missing the 10 visitors a day I used to receive from them.
