Forum Moderators: goodroi

Message Too Old, No Replies

Banning AskJeeves Bot

Need to ban askJeeves

         

Marcus Aurelius

7:50 pm on Aug 27, 2005 (gmt 0)

10+ Year Member



Ask is just totally slamming my site for pages and sends almost no traffic to the site. Anyone know a simple way I can ban this bot or at least slow the thing down, its crushing some of the more complex db pages.

Thanks!

jdMorgan

8:31 pm on Aug 27, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



From the Ask Jeeves Crawler information page -- URL included in their User-agent string:

Can I control the crawler request rate from Teoma [Ask Jeeves] spider to my site? [sp.ask.com]

Jim