Welcome to WebmasterWorld Guest from 54.162.227.136

Forum Moderators: goodroi

Message Too Old, No Replies

Ask Jeeves Question

Need to ban a bot

     
7:10 am on Dec 1, 2004 (gmt 0)

10+ Year Member



Hi,

I need to ban Ask Jeeves, its indexing my site like crazy but never sends much traffic and its hammering the database. can someone help me with the right user agent string for the robots.txt file so I can ban the thing, or at least slow it down a LOT.

Thanks

10:13 am on Dec 1, 2004 (gmt 0)

10+ Year Member



Try this one

User-agent: Teoma
Disallow: /

User-agent: *
Disallow:

 

Featured Threads

Hot Threads This Week

Hot Threads This Month