Welcome to WebmasterWorld Guest from 54.226.246.160

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Why block a Spider?

     

Bobby79

11:58 am on May 17, 2001 (gmt 0)



Why would anyone block spiders, i thought they where good?

Hope

12:40 pm on May 17, 2001 (gmt 0)

10+ Year Member



There are several reasons you would block a spider. Some spiders take up too much of your bandwidth. Sometimes you don't want spiders in some areas of you site. Your site may only be relevant for one country and you don't want the site listed if search engines of other countries.

wangdy

12:50 pm on May 21, 2001 (gmt 0)

10+ Year Member



Hi,
Although this might be off topic... how do you go about creating a spider? Just curious..
Thanks!
 

Featured Threads

Hot Threads This Week

Hot Threads This Month