Welcome to WebmasterWorld Guest from 184.108.40.206
Forum Moderators: goodroi
For the list of spiders you don't like, you have to decide that yourself. I block:
vscooter (Altavista Images)
These are bots that attempt to cache my images, which I don't like. Other people block other bots.
I emailed fast and asked them how to stop the bot from collecting images but have it still collect html. They replied with the robots.txt code to disallow /.
I emailed google and asked them the same thing. One month later they introduced the google-image agent. Obviously Google cares about webmasters and fast doesn't.