Forum Moderators: open

Message Too Old, No Replies

Fatlens

         

smokeybarnable

4:02 pm on Aug 30, 2006 (gmt 0)

10+ Year Member



How do I block the fatlens spider?

Mokita

9:52 pm on Aug 30, 2006 (gmt 0)

10+ Year Member



Have you tried disallowing it in robots.txt?

User-agent: Fatbot
Disallow: /

They claim to honour it:
[fatlens.com...]

If it has been ignoring robots.txt, then you'll probably need to use mod_rewrite in .htaccess to block it (if you are hosted on an Apache server that is).

ssgumby

5:37 pm on Sep 6, 2006 (gmt 0)

10+ Year Member



They do seem to honor the disallow .. I did this just the other day and have not seen them since.