Complete List of Yahoo Crawlers IPs addresses to block them !

How to definitively block yahoo slurp bots?

[oliondor]

Complete List of Yahoo Crawlers IPs addresses to block them ! How to definitively block yahoo slurp bots ?

Hi,

Do you know the complete list of yahoo crawlers IP addresses ?

They start by 72.30. and it seems that yahoo is using so many addresses that i had to block all (deny from 72.30.).

But i would like to find the exact list of yahoo ips if possible.

I can't believe that this useless search engine is accessing my websites so often and so fast !

Thank you.

[wilderness]

Yahoo for the most part complies with robots.txt.

Rather than denying the IP ranges, it would be much easier to deny the UA's.

RewriteCond %{HTTP_USER_AGENT} (Yahoo¦Slurp¦Inktomi) [NC,OR]

(Above line requires correction of broken pipe-characters by fourm)

This list shows a Feb Update [iplists.com]