incrediBILL - 9:27 pm on Jun 9, 2007 (gmt 0)

I allready banned about 60 IP addresses linke those above. Can you please tell me what to do to limit the number of yahoo crwawlers on my website?

Why would you ban Yahoo IPs unless you don't want Yahoo traffic?

Yahoo AND Google use many IPs during their crawl, they aren't different crawlers, they are the same crawler unless the user agent changes.

For any major search engine you should only use ROBOTS.TXT to disallow the various crawlers, never block them by IP as you can totally destroy your search engine rankings.

[edited by: incrediBILL at 9:27 pm (utc) on June 9, 2007]