Gene_B - 2:18 am on Jun 13, 2007 (gmt 0) I added Yahoo also blocks email from our shared mail server with:
I thought I was the only one with that problem. I have Apache Guardian sending me an email for every 40x error. The all are caused by yahoo slurp, most looking for invalid directories. example, I have example.org/folder1/page1.htm, slurp keeps looking for example.org/folder1/folder1/page1.htm. I issued a complaint and the reply was that sombody had a link to that url. WRONG! they are the only one. They said slurp obeys robots.txt, WRONG! I added
and slurp is still giving me errors.
to get rid of yahoo for a while.
Slurp is also using 10 times the bandwidth as Google!
X-YahooFilteredBulk: xx.xx.xx.xx but that is another nightmare story ..
Yahoo also blocks email from our shared mail server with: