Yet another Yahoo spider UA

Appears to be for .de search

[jdMorgan]

72.30.142.24 - - [18/Mar/2006:16:53:27 -0500] "GET / HTTP/1.1" 403 541 "-" "Mozilla/5.0 (compatible; Yahoo! DE Slurp; [help.yahoo.com...]

IP address checks out to Yahoo (Inktomi).

Like Yahoo! Slurp China, it cannot be separately-controlled by robots.txt.

Jim

[Pfui]

Thanks for the head's up! "Mozilla/5.0 (compatible; Yahoo! Slurp China; [misc.yahoo.com.cn...] has been a real pain, so here's hoping this second country specific-variation isn't a harbinger of more to come (but I wouldn't be surprised).

I used to block all Yahoo/Y!/inktomisearch.com/etc. crawls then opened things up to see whether or if people were using Yahoo to search. After a few months, I'd say the crawlers' bandwidth far exceeds that of visitor referrals.

Hmm. May have to rethink my current open-door policy towards Yahoo's many, many, many bots. To date, I've counted at least 10 differently named ones. Enough already!

[Mokita]

I've just seen the Slurp China bot in our sites for the first time. We don't need or want traffic from China so I've blocked it from .htaccess.

As you say, I'm sure that the bandwidth consumed by Slurp bots far exceeds the visitor referrals from Yahoo.