ext9.vc.search.re2.yahoo.com GET /robots.txt

repeated up to 3x per sec

[arnarn]

Does it make any sense at all that yahoo would need to look at our robots.txt over and over again?

Maybe it just can't believe it's eyes! (i.e. we're NOT excluding them)

Are we doing something on our site to cause this perseveration?

.