Page is a not externally linkable
lucy24 - 2:30 am on May 27, 2011 (gmt 0)
I remember when I discovered this by accident (investigating Metacrawler, I think), and didn't mention it because I assumed it was something everyone else already knew. Oops. I call them Yahoo/Bing to distinguish from g###.
Can anyone hazard a guess why both robots (bingbot and Yahoo! Slurp from separate IPs) are still working in tandem, when they're both feeding into the same results?