CDI Corporation

64.94.199.9

[wilderness]

"Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)"
Read robots however doesn't identify itself as a bot. Which is a violation of site TOS.

I don't care for the title implications of the back bone and have denied their entire blocks.

[jdMorgan]

wilderness,

What are you objecting to about "the backbone"? Is it the "InterNAP" part? - what is that?

Basically, I don't get it, please explain.

Company info [yahoo.marketguide.com]. I wonder why they bother to read robots.txt if they use a browser UA? I usually don't care to wait around for them to try using robots.txt as a shopping list either, except that most bad 'bots will get whacked by the spider trap pretty quickly anyway... :)

Thanks,
Jim

[wilderness]

Jim,
"Internap Network Services" to me implies intranet :-(
Course I have a distorted interpeation of most of the english language :-)