Forum Moderators: open

Message Too Old, No Replies

CDI Corporation

64.94.199.9

         

wilderness

11:08 pm on Jan 15, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



"Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)"
Read robots however doesn't identify itself as a bot. Which is a violation of site TOS.

I don't care for the title implications of the back bone and have denied their entire blocks.

jdMorgan

11:23 pm on Jan 15, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



wilderness,

What are you objecting to about "the backbone"? Is it the "InterNAP" part? - what is that?

Basically, I don't get it, please explain.

Company info [yahoo.marketguide.com]. I wonder why they bother to read robots.txt if they use a browser UA? I usually don't care to wait around for them to try using robots.txt as a shopping list either, except that most bad 'bots will get whacked by the spider trap pretty quickly anyway... :)

Thanks,
Jim

wilderness

12:26 am on Jan 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Jim,
"Internap Network Services" to me implies intranet :-(
Course I have a distorted interpeation of most of the english language :-)