Namaste - 11:28 pm on Mar 9, 2005 (gmt 0)

I'm not seeing this in the thread: benefits of tailoring keywords and other data to bots.

Whoever made that page, did it because they concieved a benefit. Very often I too like to put data for internal bots, but avoid it because it may do some search engine spider wrong.

In my company there are around 50 people working on pages. It's very hard sometimes to ensure that everybody is up with the latest "rules" dictaed by search engines. I've had to enforce strict version control processes to ensure that all pages meet these "rules". The process has a cost element of it's own.

I think it's time, search engines developed a mature system of flagging sites for cloacking and other misdemeanors.