Forum Moderators: open
This is the first time I've seen this UA. Normally I like Baidu and let it crawl my sites. Everything about this UA seems valid. However it did not read robots.txt.
Has anyone else seen this UA and if so what's your opinion of it?
Thanks. :)
Personally, I can relate a story which was responsible for all my websites images (around 5k) being numbered, rather than named and being placed in an image folder which bots are not tolerated. (even non-bots spidering images are easily spotted today).
Before the aforementioned solution implementation, I had a a nothing image (however unique) named widgets.
Many folks searched for widgets.jpg and lo and behold thousands of visitor arrived daily to view this image. NOT my page content and not ANY page content.
As a result, what possible benefit was it to myself or my websites to make this image available? (rhetorical)
Don
I suppose. . .there are specific instances where webmasters (photographers or artists especially) would prefer to have their images spidered and archived outside of their own website?