| 11:04 pm on Dec 27, 2004 (gmt 0)|
User-agent: psbot (picsearch)
Don't know about AJ.
| 11:53 pm on Dec 27, 2004 (gmt 0)|
Is there any point in not Disallowing the images folder? I thought the bots were interested only in text.
| 12:25 am on Dec 28, 2004 (gmt 0)|
The image-bots are interested in images. That's sorta the point of image-bots.
| 3:17 am on Dec 28, 2004 (gmt 0)|
psbot appears to be ignoring my robot.txt file. Has anyone out there noticed this?
I'll double check everything and report back in a couple of days.
| 11:49 am on Dec 28, 2004 (gmt 0)|
stapel, bear with me, I am still learning about bots. What is the purpose of an images bot - and what do they latch on to? As I see it, the image has a file name only, which doesn't mean much. Do the bots link the file name to the alt text in the HTML file? And anyway, why deny bots access? If images are confidential, there does not seem much point having them on a web site (other than a secure one).
Not tyring to be argumentative, just trying to learn.
| 2:10 pm on Dec 28, 2004 (gmt 0)|
The purpose of an image-bot is to harvest images. They latch onto images, as well as surrounding text which may be helpful in returning hits to return in image searches.
Images don't have to be confidential for the creator not to want them included in a "go ahead and nick any of these images" search engine.
| 5:17 pm on Jan 2, 2005 (gmt 0)|