Welcome to WebmasterWorld Guest from 126.96.36.199
This is a quick question because I am only asking about a robot that can be disallowed in robots.txt
We do have a crawler for images and other formats, it is using the agent string "FAST/WebCrawler-3.x Multimedia".
User-agent: FAST/WebCrawler-3.x Multimedia Disallow: /
Or do I have to write this some other way?
I had not noticed you around here before. Welcome.
Become a Pro Member