Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Is there a Fast robot for images?

Looking for a name to use in robots.txt



5:53 pm on Jul 9, 2002 (gmt 0)

10+ Year Member

Does Fast have a special robot that requests images?

This is a quick question because I am only asking about a robot that can be disallowed in robots.txt



6:45 am on Jul 10, 2002 (gmt 0)

10+ Year Member

Hi, this is Stig from FAST.

We do have a crawler for images and other formats, it is using the agent string "FAST/WebCrawler-3.x Multimedia".

- Stig


7:41 am on Jul 10, 2002 (gmt 0)

10+ Year Member

Thank you. I think this is what I am looking for. But will this work?

User-agent: FAST/WebCrawler-3.x Multimedia
Disallow: /

Or do I have to write this some other way?

Thanks again.


8:16 am on Jul 10, 2002 (gmt 0)

10+ Year Member

Hi Stig

I had not noticed you around here before. Welcome.


9:46 pm on Jul 10, 2002 (gmt 0)

10+ Year Member

Misosoph: yes, that robot.txt file should work. Please note that your robots.txt file changes won't apply until we re-fetch that file. This should not take longer than three to four days.

- Stig


Featured Threads

Hot Threads This Week

Hot Threads This Month