Welcome to WebmasterWorld Guest from 54.145.183.207

Forum Moderators: open

Is there a Fast robot for images?

Looking for a name to use in robots.txt

   
5:53 pm on Jul 9, 2002 (gmt 0)

10+ Year Member



Does Fast have a special robot that requests images?

This is a quick question because I am only asking about a robot that can be disallowed in robots.txt

Thanks.

6:45 am on Jul 10, 2002 (gmt 0)

10+ Year Member



Hi, this is Stig from FAST.

We do have a crawler for images and other formats, it is using the agent string "FAST/WebCrawler-3.x Multimedia".

- Stig

7:41 am on Jul 10, 2002 (gmt 0)

10+ Year Member



Thank you. I think this is what I am looking for. But will this work?

User-agent: FAST/WebCrawler-3.x Multimedia
Disallow: /

Or do I have to write this some other way?

Thanks again.

8:16 am on Jul 10, 2002 (gmt 0)

10+ Year Member



Hi Stig

I had not noticed you around here before. Welcome.

9:46 pm on Jul 10, 2002 (gmt 0)

10+ Year Member



Misosoph: yes, that robot.txt file should work. Please note that your robots.txt file changes won't apply until we re-fetch that file. This should not take longer than three to four days.

- Stig

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month