Welcome to WebmasterWorld Guest from 54.145.23.244

Forum Moderators: open

Message Too Old, No Replies

Is there a Fast robot for images?

Looking for a name to use in robots.txt

     
5:53 pm on Jul 9, 2002 (gmt 0)

Junior Member

10+ Year Member

joined:Apr 3, 2002
posts:96
votes: 0


Does Fast have a special robot that requests images?

This is a quick question because I am only asking about a robot that can be disallowed in robots.txt

Thanks.

6:45 am on July 10, 2002 (gmt 0)

New User

10+ Year Member

joined:July 10, 2002
posts:5
votes: 0


Hi, this is Stig from FAST.

We do have a crawler for images and other formats, it is using the agent string "FAST/WebCrawler-3.x Multimedia".

- Stig

7:41 am on July 10, 2002 (gmt 0)

Junior Member

10+ Year Member

joined:Apr 3, 2002
posts:96
votes: 0


Thank you. I think this is what I am looking for. But will this work?

User-agent: FAST/WebCrawler-3.x Multimedia
Disallow: /

Or do I have to write this some other way?

Thanks again.

8:16 am on July 10, 2002 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 27, 2001
posts:392
votes: 0


Hi Stig

I had not noticed you around here before. Welcome.

9:46 pm on July 10, 2002 (gmt 0)

New User

10+ Year Member

joined:July 10, 2002
posts:5
votes: 0


Misosoph: yes, that robot.txt file should work. Please note that your robots.txt file changes won't apply until we re-fetch that file. This should not take longer than three to four days.

- Stig

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members