Welcome to WebmasterWorld Guest from 54.147.237.64

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt syntax

spaces or slashes?

     
8:20 am on Feb 27, 2003 (gmt 0)

Moderator from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:7767
votes: 265


Not sure how to write this new UA to disallow list.

User-agent: ISSB Website Loader 1.1.29
Disallow: /

Is this correct, or should I use slashes to account for the spaces, example:

User-agent: ISSB/Website/Loader/1.1.29
Disallow: /

thanks

9:01 am on Feb 27, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 4, 2002
posts:1314
votes: 0


Write spaces as spaces.

Take a look at WebmasterWorld's robots.txt for lots of examples.

Use:
[searchengineworld.com...]
to validate your robots.txt

5:14 pm on Feb 27, 2003 (gmt 0)

Moderator from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:7767
votes: 265


Thanks victor, I am aware of searchengineworld.com's robotcheck, however the file will validate either way so it's not much help.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members