Welcome to WebmasterWorld Guest from 18.104.22.168
Not sure how to write this new UA to disallow list.
User-agent: ISSB Website Loader 1.1.29 Disallow: /
Is this correct, or should I use slashes to account for the spaces, example:
User-agent: ISSB/Website/Loader/1.1.29 Disallow: /
Take a look at WebmasterWorld's robots.txt for lots of examples.
Use: [searchengineworld.com...] to validate your robots.txt
Thanks victor, I am aware of searchengineworld.com's robotcheck, however the file will validate either way so it's not much help.
Become a Pro Member