Forum Moderators: DixonJones
Am I correct in assuming that password protected directories, by definition, block robots and download agents so it is unnecessary to disallow these directories in robots.txt?
Thanks
anyone?