Forum Moderators: open
[webmasterworld.com...]
The Standard is NOT using the slash or anything after it which would result in "Netscape"
Did this tool read robots? I kinda doubt it?
Your more likley going to need to resolve this in your htaccess.
SetEnvIf ^Netscape/PICgrabber keep_out (or what ever you use instead)
Don
To clarify one point, I did not mean to imply that this user agent shouldn't be blocked with
Disallow: Netscape/PICgrabber
What I meant was, don't bother using something like
Disallow: NastyBot/1.2.3B
because then all they have to do is change the version number and come back, thus avoiding a technical violation. And, of course, trying to keep up with version numbers just increases your workload.
Jim
Spoofed Internet Explorer or Googlebot gets listed by themselves, not in with the valid UAs. Many Opera users do this (for whatever reason?) so my stats for Opera aren't accurate; seems self defeating since they are always boasting how many users have switched to Opera, but that's OT ;)