Forum Moderators: Robert Charlton & goodroi
Thanks,
Roberto.
A "Disallow" rule in robots.txt will tell Google not to request the url.
in other cases my web server tries to answer anyway causing performance problems
To be qhort about it - you need to fix that. If it's extremely complex, then these urls are immediate candidates for a robots.txt disallow.