Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: goodroi
Going to stop a robot that obeys robots.txt indexing something like this: dynamicpage.asp?something=something
I'm assuming that it will, but just want to make sure. Thanks.
That may not stop anything at all... But hopefully, the missing ":" after "User-agent" was a typo. :)
Will stop any robot that obeys robots.txt from indexing something like this: dynamicpage.asp?anything