Welcome to WebmasterWorld Guest from 188.8.131.52
is this going to be enough to exclude robots from a dynamic page?
User-agent * Disallow: /dynamicpage.asp
Going to stop a robot that obeys robots.txt indexing something like this: dynamicpage.asp?something=something
I'm assuming that it will, but just want to make sure. Thanks.
That may not stop anything at all... But hopefully, the missing ":" after "User-agent" was a typo. :)
User-agent: * Disallow: /dynamicpage.asp
Will stop any robot that obeys robots.txt from indexing something like this: dynamicpage.asp?anything
Become a Pro Member