| Welcome to WebmasterWorld Guest from 126.96.36.199 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
Hi. I have a multilingual site with directories that I wouldn't like to be indexed. URLs at my website look like this:
Will that work?
This should work for Google, but others, like Yahoo might have problems and it will most probably not work. Reason is, that this is not standardized robots.txt code.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved