| Welcome to WebmasterWorld Guest from 220.127.116.11 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
|Disallow indexing on dynamic files|
Disallow indexing on dynamic files
On my website, I have a few dynamic pages generated using one file. Say x.cfm.
So the resulting dynamic pages are:
You get the idea.
How do I disallow the search engines from indexing any link with x.cfm? I'd appreciate the full correct code since I don't know much about robots.txt formatting.
Hello premzero, Welcome to WebmasterWorld!
That should do it.
Validate your robots.txt file here...
robots.txt Validator [searchengineworld.com]
|I'd appreciate the full correct code since I don't know much about robots.txt formatting. |
Open up Note Pad. Cut and paste the code above into NP. Do a save as robots.txt. Upload to the root level of your web. It must reside in the root level, the URI should look like this...
Sorry I've been away.
Thanks for the reply. I'm implementing it right away!
what permissions to give the robots.txt 755?
644 should suffice
|what permissions to give the robots.txt 755? |
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved