Welcome to WebmasterWorld Guest from 54.161.105.39

Forum Moderators: goodroi

Message Too Old, No Replies

Disallow indexing on dynamic files

Disallow indexing on dynamic files

     
1:29 am on Dec 10, 2003 (gmt 0)

New User

10+ Year Member

joined:Oct 13, 2003
posts:2
votes: 0


On my website, I have a few dynamic pages generated using one file. Say x.cfm.
So the resulting dynamic pages are:
/x.cfm?a=987&b=787
/x.cfm?a=987
etc...

You get the idea.

How do I disallow the search engines from indexing any link with x.cfm? I'd appreciate the full correct code since I don't know much about robots.txt formatting.

Thanks

1:37 am on Dec 10, 2003 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member pageoneresults is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Apr 27, 2001
posts:12172
votes: 60


Hello premzero, Welcome to WebmasterWorld!

User-agent: *
Disallow: /x.cfm?

That should do it.

Validate your robots.txt file here...

robots.txt Validator [searchengineworld.com]

1:48 am on Dec 10, 2003 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member pageoneresults is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Apr 27, 2001
posts:12172
votes: 60


I'd appreciate the full correct code since I don't know much about robots.txt formatting.

Open up Note Pad. Cut and paste the code above into NP. Do a save as robots.txt. Upload to the root level of your web. It must reside in the root level, the URI should look like this...

http*//www.example.com/robots.txt

4:59 am on Dec 16, 2003 (gmt 0)

New User

10+ Year Member

joined:Oct 13, 2003
posts:2
votes: 0


Sorry I've been away.

Thanks for the reply. I'm implementing it right away!

Cheers!

2:51 pm on Dec 25, 2003 (gmt 0)

New User

10+ Year Member

joined:Dec 25, 2003
posts:9
votes: 0


what permissions to give the robots.txt 755?
2:58 am on Dec 26, 2003 (gmt 0)

Administrator from JP 

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Oct 12, 2000
posts:14977
votes: 131


what permissions to give the robots.txt 755?
644 should suffice