homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

How to disallow doorway pages from indexing?

 1:25 pm on Feb 25, 2004 (gmt 0)


I have a doorway page to count clicks made at links and to redirect to other site.

Let's say there are 2 sites. Site A.com and site B.com

I have a link at at A.com which looks like:
A.com/target.php?parameters and then it goes to target.php counts what it should on the basis of parameter sent and then redirect the bage to B.com/otherlink.php?parameters

How can I dissalow reading target.php so I don't get banned from Google for using doorway pages if I use the right terminlogy.

Thank you for your help

With regards




 8:08 am on Feb 26, 2004 (gmt 0)

If you want to completely disallow /target.php then add this to your robots.txt file :

Disallow: /target.php

Note that this will completely prevent spidering for that page, regardless of parameters used. If you do want it indexed for certain parameters, then this would not be a good idea.


 8:01 pm on Feb 26, 2004 (gmt 0)


Thank you for help.

Is it possible to put in in the META ROBOTS somehow.

I look for 404 errors with robots.txt files to see spider visits. There are of course easy way to filter robots.txt out of access_log but that is an easy way and I would prefer to put disallow in META ROBOTS of target.php somehow.

With regards



 2:30 pm on Mar 1, 2004 (gmt 0)


Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved