I have a doorway page to count clicks made at links and to redirect to other site.
Let's say there are 2 sites. Site A.com and site B.com
I have a link at at A.com which looks like: A.com/target.php?parameters and then it goes to target.php counts what it should on the basis of parameter sent and then redirect the bage to B.com/otherlink.php?parameters
How can I dissalow reading target.php so I don't get banned from Google for using doorway pages if I use the right terminlogy.
Is it possible to put in in the META ROBOTS somehow.
I look for 404 errors with robots.txt files to see spider visits. There are of course easy way to filter robots.txt out of access_log but that is an easy way and I would prefer to put disallow in META ROBOTS of target.php somehow.