Hi,
When I do a search in my site such as:
site:firstname1lastname1.example.com firstname1 lastname1
I am getting results with multiple subdomains in them such as
firstname1lastname1.firstname2lastname2.firstname3lastname3.example.com/index.php?option=com_jfbconnect&task=loginFacebookUser&return=L2xhdGVzdC1vbmxpbmUtbWVtb3JpYWwtd2Vic2l0ZXM=
A description for this result is not available because of this site's robots.txt – learn more
I have about 5 pages of these results showin in google. So what i did is I have an htaccess rule that would automatically redirect to the firstname1.lastname1.example.com and in that page i have a Google No Follow - No Index Code so that these are removed from index.
However I noticed that they are still showing and they are not being removed. If i click on it i get a 500 error.
Do I need to take off the Disallow rule in my robots.txt so the crawler crawls them again?
I Have Disallow /index.php
Should I use another Disallow Rule and remove /index.php
Should I even have that disallow Rule in the first place? Cant we use the URL parameters tool in Webmaster tools to tell google not to crawl them.
