crobb305 - 12:58 am on Mar 12, 2011 (gmt 0)
I need some help removing some redirect urls with old attached parameters from Google, and try to encourage Google to stop crawling nonexistent urls (and hopefully my redirect file altogether).
I use a php redirect script to house my affiliate links. Over the years, some parameters have come and gone, yet Google continues to index them (despite denial in robots.txt) and Google keeps trying to crawl them (despite being served 404). In my WMT account, I see dozens of these old urls, in the format http://www.example.com/go/go.php?url=someoldparameter
At the current time, my go.php? file contains only about 5 valid affiliate links, so there is no need for Google to keep trying to crawl old ones that were deleted a year ago.
A) Should I serve a 410 for each parameter?
B) If I serve a 410, I assume I would list these one by one in htaccess?
C) Can I add a "noindex" in the go.php file to stop all future crawling/indexing of these redirects since my denial in robots.txt has proven insufficient?
Thanks in advance for your help