Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Pages are ranking, in spite of robots.txt or robots meta tags


tigger - 11:11 am on Jun 2, 2006 (gmt 0)


thanks encyclo

If you do a very specific search then yes the pages are ranking - when I say raking the only page that comes up is mine

The idea was to stop G looking at these pages at all and I followed the ideas suggested here - TBH this is all very new for me as I've never tried to stop pages from getting crawled so if you wouldn't mind could you give me some more info regarding this as I'm completely out of my deep on this

>My solution to stopping all indexing in a particular directory was to use mod_rewrite to send 403 Forbidden messages to any Googlebot user agent visiting the excluded directory.


Thread source:: http://www.webmasterworld.com/google/34402.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com