Welcome to WebmasterWorld Guest from 54.167.85.221

Message Too Old, No Replies

Google Penalty on no-index / no-follow pages?

     

Panoramic

10:44 pm on Aug 29, 2014 (gmt 0)



The question I have is relatively straightforward. Would Google penalize a website for potential violations on pages that contain no-index and no-follow meta tags?

A client of mine runs a photograph site and was forced to de-index the overwhelming majority of their site in the wake of Panda 4.0. At this time the only pages indexed are the main page and the category pages. Originally they had a mobile redirect advertisement on the main page. Mobile users would redirected to the App Store or an alternative website. While Google certainly frowns upon redirects of this sort, would it be acceptable on pages these no-index / no-follow pages given that Google should not be crawling / indexing these pages in the first place?

not2easy

5:21 am on Aug 30, 2014 (gmt 0)

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



A noindex tag does not prevent crawling, so if a visitor can navigate to the pages, it will be crawled. You could block crawling in robots.txt but I can't say that would prevent penalties.

Panoramic

8:12 am on Aug 30, 2014 (gmt 0)



Thanks for clarifying not2easy. The pages are also disallowed within the robots.txt file.

not2easy

1:56 pm on Aug 30, 2014 (gmt 0)

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



If you have disallowed crawling before the bot has crawled the pages since the noindex tag was added, the bot will continue to consider the pages as "index, follow" because they can't see that you have added a noindex tag.

When you change a robots metatag to noindex, you need to wait until it has been crawled, then you can block it in robots.txt.

Panoramic

1:17 am on Aug 31, 2014 (gmt 0)



Thanks no2easy the order of actions is certainly important. I actually manually removed all the pages in question utilizing Google Webmaster Tools.

Now what is everyone's opinions regarding potential penalties on pages that have been blocked in the robots.txt file and additionally have no-index / no-follow meta tags?

Martin Ice Web

7:37 am on Aug 31, 2014 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member Top Contributors Of The Month



@panoramic, i thought sbout it too and in regard of panda, geevil says it is a way to come out of panda by noindex low and shallow pages. I don't know if it realy works for redirects. I would say that this is a more severe violation against their guidelines (that certainly don't account for big brands and geevil itself)

not2easy

3:42 pm on Aug 31, 2014 (gmt 0)

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



I actually manually removed all the pages in question utilizing Google Webmaster Tools.

This removes those pages from the index immediately. You have added the noindex metatag to prevent indexing, good move. But you should not block those pages in robots.txt or they cannot see the noindex metatag. Manually removing pages is temporary and blocking in robots.txt should not be done until you are sure they have crawled those pages with the noindex tag.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month