homepage Welcome to WebmasterWorld Guest from 54.211.34.105
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Google Penalty on no-index / no-follow pages?
Panoramic



 
Msg#: 4698873 posted 10:44 pm on Aug 29, 2014 (gmt 0)

The question I have is relatively straightforward. Would Google penalize a website for potential violations on pages that contain no-index and no-follow meta tags?

A client of mine runs a photograph site and was forced to de-index the overwhelming majority of their site in the wake of Panda 4.0. At this time the only pages indexed are the main page and the category pages. Originally they had a mobile redirect advertisement on the main page. Mobile users would redirected to the App Store or an alternative website. While Google certainly frowns upon redirects of this sort, would it be acceptable on pages these no-index / no-follow pages given that Google should not be crawling / indexing these pages in the first place?

 

not2easy

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



 
Msg#: 4698873 posted 5:21 am on Aug 30, 2014 (gmt 0)

A noindex tag does not prevent crawling, so if a visitor can navigate to the pages, it will be crawled. You could block crawling in robots.txt but I can't say that would prevent penalties.

Panoramic



 
Msg#: 4698873 posted 8:12 am on Aug 30, 2014 (gmt 0)

Thanks for clarifying not2easy. The pages are also disallowed within the robots.txt file.

not2easy

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



 
Msg#: 4698873 posted 1:56 pm on Aug 30, 2014 (gmt 0)

If you have disallowed crawling before the bot has crawled the pages since the noindex tag was added, the bot will continue to consider the pages as "index, follow" because they can't see that you have added a noindex tag.

When you change a robots metatag to noindex, you need to wait until it has been crawled, then you can block it in robots.txt.

Panoramic



 
Msg#: 4698873 posted 1:17 am on Aug 31, 2014 (gmt 0)

Thanks no2easy the order of actions is certainly important. I actually manually removed all the pages in question utilizing Google Webmaster Tools.

Now what is everyone's opinions regarding potential penalties on pages that have been blocked in the robots.txt file and additionally have no-index / no-follow meta tags?

Martin Ice Web

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4698873 posted 7:37 am on Aug 31, 2014 (gmt 0)

@panoramic, i thought sbout it too and in regard of panda, geevil says it is a way to come out of panda by noindex low and shallow pages. I don't know if it realy works for redirects. I would say that this is a more severe violation against their guidelines (that certainly don't account for big brands and geevil itself)

not2easy

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



 
Msg#: 4698873 posted 3:42 pm on Aug 31, 2014 (gmt 0)

I actually manually removed all the pages in question utilizing Google Webmaster Tools.

This removes those pages from the index immediately. You have added the noindex metatag to prevent indexing, good move. But you should not block those pages in robots.txt or they cannot see the noindex metatag. Manually removing pages is temporary and blocking in robots.txt should not be done until you are sure they have crawled those pages with the noindex tag.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved