homepage Welcome to WebmasterWorld Guest from 54.167.174.90
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Googlebot not obeying noindex, nofollow META Robots Tags.
jason76

5+ Year Member



 
Msg#: 35024 posted 5:16 pm on Jun 30, 2006 (gmt 0)

I recently deployed a new site and Googlebot has not obeyed the noindex , nofollow META Robots Tags. As a consequence Google has indexed a lot of content on my site that I did not want indexed. How can I get Google to drop those pages and ignore them in the future?

 

GenerationTalk

5+ Year Member



 
Msg#: 35024 posted 9:18 am on Jul 3, 2006 (gmt 0)

Remove content from Googles index [google.com]

Where abouts have you placed your robot.txt file and what is the exact contents of the file.

You may havesimply made a mistake.

RichTC

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 35024 posted 9:41 am on Jul 3, 2006 (gmt 0)

Jason,

Frankly im finding on a number of sites that google is doing just about what it likes.

Not just ignoring no index, no follow robot tags etc but also its now reading files within java script etc.

Meanwhile googles attitude is kind of "Well if you dont want us to crawl your site we will take it out the index"

Bottom line is imo that you will have to either put up with the abuse of google ransacking everything on your pages OR get your site removed from its search.

Not much of an option!

M3Guy

5+ Year Member



 
Msg#: 35024 posted 10:45 am on Jul 3, 2006 (gmt 0)

G has been ignoring robots.txt and on page directives for a while now.

Best option, use rewrite to block the folder the pages are in

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved