homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

Problem with my robots meta tag
Will Googlebot come back??

10+ Year Member

Msg#: 17559 posted 9:41 pm on Oct 10, 2003 (gmt 0)

Hi all,

Recently, without realizing it, I had placed an faulty robots meta tag in the pages on two new websites.

I put <meta name=robots conteXt="index,follow"> instead of <meta name=robots conteNt="index,follow">

In both cases, the Googlebot visited and indexed the default.asp a few weeks ago, but hasn't been back to index the rest of the pages since.

I expect this is due to the little error I made. In the meanwhile I corrected it.

Will Googlebot be back to re-index the default.asp pages thus finding the error corrected and indexing the rest of the pages anyway. Or am I in a whole lot of trouble now?




10+ Year Member

Msg#: 17559 posted 9:57 pm on Oct 10, 2003 (gmt 0)

I doubt you're in any trouble at all, just work on getting more links to your site, Google will check it out again.


WebmasterWorld Senior Member 10+ Year Member

Msg#: 17559 posted 9:57 pm on Oct 10, 2003 (gmt 0)

I don't think you have anything to worry about.

The default behaviour, given no robots.txt or valid robots meta tag is to index pages and follow links, at the crawlers discretion;

Now you say default.asp has been indexed by Google, which would imply that Google has not made any assumption about the content of your broken robots meta tag.

Plus, there have been many threads here recently about Googlebot taking an index page and not coming back for weeks/months for anything more.

Just seems to be part of the way it works these days.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved