Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Problem with my robots meta tag

Will Googlebot come back??

9:41 pm on Oct 10, 2003 (gmt 0)

New User

10+ Year Member

joined:Oct 10, 2003
votes: 0

Hi all,

Recently, without realizing it, I had placed an faulty robots meta tag in the pages on two new websites.

I put <meta name=robots conteXt="index,follow"> instead of <meta name=robots conteNt="index,follow">

In both cases, the Googlebot visited and indexed the default.asp a few weeks ago, but hasn't been back to index the rest of the pages since.

I expect this is due to the little error I made. In the meanwhile I corrected it.

Will Googlebot be back to re-index the default.asp pages thus finding the error corrected and indexing the rest of the pages anyway. Or am I in a whole lot of trouble now?


9:57 pm on Oct 10, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 3, 2002
votes: 0

I doubt you're in any trouble at all, just work on getting more links to your site, Google will check it out again.
9:57 pm on Oct 10, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 3, 2003
votes: 0

I don't think you have anything to worry about.

The default behaviour, given no robots.txt or valid robots meta tag is to index pages and follow links, at the crawlers discretion;

Now you say default.asp has been indexed by Google, which would imply that Google has not made any assumption about the content of your broken robots meta tag.

Plus, there have been many threads here recently about Googlebot taking an index page and not coming back for weeks/months for anything more.

Just seems to be part of the way it works these days.