| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|Problem with my robots meta tag|
Will Googlebot come back??
Recently, without realizing it, I had placed an faulty robots meta tag in the pages on two new websites.
I put <meta name=robots conteXt="index,follow"> instead of <meta name=robots conteNt="index,follow">
In both cases, the Googlebot visited and indexed the default.asp a few weeks ago, but hasn't been back to index the rest of the pages since.
I expect this is due to the little error I made. In the meanwhile I corrected it.
Will Googlebot be back to re-index the default.asp pages thus finding the error corrected and indexing the rest of the pages anyway. Or am I in a whole lot of trouble now?
I doubt you're in any trouble at all, just work on getting more links to your site, Google will check it out again.
I don't think you have anything to worry about.
The default behaviour, given no robots.txt or valid robots meta tag is to index pages and follow links, at the crawlers discretion;
Now you say default.asp has been indexed by Google, which would imply that Google has not made any assumption about the content of your broken robots meta tag.
Plus, there have been many threads here recently about Googlebot taking an index page and not coming back for weeks/months for anything more.
Just seems to be part of the way it works these days.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved