homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

My website all pages are in cache but home page are not caching
home page is not caching , what should i do for it?

5+ Year Member

Msg#: 3743182 posted 4:33 am on Sep 12, 2008 (gmt 0)

Dear All,

My website was ranking well, but last few days ago due to some mistake robots.txt had restricted my website home page www.example.com.au , after it i have allowed it in robots.txt file but home page are not indexing yet, all page are crawling properly, I have done lots of work to crawl my home page, but it is not crawling what should i do now? to index my home page www.example.com.au again?

Waiting for expert suggestion ?


[edited by: goodroi at 1:27 pm (utc) on Sep. 12, 2008]
[edit reason] Please no personal URLs [/edit]



WebmasterWorld Administrator goodroi us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Msg#: 3743182 posted 1:33 pm on Sep 12, 2008 (gmt 0)

Welcome to WebmasterWorld pervezalam!

If you accidentally blocked the search engines from accessing your home page with robots.txt you do not need to worry since the search engines will try to revisit it again. It is important to make sure you correct the robots.txt file to allow your home page to be accessed. You may encounter some temporary issues with your search engine rankings but in my experience it is very minor (assuming you quickly corrected the bad robots.txt). This should not cause any long lasting problems.


5+ Year Member

Msg#: 3743182 posted 6:43 pm on Sep 24, 2008 (gmt 0)

As stated by goodroi, the .problems caused due to robots.txt are temporary and they don't have long term effects.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved