homepage Welcome to WebmasterWorld Guest from 50.19.155.235
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
Subscribe to WebmasterWorld

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library : Charter : Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
My website all pages are in cache but home page are not caching
home page is not caching , what should i do for it?
pervezalam




msg:3743184		 4:33 am on Sep 12, 2008 (gmt 0)

Dear All,

My website was ranking well, but last few days ago due to some mistake robots.txt had restricted my website home page www.example.com.au , after it i have allowed it in robots.txt file but home page are not indexing yet, all page are crawling properly, I have done lots of work to crawl my home page, but it is not crawling what should i do now? to index my home page www.example.com.au again?

Waiting for expert suggestion ?

Webmaster
www.example.com.au

[edited by: goodroi at 1:27 pm (utc) on Sep. 12, 2008]
[edit reason] Please no personal URLs [/edit]

 

goodroi




msg:3743481		 1:33 pm on Sep 12, 2008 (gmt 0)

Welcome to WebmasterWorld pervezalam!

If you accidentally blocked the search engines from accessing your home page with robots.txt you do not need to worry since the search engines will try to revisit it again. It is important to make sure you correct the robots.txt file to allow your home page to be accessed. You may encounter some temporary issues with your search engine rankings but in my experience it is very minor (assuming you quickly corrected the bad robots.txt). This should not cause any long lasting problems.

ripejuice




msg:3751468		 6:43 pm on Sep 24, 2008 (gmt 0)

As stated by goodroi, the .problems caused due to robots.txt are temporary and they don't have long term effects.
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved