My website was ranking well, but last few days ago due to some mistake robots.txt had restricted my website home page www.example.com.au , after it i have allowed it in robots.txt file but home page are not indexing yet, all page are crawling properly, I have done lots of work to crawl my home page, but it is not crawling what should i do now? to index my home page www.example.com.au again?
Waiting for expert suggestion ?
[edited by: goodroi at 1:27 pm (utc) on Sep. 12, 2008] [edit reason] Please no personal URLs [/edit]
If you accidentally blocked the search engines from accessing your home page with robots.txt you do not need to worry since the search engines will try to revisit it again. It is important to make sure you correct the robots.txt file to allow your home page to be accessed. You may encounter some temporary issues with your search engine rankings but in my experience it is very minor (assuming you quickly corrected the bad robots.txt). This should not cause any long lasting problems.