hi in my live site robot.txt was wrongly added for disallowing all spiders not to crawl my site. can you please tell me what problem it can create for my site. as this file was there from last seven days on my site.
please reply....
ncw164x
11:39 am on Nov 9, 2004 (gmt 0)
It would block all spider for the last 7 days from accessing your site, now the block has been removed next time you have a robot visit it should spider your site again
Have you noticed any pages removed from any of the search engines?