lucy24 - 7:22 am on Nov 10, 2012 (gmt 0)
I also added to my robots.txt files my email address ( is that useful, I am afraid google passes PR to the email address )
as well as a .pdf ( is it also useful )
Say what now?
robots.txt is for naming directories on your site that you don't want to have crawled by good robots. Bad robots don't read robots.txt -- or they do read it and head straight for the listed directories -- so you have to 403 them.
I'm guessing there are certain directories used internally by joomla that it doesn't want to have crawled, so it comes with its own robots.txt to go with its own htaccess. This presumably overwrites your own pre-existing robots.txt, so I hope you kept a backup.