Neil_McRae - 11:26 pm on Jun 28, 2011 (gmt 0)
Originally posted by lucy24
Obvious question: has the site in fact changed since 2006?
Yes it has changed since then.
I made a robots.txt and I uploaded it to my root directory. That's the same directory in which I have my index.html file that my domain points to. The htaccess for that directory is empty.
The robots.txt file I made says:
No spaces after the asterisk on first line.
One space on second line after disallow.