Page is a not externally linkable
cyberdyne - 10:32 pm on Nov 19, 2009 (gmt 0)
I have just looked through my robots.txt as displayed by Google webmaster tools 'Crawler access' and it is cut off approximately 40% through. My robots.txt file is just 13kb Many thanks
Does Google only accept a robots.txt of a certain maximum length?