Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Google maximum characters robots.txt ?

cyberdyne - 10:32 pm on Nov 19, 2009 (gmt 0)


Does Google only accept a robots.txt of a certain maximum length?

I have just looked through my robots.txt as displayed by Google webmaster tools 'Crawler access' and it is cut off approximately 40% through.

My robots.txt file is just 13kb

Many thanks

Thread source:: http://www.webmasterworld.com/robots_txt/4028365.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com