Page is a not externally linkable
jdMorgan - 3:19 pm on Oct 21, 2003 (gmt 0)
Welcome to WebmasterWorld [webmasterworld.com]! > I am, however, looking at a huge robots.txt file. It's not small. It's large. Very. How large? I used to have one that was about 16kB in size, and had no problems. I'd suggest e-mailing FAST and asking them about any specific cut-off size. Just to be sure: Robots.txt Validator [searchengineworld.com] A few suggestions: Put your robots.txt on a diet [webmasterworld.com] Jim
WyrdoManx,