Page is a not externally linkable
ciml - 12:47 pm on Jun 28, 2002 (gmt 0)
Googlebot will grab 100k, so I wouldn't worry about it being just the 1st 100 lines. WebGuerilla: Definitely, but Googlebot can trip even on valid HTML such as > appearing in attribute values (at least it did a few weeks ago when last I checked).
egomanica:
> Because of this, some believe that spiders don't always spider the entire page...
> Code that validates dramatically reduces the chances that there will be an error when the document is parsed.