Page is a not externally linkable
- Search Engines
-- Ask - Teoma
---- Deep Crawl.


XMLMania - 8:02 pm on Nov 22, 2004 (gmt 0)


Maybe the majority of the spidered pages by Googlebot was by the Mozilla 5.0 variant?

This bot supports HTTP/1.1 meaning it supports Gzip pages, sometimes upto 1/8th the transfer size of uncompressed pages.


Thread source:: http://www.webmasterworld.com/ask_jeeves_teoma/446.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com