- - Search Engines
- -- Search Engine Spider and User Agent Identification
- ---- SEOmoz Crawler/Bot
incrediBILL - 10:23 pm on Oct 8, 2008 (gmt 0)
|What does the 22GB decompress to? I couldn't find that information on the dotnetdotcom site. |
I do know the decompression tool claimed it would take about 4 hours to complete and we stopped it at 2 hours when it was obvious there was insufficient space.
It's in their "Download our index" section and I have no clue how big the file will be because so far none of us have had enough space to decompress it.
Short of heading out to buy a 1TB drive, I may never know.
Thread source: http://www.webmasterworld.com/search_engine_spiders/3759661.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com