Page is a not externally linkable
Adam_C - 11:30 am on Mar 11, 2003 (gmt 0)
Here's something interesting... A site I put up about 10 days ago seems to have been included in the recent update, but has only been crawled by freshbot - the 64's. Anyone got any experience of this happening? Or is this a fresh listing without a date? Or something else? [edited by: Adam_C at 1:07 pm (utc) on Mar. 11, 2003]
From the Deepbot/Freshbot FAQ [webmasterworld.com]: 4. How do you tell the difference between the deepbot and the freshbot.
The deepbot and the freshbot uses different IPs.
The Deepbot uses IPs which run from 216.*
and the Freshbot uses IPs which start with 64.*