Msg#: 28263 posted 6:58 pm on Feb 23, 2005 (gmt 0)
Just curious if anyone is seeing the following phenomenon:
A single Google Freshbot (18.104.22.168) spiders my site daily taking thousands of pages however, the the pages are spidered based on the length of the URI (ie. [example.com...] where the keyword-phrase is the URI.
This particular bot is spidering the shorter URI's FIRST, then sequentially coming back for the longer mulit-phrase URI's. ie.