Forum Moderators: open

Message Too Old, No Replies

Fast PartnerSite Crawler

Part Two - Ammending Prior Post of Same Title

         

pendanticist

5:28 am on Mar 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



In this thread:

Fast PartnerSite Crawler Question [webmasterworld.com]

heini said:

Yup, that's the partnersite crawler, should come in from 66.77.73.107
Guess you payed someone, right?

While there is no follow-up from the original poster, I'd like to mention that 'FSP' has just finished crawling my domain and that I've never paid for submission.

On the other hand, I've been listed with most of these engines for better than five years now, so maybe I'm grandfathered in?

<shrug>

Pendanticist.

heini

5:05 pm on Mar 6, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hmm, in my logs the Partnersite crawler only shows for PFI pages.
But perhaps the bot is underemployed, or they run it for testing purposes.
>grandfathered
Now that would imply your pages are getting refreshed constantly, crawled on average each 48 hours or so.