speedy 'lil freshbot

good boy.

[farside847]

I put together a few new pages on my PR5 site, and within 24 hours freshbot crawled them and they were added to the index and listed on google search results (www). I was pleasantly surprised since I had thought the deepbot was the only bot to follow new links and I would have to wait until the next update... is this new?

[trillianjedi]

No, this isn't especially new. But remember, those pages are not "in the index" - the freshbot listings kind of "sit on the top". It's all good though.

They may drop out after a couple of weeks, but don't worry when they do - they will get indexed properly next time around.

TJ

[jilla]

I have one site with pr5 that when I add new pages get picked up within a week... but I have 2 other ones that really don't get picked up..

Are there other factors involved? IE the number of pages linking to them? Thanks.

[skipfactor]

Are there other factors involved?

Freshbot, like humans, prefers fresh content; give him something new to look at every chance you get.

I recently discovered he seems to prefer low-digit session ids (on my site at least):

[webmasterworld.com...]