Freshbot: Taking longer to add pages suddenly?

[hitchhiker]

I might be jumping the gun, but my new (waiting index entry in this update) sites are not being picked up by freshbot as much this week.

I checked with another admin and he's seeing the same. Until a week ago it would take a day or so till I saw them in the SERPS. Now longer, if at all.

[jimbeetle]

Hey hitchhiker,

You have to keep in mind that freshbot doesn't come out all the time, only when its keepers decide to open the cage door.

GoogleGuy is still referring to freshy as something of an experiment and that it isn't always out roaming.

Jim

[hitchhiker]

It's been all over my server, it hits daily and hard, but lately the time from crawl->serp has increased.

This is one of the few variables we have to work with on isolating patterns, i'm just wondering if anyone else noticed it?

Clarified: The time taken from when a new URL on a non-indexed site is crawled to when it appears in any serp.

[jimbeetle]

Sorry, didn't understand you the first time around. But then the answer is almost the same. Doesn't appear to be any fresh tags today and I think I remember a similar WW thread from a couple of days ago.

Probably just one of those times was google isn't listing any freshbot results. GG did say that they use it whenever they want or have some tinkering to do and that it isn't something you can depend on.

[austtr]

Seem to be seeing a similar scenario.... a new site went online at end Feb, was visited by deep bot on 19th & 20th March, the fresh bot called on 6th April just for robots.txt and the index.htm.

A search on the unique domain name shows no results found in the Google index. I can't recall any previous site taking so long to appear.

[hitchhiker]

I just checked again now, the sites that I had in the index got spidered by fresh in the last few days and put in the serps, the ones that weren't have only had robots.txt visited

(previously they were crawled daily and entered into the serps the following day). I also, cannot recall, when it took this long.

Freshbot's sudden impotentence! It just cant get the pages up :)

[jimbeetle]

This thread [webmasterworld.com] has a discussion on current freshbot activity and fresh tags. Some folks have seen some fresh tags as recently as the 6th and 7th. On searches I've done this am (somewhat competitive terms) have seen one fresh tag and that's from the 7th.

Just keep 'em fresh until G starts tagging them again.

[hitchhiker]

Yep, been reading that, however I'm really just trying to find the pattern between sites indexed, and sites not:

Time it's taking for non-indexed sites from crawl -> SERP
(which appears to have increased for the last 5 days by my estimation)

-Freshy is on my non-indexed sites, but not SERPing new pages.

-Freshy is also on my sites indexed, and they are acting normally, new pages appearing in the SERPs within 48 hours.