Fresh Crawl

Advantages v. Disadvantages

[docdanger47]

My site was had gotten freshed crawled the past four days and were moving up for our major keywords. Then like magic, they disappeared when I went looking today. If this whole fresh crawl thing is going to work, it needs to be way more consistent.

[troels nybo nielsen]

Same thing happened to me. You shouldn't take this freshbot too seriously. It's a rather new feature and they are still experimenting with it.

[hightraffic10]

Yup same thing for me, I made major changes and saw major results and then nothing, take it for what it is worth, dont go selling the farm. The dance is where it will happen.

[ikbenhet1]

I have seen this happening today also. Everfluxing sites are gone today, probable will show up tomorrow or the day after that.

-Advantage, you will still get peeks in visitors now and then when the site is 'everfluxed' until the big 'update'

-Advantage, You know next month traffic from those urls that are everfluxing now will increase significantly when they get permenant listing after 'update'

I really hope this update, will be a good one, because i haven't forgot what happened last month.
I still can't see the backlinks for sites that rank about the same as they always do and until now always shown their backlinks and now suddenly they dont show up anymore. Hope this won't happen again, i don't understand why it happend in the first place.

[docdanger47]

ikbenhet1, thanks for the informative inout. It certainly sets my mind at ease.

[rfgdxm1]

Personally I think the Google Freshbot exists just to keep webmasters in a total state of fear and paranoia. The "Big Google is watching YOU" strategy. ;)

[europeforvisitors]

I have some new pages from earlier in the month that made it into the index, then disappeared. In the meantime, newer fresh-crawled pages have made it into the index and are currently showing up in search results.

I think this is pretty normal, and past experience suggests that all the pages will be in the index (with PageRank calculated) after the end-of-the-month update.

[Tropical Island]

This may explain part of it. You make changes to yor site. The freshbot visits and gives you a fresh tag for a few days. Then it returns and finds the same info. No more fresh tag and a temporary loss of posistion.

We update content on our home page every day and as a result we have been getting a new fresh tag daily for the last week or so.

[lazerzubb]

As GoogleGuy stated, see it as a plus on your site [webmasterworld.com]

It's not something that you should take for granted, and i don't think they produced it so webmasters would see their pages ranking higher, the main focus for them is to present the freshest information on the web.

And so far when i see the "fresh tag" next to my site, i just say, well thanks Google for presenting as fresh results as you can, that helps me as a search a lot (Google's main goal is to satisfy the user, not the SEO webmaster ;) )

[Grumpus]

This whole freshness thing in Google has opened up a whole new area in optimizing your site. In the past, right before the crawl starts, I've always grabbed Mr. Peabody, slapped the Wayback Machine into reverse, and moved myself a month into the future and tried to anticipate which keywords were going to be "hot" at the time of the next update. In some ways, this freshness factor makes this easier, but in other ways, it can hurt you in the long run.

My Original Post [webmasterworld.com] describes a story where my site ended up being "too fresh" for its own good. The thread then goes on a little bit to explore ideas about how to key in on which pages are likely to get freshed.

G.

[troels nybo nielsen]

In october I more or less tore down a website and only kept the original frontpage (mydomain.dk/mysite/index.htm) with a redirect to the new address (mywonderfulnewdomain.dk). And now I am slowly rebuilding the website there.

Last week a new page of mine gained a #1 on one of my most important keywords. After a couple of days it was pushed down as #2 by a new competitor's frontpage. Earlier this week my page completely disappeared as told above.

I have just searched again. To of my other pages now are #1 and #2. And the competitor is out.

Typical freshbot everflux.

[xbase234]

Had a new site that was submitted last week immediately pushed in SERP's as a result of everflux and the deep crawl. All I can say is that I finished the site at just the right time (deep crawl before dance). I also credit a lightning speed DMOZ listing as well - less than a week and I was in.

From what I saw in the Google SERP's, I'm going to have a nice debut.

[wasmith]

I've one url that has maintained (with good reason) a fresh tag awhile now. The fresh dropped during the update but nearly everday it is fresh.

I have a newer fresh url which is only freshed about 50% of the time.

It took me awhile to figure out how to use search engine traffic effectively. I kind of think freshbot is simular. But anything that can move a site in the serps is important, even if it is only 50% of the time.

[Stefan]

I've been getting my entire .org site crawled by the freshbot every other day since the last index. I just started the thing in Sept, got on dmoz, then got in the index at the end of Oct. Now Google seems to love me.
Thanks to all the tips I learned here, I'm managing to get #1, or close, on every kw as I fine tune things day by day. Wicked. The freshbot is more than welcome to drop by as often as it likes.

[Visit Thailand]

I would like to ask a question relates to this topic.

We (on one site) have added the google no cache tag to pretty much all our pages to ensure that visitors a) come to our site and get sticky or b) that visitors who use cache get the most up to date and valid version.

Since we have done so we have not lost position but we have lost the dates.

Do you think google should add the frsh dates to google even though the no cache is in the page? AV now has some of our pages as modified in the last 24 hours. I like that as it shows users we are constantly on the site.