Forum Moderators: open

Message Too Old, No Replies

Is this Textbook Everflux, or am I going mad?

Wondering about the logic of Everflux

         

TFLCreator

5:27 pm on Nov 13, 2002 (gmt 0)

10+ Year Member



Hi, all. 6 days ago, we optimized the URL structure of our dynamic links on our site so that the GoogleBot(s) would be able to spider them with ease. One day after deploying that change, we suddenly noticed an insane amount of GoogleBot spider activity on our server. We watched with glee as the bot proceeded to spider thousands of our dynamic product pages. And then, just two days ago, on Monday, we were blown away to find that a number (probably between 25-30) of our dynamic product pages were suddenly actually indexed in Google (www). We couldn't believe our eyes! We understood a bit about the Freshbot, and the EverFlux effect. But this past Monday and Tuesday, we have seen these dynamic pages remain in Google. A thrill for us, as we have been working on this project for close to a year. But then, just this morning, when we went to do our daily Google inspection, we found that those newly indexed pages have disappeared. It seems that those pages are now being listed on the www2 and www3 staging servers instead of the main Google index. Can anyone tell me with any degree of experience or certainty that what has just happened is common Everflux activity? We know full well that the deep crawl and index isnt due until around the 26th-28th of this month, but what of this temporariy indexing? Why would it have been in the primary Google for two days, then dropped down to www2/www3 today? Is it a reason to be significantly concerned? In all honesty, we didnt expect at all that we'd have ANY of our spidered pages indexed in Google until the end of the month. So these few pages that did appear were a pleasant suprise, to be sure, but fleeting... where did they go?

Any insight would be great.

Chris

veritysystems

5:37 pm on Nov 13, 2002 (gmt 0)

10+ Year Member



There does seem to be more movement this month, with freshbot visiting every day. Maybe, they are moving away from the dance to a continuous update?

TFLCreator

5:46 pm on Nov 13, 2002 (gmt 0)

10+ Year Member



I think you might be right. I mean, it was literally only one day after we made the changes to our site that the FreshBot came back and started running links like crazy. And then, two days later, to actually see a small but significant number of dynamic page results appearing in Google (and ranking quite highly, I might add) was something we never thought possible. But now, as I was suspiciously expecting, the results are now changing (moving from www to www2, for example) on a daily basis, and it makes it that much harder to jump up and down with joy at the results. We realize that we'll have to wait until the end of the month to see results that 'stick', but even then, who really knows what Google may do differently next time.... my kingdom for a certainty...

conor

6:11 pm on Nov 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The 'Fresh' index is non-permanent -- it only holds what was crawled by the 'Fresh crawl', thus does not ever hit www2 or www3. If a site/page was not included in the most recent 'Fresh crawl' it will drop from the index but will most likley re-appear in the permanent index after the next update.

xbase234

6:22 pm on Nov 13, 2002 (gmt 0)

10+ Year Member



Not sure if you could call it "textbook". The freshbot has been going nuts on my new site. I was expecting to wait a couple of months to be properly indexed, but it may be just a couple of weeks instead (I also credit a lightning-speed DMOZ listing for this).

Just in time for the deep crawl.

TFLCreator

6:25 pm on Nov 13, 2002 (gmt 0)

10+ Year Member



If I am understanding what you are saying, how can it be that our 25-30 new pages were to be found in the www.google.com index AND www2/www3.google.com index(only 3 days after we put them up, and only 2 days after being spidered by GoogleBot) on Sunday, Monday, and Tuesday, but today, those new pages are no longer in www.google.com, byt the are still in www2/www3. It sounded like you said that the FreshIndex results do not ever end up in the www2 or www3 indices, but that is where our new pages are located right now, as we speak. Am I missing a point or two?

jilla

11:44 pm on Nov 13, 2002 (gmt 0)

10+ Year Member



The same thing happened to me. I got a ton of traffic Mon and Tues and then it died. I am wondering if it would help to add a little new content each day now. Will that bring it back into everflux mode? Or will it not help when you get "un-fluxed"?